== sanity-scrub test 4c: Auto trigger OI scrub if bad OI mapping was found (3) ========================================================== 16:57:51 (1718398671) preparing... Fri Jun 14 16:57:51 EDT 2024 creating 500 files on mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126097 s, 83.2 MB/s prepared Fri Jun 14 16:57:55 EDT 2024. stop mds1 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg251-server: oleg251-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg251-client: oleg251-server: ssh exited with exit code 1 Starting client: oleg251-client.virtnet: -o user_xattr,flock oleg251-server@tcp:/lustre /mnt/lustre OI scrub on MDS1 status for the 1st time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 40 seconds time_since_latest_start: 5 seconds time_since_last_checkpoint: 5 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 3 updated: 0 failed: 0 prior_updated: 3 noscrub: 0 igif: 0 success_count: 7 run_time: 4 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS1 status for the 2nd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 44 seconds time_since_latest_start: 9 seconds time_since_last_checkpoint: 9 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 4 updated: 0 failed: 0 prior_updated: 4 noscrub: 0 igif: 0 success_count: 7 run_time: 8 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS1 status for the 3rd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 5 seconds time_since_latest_start: 5 seconds time_since_last_checkpoint: 5 seconds latest_start_position: 12 last_checkpoint_position: 160001 first_failure_position: N/A checked: 764 updated: 568 failed: 0 prior_updated: 21 noscrub: 70 igif: 1 success_count: 8 run_time: 0 seconds average_speed: 764 objects/sec real_time_speed: N/A current_position: N/A lf_scanned: 0 lf_repaired: 0 lf_failed: 0 -r--r--r-- 1 root root 0 Jun 14 16:57 /mnt/lustre/d4c.sanity-scrub/mds1/f4c.sanity-scrub1