-----============= acceptance-small: sanity-scrub ============----- Tue Apr 1 03:45:04 EDT 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg605-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-scrub.*ex': No such file or directory excepting tests: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions client=34616393 MDS=34616393 OSS=34616393 Stopping clients: oleg605-client.virtnet /mnt/lustre (opts:) Stopping client oleg605-client.virtnet /mnt/lustre opts: Stopping clients: oleg605-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg605-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg605-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg605-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg605-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing unload_modules_local oleg605-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. === sanity-scrub: start setup 03:48:23 (1743493703) === Stopping clients: oleg605-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg605-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 2 oleg605-server: oleg605-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions oleg605-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg605-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/vdc pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Format mds2: /dev/vdd pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Format ost1: /dev/vde pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Format ost2: /dev/vdf pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Commit the device label on /dev/vdc Started lustre-MDT0000 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Commit the device label on /dev/vdd Started lustre-MDT0001 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Commit the device label on /dev/vde Started lustre-OST0000 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Commit the device label on /dev/vdf Started lustre-OST0001 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f296e564000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f296e564000.idle_timeout=debug setting jobstats to procname_uid Setting lustre.sys.jobid_var from disable to procname_uid Waiting 90s for 'procname_uid' disable quota as required osd-ldiskfs.track_declares_assert=1 === sanity-scrub: finish setup 03:54:43 (1743494083) === == sanity-scrub test 0: Do not auto trigger OI scrub for non-backup/restore case ========================================================== 03:54:48 (1743494088) preparing... Tue Apr 1 03:54:53 EDT 2025 creating 0 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d0.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109655 s, 9.6 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d0.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0522534 s, 20.1 MB/s prepared Tue Apr 1 03:55:09 EDT 2025. stop mds1 stop mds2 starting MDTs without disabling OI scrub oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre PASS 0 (132s) == sanity-scrub test 1a: Auto trigger initial OI scrub when server mounts ========================================================== 03:57:00 (1743494220) preparing... Tue Apr 1 03:57:10 EDT 2025 creating 0 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d1a.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12289 s, 8.5 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d1a.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125789 s, 8.3 MB/s prepared Tue Apr 1 03:57:25 EDT 2025. stop mds1 stop mds2 start mds1 without disabling OI scrub: -o localrecov -o user_xattr oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre fail_loc=0x193 fail_loc=0 192.168.206.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project 0 0 Stopping client oleg605-client.virtnet /mnt/lustre (opts:) stop mds1 start mds1 with disabling OI scrub: -o localrecov -o user_xattr,noscrub oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 PASS 1a (166s) == sanity-scrub test 1b: Trigger OI scrub when MDT mounts for OI files remove/recreate case ========================================================== 03:59:46 (1743494386) Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: Force libcfs to create 2 CPU partitions oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f296ea0c000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f296ea0c000.idle_timeout=debug disable quota as required preparing... Tue Apr 1 04:01:57 EDT 2025 creating 0 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d1b.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0366563 s, 28.6 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d1b.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0726831 s, 14.4 MB/s prepared Tue Apr 1 04:02:13 EDT 2025. fail_loc=0x198 fail_loc=0 stop mds1 stop mds2 removing OI files on mds1: idx= removed '/mnt/lustre-brpt/oi.16.0' removed '/mnt/lustre-brpt/oi.16.1' removed '/mnt/lustre-brpt/oi.16.10' removed '/mnt/lustre-brpt/oi.16.11' removed '/mnt/lustre-brpt/oi.16.12' removed '/mnt/lustre-brpt/oi.16.13' removed '/mnt/lustre-brpt/oi.16.14' removed '/mnt/lustre-brpt/oi.16.15' removed '/mnt/lustre-brpt/oi.16.16' removed '/mnt/lustre-brpt/oi.16.17' removed '/mnt/lustre-brpt/oi.16.18' removed '/mnt/lustre-brpt/oi.16.19' removed '/mnt/lustre-brpt/oi.16.2' removed '/mnt/lustre-brpt/oi.16.20' removed '/mnt/lustre-brpt/oi.16.21' removed '/mnt/lustre-brpt/oi.16.22' removed '/mnt/lustre-brpt/oi.16.23' removed '/mnt/lustre-brpt/oi.16.24' removed '/mnt/lustre-brpt/oi.16.25' removed '/mnt/lustre-brpt/oi.16.26' removed '/mnt/lustre-brpt/oi.16.27' removed '/mnt/lustre-brpt/oi.16.28' removed '/mnt/lustre-brpt/oi.16.29' removed '/mnt/lustre-brpt/oi.16.3' removed '/mnt/lustre-brpt/oi.16.30' removed '/mnt/lustre-brpt/oi.16.31' removed '/mnt/lustre-brpt/oi.16.32' removed '/mnt/lustre-brpt/oi.16.33' removed '/mnt/lustre-brpt/oi.16.34' removed '/mnt/lustre-brpt/oi.16.35' removed '/mnt/lustre-brpt/oi.16.36' removed '/mnt/lustre-brpt/oi.16.37' removed '/mnt/lustre-brpt/oi.16.38' removed '/mnt/lustre-brpt/oi.16.39' removed '/mnt/lustre-brpt/oi.16.4' removed '/mnt/lustre-brpt/oi.16.40' removed '/mnt/lustre-brpt/oi.16.41' removed '/mnt/lustre-brpt/oi.16.42' removed '/mnt/lustre-brpt/oi.16.43' removed '/mnt/lustre-brpt/oi.16.44' removed '/mnt/lustre-brpt/oi.16.45' removed '/mnt/lustre-brpt/oi.16.46' removed '/mnt/lustre-brpt/oi.16.47' removed '/mnt/lustre-brpt/oi.16.48' removed '/mnt/lustre-brpt/oi.16.49' removed '/mnt/lustre-brpt/oi.16.5' removed '/mnt/lustre-brpt/oi.16.50' removed '/mnt/lustre-brpt/oi.16.51' removed '/mnt/lustre-brpt/oi.16.52' removed '/mnt/lustre-brpt/oi.16.53' removed '/mnt/lustre-brpt/oi.16.54' removed '/mnt/lustre-brpt/oi.16.55' removed '/mnt/lustre-brpt/oi.16.56' removed '/mnt/lustre-brpt/oi.16.57' removed '/mnt/lustre-brpt/oi.16.58' removed '/mnt/lustre-brpt/oi.16.59' removed '/mnt/lustre-brpt/oi.16.6' removed '/mnt/lustre-brpt/oi.16.60' removed '/mnt/lustre-brpt/oi.16.61' removed '/mnt/lustre-brpt/oi.16.62' removed '/mnt/lustre-brpt/oi.16.63' removed '/mnt/lustre-brpt/oi.16.7' removed '/mnt/lustre-brpt/oi.16.8' removed '/mnt/lustre-brpt/oi.16.9' removing OI files on mds2: idx= removed '/mnt/lustre-brpt/oi.16.0' removed '/mnt/lustre-brpt/oi.16.1' removed '/mnt/lustre-brpt/oi.16.10' removed '/mnt/lustre-brpt/oi.16.11' removed '/mnt/lustre-brpt/oi.16.12' removed '/mnt/lustre-brpt/oi.16.13' removed '/mnt/lustre-brpt/oi.16.14' removed '/mnt/lustre-brpt/oi.16.15' removed '/mnt/lustre-brpt/oi.16.16' removed '/mnt/lustre-brpt/oi.16.17' removed '/mnt/lustre-brpt/oi.16.18' removed '/mnt/lustre-brpt/oi.16.19' removed '/mnt/lustre-brpt/oi.16.2' removed '/mnt/lustre-brpt/oi.16.20' removed '/mnt/lustre-brpt/oi.16.21' removed '/mnt/lustre-brpt/oi.16.22' removed '/mnt/lustre-brpt/oi.16.23' removed '/mnt/lustre-brpt/oi.16.24' removed '/mnt/lustre-brpt/oi.16.25' removed '/mnt/lustre-brpt/oi.16.26' removed '/mnt/lustre-brpt/oi.16.27' removed '/mnt/lustre-brpt/oi.16.28' removed '/mnt/lustre-brpt/oi.16.29' removed '/mnt/lustre-brpt/oi.16.3' removed '/mnt/lustre-brpt/oi.16.30' removed '/mnt/lustre-brpt/oi.16.31' removed '/mnt/lustre-brpt/oi.16.32' removed '/mnt/lustre-brpt/oi.16.33' removed '/mnt/lustre-brpt/oi.16.34' removed '/mnt/lustre-brpt/oi.16.35' removed '/mnt/lustre-brpt/oi.16.36' removed '/mnt/lustre-brpt/oi.16.37' removed '/mnt/lustre-brpt/oi.16.38' removed '/mnt/lustre-brpt/oi.16.39' removed '/mnt/lustre-brpt/oi.16.4' removed '/mnt/lustre-brpt/oi.16.40' removed '/mnt/lustre-brpt/oi.16.41' removed '/mnt/lustre-brpt/oi.16.42' removed '/mnt/lustre-brpt/oi.16.43' removed '/mnt/lustre-brpt/oi.16.44' removed '/mnt/lustre-brpt/oi.16.45' removed '/mnt/lustre-brpt/oi.16.46' removed '/mnt/lustre-brpt/oi.16.47' removed '/mnt/lustre-brpt/oi.16.48' removed '/mnt/lustre-brpt/oi.16.49' removed '/mnt/lustre-brpt/oi.16.5' removed '/mnt/lustre-brpt/oi.16.50' removed '/mnt/lustre-brpt/oi.16.51' removed '/mnt/lustre-brpt/oi.16.52' removed '/mnt/lustre-brpt/oi.16.53' removed '/mnt/lustre-brpt/oi.16.54' removed '/mnt/lustre-brpt/oi.16.55' removed '/mnt/lustre-brpt/oi.16.56' removed '/mnt/lustre-brpt/oi.16.57' removed '/mnt/lustre-brpt/oi.16.58' removed '/mnt/lustre-brpt/oi.16.59' removed '/mnt/lustre-brpt/oi.16.6' removed '/mnt/lustre-brpt/oi.16.60' removed '/mnt/lustre-brpt/oi.16.61' removed '/mnt/lustre-brpt/oi.16.62' removed '/mnt/lustre-brpt/oi.16.63' removed '/mnt/lustre-brpt/oi.16.7' removed '/mnt/lustre-brpt/oi.16.8' removed '/mnt/lustre-brpt/oi.16.9' start MDTs without disabling OI scrub oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre PASS 1b (277s) == sanity-scrub test 1c: Auto detect kinds of OI file(s) removed/recreated cases ========================================================== 04:04:23 (1743494663) preparing... Tue Apr 1 04:04:31 EDT 2025 creating 0 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d1c.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0481281 s, 21.8 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d1c.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0715276 s, 14.7 MB/s prepared Tue Apr 1 04:04:46 EDT 2025. stop mds1 stop mds2 removing OI files on mds1: idx=0 removed '/mnt/lustre-brpt/oi.16.0' removing OI files on mds2: idx=0 removed '/mnt/lustre-brpt/oi.16.0' start MDTs with OI scrub disabled oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f296e869000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f296e869000.idle_timeout=debug disable quota as required preparing... Tue Apr 1 04:08:53 EDT 2025 creating 0 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d1c.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.160504 s, 6.5 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d1c.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112198 s, 9.3 MB/s prepared Tue Apr 1 04:09:09 EDT 2025. stop mds1 stop mds2 removing OI files on mds1: idx=2 removed '/mnt/lustre-brpt/oi.16.2' removed '/mnt/lustre-brpt/oi.16.4' removed '/mnt/lustre-brpt/oi.16.8' removed '/mnt/lustre-brpt/oi.16.16' removed '/mnt/lustre-brpt/oi.16.32' removing OI files on mds2: idx=2 removed '/mnt/lustre-brpt/oi.16.2' removed '/mnt/lustre-brpt/oi.16.4' removed '/mnt/lustre-brpt/oi.16.8' removed '/mnt/lustre-brpt/oi.16.16' removed '/mnt/lustre-brpt/oi.16.32' start MDTs with OI scrub disabled oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f295f141000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f295f141000.idle_timeout=debug disable quota as required preparing... Tue Apr 1 04:13:06 EDT 2025 creating 0 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d1c.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0467656 s, 22.4 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d1c.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108415 s, 9.7 MB/s prepared Tue Apr 1 04:13:19 EDT 2025. stop mds1 stop mds2 removing OI files on mds1: idx=3 removed '/mnt/lustre-brpt/oi.16.3' removed '/mnt/lustre-brpt/oi.16.9' removed '/mnt/lustre-brpt/oi.16.27' removing OI files on mds2: idx=3 removed '/mnt/lustre-brpt/oi.16.3' removed '/mnt/lustre-brpt/oi.16.9' removed '/mnt/lustre-brpt/oi.16.27' start MDTs with OI scrub disabled oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub PASS 1c (660s) == sanity-scrub test 2: Trigger OI scrub when MDT mounts for backup/restore case ========================================================== 04:15:24 (1743495324) Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f296e149000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f296e149000.idle_timeout=debug disable quota as required preparing... Tue Apr 1 04:17:22 EDT 2025 creating 0 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d2.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0388321 s, 27.0 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d2.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0995149 s, 10.5 MB/s prepared Tue Apr 1 04:17:37 EDT 2025. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs without disabling OI scrub oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre PASS 2 (303s) == sanity-scrub test 4a: Auto trigger OI scrub if bad OI mapping was found (1) ========================================================== 04:20:28 (1743495628) preparing... Tue Apr 1 04:20:36 EDT 2025 creating 0 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d4a.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0870048 s, 12.1 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d4a.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0634374 s, 16.5 MB/s prepared Tue Apr 1 04:20:49 EDT 2025. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre PASS 4a (219s) == sanity-scrub test 4b: Auto trigger OI scrub if bad OI mapping was found (2) ========================================================== 04:24:06 (1743495846) preparing... Tue Apr 1 04:24:15 EDT 2025 creating 5 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d4b.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100067 s, 10.5 MB/s creating 5 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d4b.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133693 s, 7.8 MB/s prepared Tue Apr 1 04:24:32 EDT 2025. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre OI scrub on MDS1 status for the 1st time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 238 seconds time_since_latest_start: 14 seconds time_since_last_checkpoint: 14 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 3 updated: 0 failed: 0 prior_updated: 3 noscrub: 0 igif: 0 success_count: 6 run_time: 14 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 1st time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 240 seconds time_since_latest_start: 15 seconds time_since_last_checkpoint: 15 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 1 updated: 0 failed: 0 prior_updated: 1 noscrub: 0 igif: 0 success_count: 6 run_time: 15 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS1 status for the 2nd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 256 seconds time_since_latest_start: 32 seconds time_since_last_checkpoint: 32 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 4 updated: 0 failed: 0 prior_updated: 4 noscrub: 0 igif: 0 success_count: 6 run_time: 32 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 2nd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 258 seconds time_since_latest_start: 33 seconds time_since_last_checkpoint: 33 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 2 updated: 0 failed: 0 prior_updated: 2 noscrub: 0 igif: 0 success_count: 6 run_time: 33 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS1 status for the 3rd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 49 seconds time_since_latest_start: 49 seconds time_since_last_checkpoint: 49 seconds latest_start_position: 12 last_checkpoint_position: 160001 first_failure_position: N/A checked: 255 updated: 50 failed: 0 prior_updated: 38 noscrub: 70 igif: 1 success_count: 7 run_time: 0 seconds average_speed: 255 objects/sec real_time_speed: N/A current_position: N/A lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 3rd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 20 seconds time_since_latest_start: 20 seconds time_since_last_checkpoint: 20 seconds latest_start_position: 12 last_checkpoint_position: 160001 first_failure_position: N/A checked: 234 updated: 52 failed: 0 prior_updated: 35 noscrub: 73 igif: 1 success_count: 7 run_time: 0 seconds average_speed: 234 objects/sec real_time_speed: N/A current_position: N/A lf_scanned: 0 lf_repaired: 0 lf_failed: 0 total 1024 -rw-r--r-- 1 root root 0 Apr 1 04:24 f1 -rw-r--r-- 1 root root 1048576 Apr 1 04:24 f2 total 1024 -rw-r--r-- 1 root root 0 Apr 1 04:24 f1 -rw-r--r-- 1 root root 1048576 Apr 1 04:24 f2 PASS 4b (331s) == sanity-scrub test 4c: Auto trigger OI scrub if bad OI mapping was found (3) ========================================================== 04:29:37 (1743496177) preparing... Tue Apr 1 04:29:44 EDT 2025 creating 500 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d4c.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0805889 s, 13.0 MB/s creating 500 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d4c.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0457372 s, 22.9 MB/s prepared Tue Apr 1 04:30:29 EDT 2025. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre OI scrub on MDS1 status for the 1st time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 310 seconds time_since_latest_start: 19 seconds time_since_last_checkpoint: 19 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 3 updated: 0 failed: 0 prior_updated: 3 noscrub: 0 igif: 0 success_count: 7 run_time: 19 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 1st time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 281 seconds time_since_latest_start: 19 seconds time_since_last_checkpoint: 19 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 1 updated: 0 failed: 0 prior_updated: 1 noscrub: 0 igif: 0 success_count: 7 run_time: 19 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS1 status for the 2nd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 328 seconds time_since_latest_start: 37 seconds time_since_last_checkpoint: 37 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 4 updated: 0 failed: 0 prior_updated: 4 noscrub: 0 igif: 0 success_count: 7 run_time: 37 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 2nd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 298 seconds time_since_latest_start: 36 seconds time_since_last_checkpoint: 36 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 2 updated: 0 failed: 0 prior_updated: 2 noscrub: 0 igif: 0 success_count: 7 run_time: 36 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS1 status for the 3rd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 37 seconds time_since_latest_start: 37 seconds time_since_last_checkpoint: 37 seconds latest_start_position: 12 last_checkpoint_position: 160001 first_failure_position: N/A checked: 752 updated: 562 failed: 0 prior_updated: 21 noscrub: 70 igif: 1 success_count: 8 run_time: 0 seconds average_speed: 752 objects/sec real_time_speed: N/A current_position: N/A lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 3rd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 19 seconds time_since_latest_start: 20 seconds time_since_last_checkpoint: 19 seconds latest_start_position: 12 last_checkpoint_position: 160001 first_failure_position: N/A checked: 731 updated: 561 failed: 0 prior_updated: 21 noscrub: 73 igif: 1 success_count: 8 run_time: 1 seconds average_speed: 731 objects/sec real_time_speed: N/A current_position: N/A lf_scanned: 0 lf_repaired: 0 lf_failed: 0 -r--r--r-- 1 root root 0 Apr 1 04:29 /mnt/lustre/d4c.sanity-scrub/mds1/f4c.sanity-scrub1 -r--r--r-- 1 root root 0 Apr 1 04:30 /mnt/lustre/d4c.sanity-scrub/mds2/f4c.sanity-scrub1 PASS 4c (337s) == sanity-scrub test 4d: FID in LMA mismatch with object FID won't block create ========================================================== 04:35:14 (1743496514) fail_loc=0x19b fail_loc=0 PASS 4d (63s) == sanity-scrub test 4e: FID reuse can be fixed ========== 04:36:18 (1743496578) - precreated_ost_obj_count lustre-OST0000-osc-MDT0000 prealloc_last_id: 801 prealloc_next_id: 774 count: 28 fail_loc=0x1a0 fail_loc=0 Started LFSCK on the device lustre-OST0000: scrub PASS 4e (36s) == sanity-scrub test 5: OI scrub state machine =========== 04:36:54 (1743496614) oleg605-server: oleg605-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Using TIMEOUT=20 preparing... Tue Apr 1 04:42:30 EDT 2025 creating 100 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d5.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0516379 s, 20.3 MB/s creating 100 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d5.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.063399 s, 16.5 MB/s prepared Tue Apr 1 04:42:47 EDT 2025. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled (1) oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre fail_val=3 fail_loc=0x190 192.168.206.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project 0 0 Stopping client oleg605-client.virtnet /mnt/lustre (opts:) fail_loc=0x191 stopping mds1 stopping mds2 fail_loc=0 fail_val=0 starting MDTs with OI scrub disabled (2) oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 stopping mds1 stopping mds2 fail_val=3 fail_loc=0x190 starting MDTs without disabling OI scrub oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 fail_loc=0x192 Waiting 6s for 'failed' Updated after 2s: want 'failed' got 'failed' Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre fail_loc=0 fail_val=0 File: /mnt/lustre/d5.sanity-scrub/mds2/sanity-scrub.sh Size: 42895 Blocks: 88 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 162129603798761540 Links: 1 Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-01 04:44:15.000000000 -0400 Modify: 2025-04-01 04:42:44.000000000 -0400 Change: 2025-04-01 04:44:15.000000000 -0400 Birth: 2025-04-01 04:44:15.000000000 -0400 File: /mnt/lustre/d5.sanity-scrub/mds1/sanity-scrub.sh Size: 42895 Blocks: 88 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205289279557 Links: 1 Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-01 04:43:43.000000000 -0400 Modify: 2025-04-01 04:42:36.000000000 -0400 Change: 2025-04-01 04:43:43.000000000 -0400 Birth: 2025-04-01 04:43:43.000000000 -0400 PASS 5 (707s) == sanity-scrub test 6: OI scrub resumes from last checkpoint ========================================================== 04:48:42 (1743497322) preparing... Tue Apr 1 04:48:54 EDT 2025 creating 100 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d6.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0607895 s, 17.2 MB/s creating 100 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d6.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0476122 s, 22.0 MB/s prepared Tue Apr 1 04:49:08 EDT 2025. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre fail_val=2 fail_loc=0x190 fail_loc=0x192 Waiting 6s for 'failed' Updated after 2s: want 'failed' got 'failed' fail_val=3 fail_loc=0x190 File: /mnt/lustre/d6.sanity-scrub/mds1/sanity-scrub.sh Size: 42895 Blocks: 88 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115305952575557 Links: 1 Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-01 04:49:59.000000000 -0400 Modify: 2025-04-01 04:48:59.000000000 -0400 Change: 2025-04-01 04:49:59.000000000 -0400 Birth: 2025-04-01 04:49:59.000000000 -0400 File: /mnt/lustre/d6.sanity-scrub/mds2/sanity-scrub.sh Size: 42895 Blocks: 88 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 162129704445280324 Links: 1 Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-01 04:50:30.000000000 -0400 Modify: 2025-04-01 04:49:06.000000000 -0400 Change: 2025-04-01 04:50:30.000000000 -0400 Birth: 2025-04-01 04:50:30.000000000 -0400 192.168.206.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project 0 0 Stopping client oleg605-client.virtnet /mnt/lustre (opts:) fail_loc=0x191 stopping mds1 stopping mds2 fail_val=3 fail_loc=0x190 starting MDTs without disabling OI scrub oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 PASS 6 (306s) == sanity-scrub test 7: System is available during OI scrub scanning ========================================================== 04:53:49 (1743497629) Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f295f2f9000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f295f2f9000.idle_timeout=debug disable quota as required preparing... Tue Apr 1 04:55:39 EDT 2025 creating 500 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d7.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0482829 s, 21.7 MB/s creating 500 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d7.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0400545 s, 26.2 MB/s prepared Tue Apr 1 04:56:11 EDT 2025. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre fail_val=3 fail_loc=0x190 File: /mnt/lustre/d7.sanity-scrub/mds1/f7.sanity-scrub300 Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115373061439871 Links: 1 Access: (0444/-r--r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-01 04:56:54.000000000 -0400 Modify: 2025-04-01 04:55:52.000000000 -0400 Change: 2025-04-01 04:56:54.000000000 -0400 Birth: 2025-04-01 04:56:54.000000000 -0400 File: /mnt/lustre/d7.sanity-scrub/mds2/f7.sanity-scrub300 Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 162129771554144638 Links: 1 Access: (0444/-r--r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-01 04:57:20.000000000 -0400 Modify: 2025-04-01 04:56:07.000000000 -0400 Change: 2025-04-01 04:57:20.000000000 -0400 Birth: 2025-04-01 04:57:20.000000000 -0400 fail_loc=0 fail_val=0 Waiting 6s for 'completed' Updated after 2s: want 'completed' got 'completed' PASS 7 (298s) == sanity-scrub test 8: Control OI scrub manually ======== 04:58:46 (1743497926) preparing... Tue Apr 1 04:59:10 EDT 2025 creating 128 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d8.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101662 s, 10.3 MB/s creating 128 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d8.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0552937 s, 19.0 MB/s prepared Tue Apr 1 04:59:38 EDT 2025. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 fail_val=1 fail_loc=0x190 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Stopped LFSCK on the device lustre-MDT0000. Stopped LFSCK on the device lustre-MDT0001. Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub fail_loc=0 fail_val=0 PASS 8 (205s) == sanity-scrub test 9: OI scrub speed control =========== 05:02:11 (1743498131) Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f296e1a9000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f296e1a9000.idle_timeout=debug disable quota as required preparing... Tue Apr 1 05:03:50 EDT 2025 creating 6000 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d9.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0410759 s, 25.5 MB/s creating 6000 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d9.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0551528 s, 19.0 MB/s prepared Tue Apr 1 05:06:00 EDT 2025. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub PASS 9 (432s) == sanity-scrub test 10a: non-stopped OI scrub should auto restarts after MDS remount (1) ========================================================== 05:09:23 (1743498563) Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f296e811000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f296e811000.idle_timeout=debug disable quota as required preparing... Tue Apr 1 05:14:21 EDT 2025 creating 0 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d10a.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030628 s, 34.2 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d10a.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0491689 s, 21.3 MB/s prepared Tue Apr 1 05:14:31 EDT 2025. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting mds with OI scrub disabled (1) oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre fail_val=1 fail_loc=0x190 192.168.206.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project 0 0 Stopping client oleg605-client.virtnet /mnt/lustre (opts:) stopping mds1 stopping mds2 starting MDTs with OI scrub disabled (2) oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 stopping mds1 stopping mds2 starting MDTs without disabling OI scrub oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 PASS 10a (541s) == sanity-scrub test 11: OI scrub skips the new created objects only once ========================================================== 05:18:24 (1743499104) Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f296f429000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f296f429000.idle_timeout=debug disable quota as required striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d11.sanity-scrub/mds1 total: 100 open/close in 1.86 seconds: 53.75 ops/second striped dir -i1 -c1 -H crush /mnt/lustre/d11.sanity-scrub/mds2 total: 100 open/close in 2.02 seconds: 49.56 ops/second Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub PASS 11 (111s) == sanity-scrub test 12: OI scrub can rebuild invalid /O entries ========================================================== 05:20:15 (1743499215) fail_loc=0x195 - precreated_ost_obj_count lustre-OST0000-osc-MDT0000 prealloc_last_id: 641 prealloc_next_id: 596 count: 46 total: 78 open/close in 1.33 seconds: 58.44 ops/second 192.168.206.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project 0 0 Stopping client oleg605-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg605-server fail_loc=0x233 Starting ost1: -o localrecov -o user_xattr,noscrub /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-OST0000 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started LFSCK on the device lustre-OST0000: scrub fail_loc=0 PASS 12 (221s) == sanity-scrub test 13: OI scrub can rebuild missed /O entries ========================================================== 05:23:57 (1743499437) fail_loc=0x196 - precreated_ost_obj_count lustre-OST0000-osc-MDT0000 prealloc_last_id: 705 prealloc_next_id: 674 count: 32 total: 64 open/close in 1.00 seconds: 64.12 ops/second fail_loc=0 192.168.206.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project 0 0 Stopping client oleg605-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg605-server Starting ost1: -o localrecov -o user_xattr,noscrub /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-OST0000 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started LFSCK on the device lustre-OST0000: scrub PASS 13 (215s) == sanity-scrub test 14: OI scrub can repair OST objects under lost+found ========================================================== 05:27:32 (1743499652) fail_loc=0x196 - precreated_ost_obj_count lustre-OST0000-osc-MDT0000 prealloc_last_id: 769 prealloc_next_id: 738 count: 32 - open/close 672 (time 1743499671.00 total 10.00 last 67.17) total: 1032 open/close in 15.31 seconds: 67.42 ops/second fail_loc=0 192.168.206.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project 0 0 Stopping client oleg605-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg605-server run e2fsck e2fsck -d -v -t -t -f -y /dev/mapper/ost1_flakey -m8 oleg605-server: e2fsck 1.47.1-wc2 (08-Nov-2024) oleg605-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 3], used inodes 1406/100000 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2311: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 152 badness 0 to 2 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2675: increase inode 25030 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 25031 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] Pass 1: Memory used: 292k/0k (166k/127k), time: 0.02/ 0.01/ 0.01 [Thread 0] Pass 1: I/O read: 5MB, write: 0MB, rate: 246.51MB/s [Thread 0] Scanned group range [0, 3], used inodes 1406/1406 Pass 2: Checking directory structure Pass 2: Memory used: 292k/0k (118k/175k), time: 0.03/ 0.00/ 0.01 Pass 2: I/O read: 1MB, write: 0MB, rate: 38.41MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 292k/0k (118k/175k), time: 0.06/ 0.01/ 0.02 Pass 3A: Memory used: 292k/0k (119k/174k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 292k/0k (116k/177k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 4784.69MB/s Pass 4: Checking reference counts Unattached inode 118 Connect to /lost+found? yes Inode 118 ref count is 2, should be 1. Fix? yes Unattached inode 119 Connect to /lost+found? yes Inode 119 ref count is 2, should be 1. Fix? yes Unattached inode 120 Connect to /lost+found? yes Inode 120 ref count is 2, should be 1. Fix? yes Unattached inode 121 Connect to /lost+found? yes Inode 121 ref count is 2, should be 1. Fix? yes Unattached inode 122 Connect to /lost+found? yes Inode 122 ref count is 2, should be 1. Fix? yes Unattached inode 123 Connect to /lost+found? yes Inode 123 ref count is 2, should be 1. Fix? yes Unattached inode 124 Connect to /lost+found? yes Inode 124 ref count is 2, should be 1. Fix? yes Unattached inode 125 Connect to /lost+found? yes Inode 125 ref count is 2, should be 1. Fix? yes Unattached inode 126 Connect to /lost+found? yes Inode 126 ref count is 2, should be 1. Fix? yes Unattached inode 127 Connect to /lost+found? yes Inode 127 ref count is 2, should be 1. Fix? yes Unattached inode 128 Connect to /lost+found? yes Inode 128 ref count is 2, should be 1. Fix? yes Unattached inode 129 Connect to /lost+found? yes Inode 129 ref count is 2, should be 1. Fix? yes Unattached inode 130 Connect to /lost+found? yes Inode 130 ref count is 2, should be 1. Fix? yes Unattached inode 131 Connect to /lost+found? yes Inode 131 ref count is 2, should be 1. Fix? yes Unattached inode 132 Connect to /lost+found? yes Inode 132 ref count is 2, should be 1. Fix? yes Unattached inode 133 Connect to /lost+found? yes Inode 133 ref count is 2, should be 1. Fix? yes Unattached inode 134 Connect to /lost+found? yes Inode 134 ref count is 2, should be 1. Fix? yes Unattached inode 135 Connect to /lost+found? yes Inode 135 ref count is 2, should be 1. Fix? yes Unattached inode 136 Connect to /lost+found? yes Inode 136 ref count is 2, should be 1. Fix? yes Unattached inode 137 Connect to /lost+found? yes Inode 137 ref count is 2, should be 1. Fix? yes Unattached inode 138 Connect to /lost+found? yes Inode 138 ref count is 2, should be 1. Fix? yes Unattached inode 139 Connect to /lost+found? yes Inode 139 ref count is 2, should be 1. Fix? yes Unattached inode 140 Connect to /lost+found? yes Inode 140 ref count is 2, should be 1. Fix? yes Unattached inode 141 Connect to /lost+found? yes Inode 141 ref count is 2, should be 1. Fix? yes Unattached inode 142 Connect to /lost+found? yes Inode 142 ref count is 2, should be 1. Fix? yes Unattached inode 143 Connect to /lost+found? yes Inode 143 ref count is 2, should be 1. Fix? yes Unattached inode 145 Connect to /lost+found? yes Inode 145 ref count is 2, should be 1. Fix? yes Unattached inode 146 Connect to /lost+found? yes Inode 146 ref count is 2, should be 1. Fix? yes Unattached inode 147 Connect to /lost+found? yes Inode 147 ref count is 2, should be 1. Fix? yes Unattached inode 148 Connect to /lost+found? yes Inode 148 ref count is 2, should be 1. Fix? yes Unattached inode 149 Connect to /lost+found? yes Inode 149 ref count is 2, should be 1. Fix? yes Unattached inode 153 Connect to /lost+found? yes Inode 153 ref count is 2, should be 1. Fix? yes Unattached inode 154 Connect to /lost+found? yes Inode 154 ref count is 2, should be 1. Fix? yes Unattached inode 155 Connect to /lost+found? yes Inode 155 ref count is 2, should be 1. Fix? yes Unattached inode 156 Connect to /lost+found? yes Inode 156 ref count is 2, should be 1. Fix? yes Unattached inode 157 Connect to /lost+found? yes Inode 157 ref count is 2, should be 1. Fix? yes Unattached inode 158 Connect to /lost+found? yes Inode 158 ref count is 2, should be 1. Fix? yes Unattached inode 159 Connect to /lost+found? yes Inode 159 ref count is 2, should be 1. Fix? yes Unattached inode 160 Connect to /lost+found? yes Inode 160 ref count is 2, should be 1. Fix? yes Unattached inode 161 Connect to /lost+found? yes Inode 161 ref count is 2, should be 1. Fix? yes Unattached inode 162 Connect to /lost+found? yes Inode 162 ref count is 2, should be 1. Fix? yes Unattached inode 163 Connect to /lost+found? yes Inode 163 ref count is 2, should be 1. Fix? yes Unattached inode 164 Connect to /lost+found? yes Inode 164 ref count is 2, should be 1. Fix? yes Unattached inode 165 Connect to /lost+found? yes Inode 165 ref count is 2, should be 1. Fix? yes Unattached inode 172 Connect to /lost+found? yes Inode 172 ref count is 2, should be 1. Fix? yes Unattached inode 173 Connect to /lost+found? yes Inode 173 ref count is 2, should be 1. Fix? yes Unattached inode 174 Connect to /lost+found? yes Inode 174 ref count is 2, should be 1. Fix? yes Unattached inode 175 Connect to /lost+found? yes Inode 175 ref count is 2, should be 1. Fix? yes Unattached inode 176 Connect to /lost+found? yes Inode 176 ref count is 2, should be 1. Fix? yes Unattached inode 177 Connect to /lost+found? yes Inode 177 ref count is 2, should be 1. Fix? yes Unattached inode 178 Connect to /lost+found? yes Inode 178 ref count is 2, should be 1. Fix? yes Unattached inode 179 Connect to /lost+found? yes Inode 179 ref count is 2, should be 1. Fix? yes Unattached inode 180 Connect to /lost+found? yes Inode 180 ref count is 2, should be 1. Fix? yes Unattached inode 181 Connect to /lost+found? yes Inode 181 ref count is 2, should be 1. Fix? yes Unattached inode 182 Connect to /lost+found? yes Inode 182 ref count is 2, should be 1. Fix? yes Unattached inode 183 Connect to /lost+found? yes Inode 183 ref count is 2, should be 1. Fix? yes Unattached inode 184 Connect to /lost+found? yes Inode 184 ref count is 2, should be 1. Fix? yes Unattached inode 185 Connect to /lost+found? yes Inode 185 ref count is 2, should be 1. Fix? yes Unattached inode 186 Connect to /lost+found? yes Inode 186 ref count is 2, should be 1. Fix? yes Unattached inode 187 Connect to /lost+found? yes Inode 187 ref count is 2, should be 1. Fix? yes Unattached inode 188 Connect to /lost+found? yes Inode 188 ref count is 2, should be 1. Fix? yes Unattached inode 189 Connect to /lost+found? yes Inode 189 ref count is 2, should be 1. Fix? yes Unattached inode 190 Connect to /lost+found? yes Inode 190 ref count is 2, should be 1. Fix? yes Unattached inode 191 Connect to /lost+found? yes Inode 191 ref count is 2, should be 1. Fix? yes Unattached inode 192 Connect to /lost+found? yes Inode 192 ref count is 2, should be 1. Fix? yes Unattached inode 193 Connect to /lost+found? yes Inode 193 ref count is 2, should be 1. Fix? yes Unattached inode 194 Connect to /lost+found? yes Inode 194 ref count is 2, should be 1. Fix? yes Unattached inode 195 Connect to /lost+found? yes Inode 195 ref count is 2, should be 1. Fix? yes Unattached inode 196 Connect to /lost+found? yes Inode 196 ref count is 2, should be 1. Fix? yes Unattached inode 197 Connect to /lost+found? yes Inode 197 ref count is 2, should be 1. Fix? yes Unattached inode 198 Connect to /lost+found? yes Inode 198 ref count is 2, should be 1. Fix? yes Unattached inode 199 Connect to /lost+found? yes Inode 199 ref count is 2, should be 1. Fix? yes Unattached inode 200 Connect to /lost+found? yes Inode 200 ref count is 2, should be 1. Fix? yes Unattached inode 201 Connect to /lost+found? yes Inode 201 ref count is 2, should be 1. Fix? yes Unattached inode 202 Connect to /lost+found? yes Inode 202 ref count is 2, should be 1. Fix? yes Unattached inode 203 Connect to /lost+found? yes Inode 203 ref count is 2, should be 1. Fix? yes Unattached inode 204 Connect to /lost+found? yes Inode 204 ref count is 2, should be 1. Fix? yes Unattached inode 205 Connect to /lost+found? yes Inode 205 ref count is 2, should be 1. Fix? yes Unattached inode 206 Connect to /lost+found? yes Inode 206 ref count is 2, should be 1. Fix? yes Unattached inode 207 Connect to /lost+found? yes Inode 207 ref count is 2, should be 1. Fix? yes Unattached inode 208 Connect to /lost+found? yes Inode 208 ref count is 2, should be 1. Fix? yes Unattached inode 216 Connect to /lost+found? yes Inode 216 ref count is 2, should be 1. Fix? yes Unattached inode 217 Connect to /lost+found? yes Inode 217 ref count is 2, should be 1. Fix? yes Unattached inode 218 Connect to /lost+found? yes Inode 218 ref count is 2, should be 1. Fix? yes Unattached inode 219 Connect to /lost+found? yes Inode 219 ref count is 2, should be 1. Fix? yes Unattached inode 220 Connect to /lost+found? yes Inode 220 ref count is 2, should be 1. Fix? yes Unattached inode 221 Connect to /lost+found? yes Inode 221 ref count is 2, should be 1. Fix? yes Unattached inode 222 Connect to /lost+found? yes Inode 222 ref count is 2, should be 1. Fix? yes Unattached inode 223 Connect to /lost+found? yes Inode 223 ref count is 2, should be 1. Fix? yes Unattached inode 230 Connect to /lost+found? yes Inode 230 ref count is 2, should be 1. Fix? yes Unattached inode 250 Connect to /lost+found? yes Inode 250 ref count is 2, should be 1. Fix? yes Unattached inode 251 Connect to /lost+found? yes Inode 251 ref count is 2, should be 1. Fix? yes Unattached inode 252 Connect to /lost+found? yes Inode 252 ref count is 2, should be 1. Fix? yes Unattached inode 253 Connect to /lost+found? yes Inode 253 ref count is 2, should be 1. Fix? yes Unattached inode 254 Connect to /lost+found? yes Inode 254 ref count is 2, should be 1. Fix? yes Unattached inode 255 Connect to /lost+found? yes Inode 255 ref count is 2, should be 1. Fix? yes Unattached inode 256 Connect to /lost+found? yes Inode 256 ref count is 2, should be 1. Fix? yes Unattached inode 257 Connect to /lost+found? yes Inode 257 ref count is 2, should be 1. Fix? yes Unattached inode 258 Connect to /lost+found? yes Inode 258 ref count is 2, should be 1. Fix? yes Unattached inode 259 Connect to /lost+found? yes Inode 259 ref count is 2, should be 1. Fix? yes Unattached inode 261 Connect to /lost+found? yes Inode 261 ref count is 2, should be 1. Fix? yes Unattached inode 262 Connect to /lost+found? yes Inode 262 ref count is 2, should be 1. Fix? yes Unattached inode 263 Connect to /lost+found? yes Inode 263 ref count is 2, should be 1. Fix? yes Unattached inode 264 Connect to /lost+found? yes Inode 264 ref count is 2, should be 1. Fix? yes Unattached inode 265 Connect to /lost+found? yes Inode 265 ref count is 2, should be 1. Fix? yes Unattached inode 266 Connect to /lost+found? yes Inode 266 ref count is 2, should be 1. Fix? yes Unattached inode 267 Connect to /lost+found? yes Inode 267 ref count is 2, should be 1. Fix? yes Unattached inode 268 Connect to /lost+found? yes Inode 268 ref count is 2, should be 1. Fix? yes Unattached inode 269 Connect to /lost+found? yes Inode 269 ref count is 2, should be 1. Fix? yes Unattached inode 270 Connect to /lost+found? yes Inode 270 ref count is 2, should be 1. Fix? yes Unattached inode 271 Connect to /lost+found? yes Inode 271 ref count is 2, should be 1. Fix? yes Unattached inode 272 Connect to /lost+found? yes Inode 272 ref count is 2, should be 1. Fix? yes Unattached inode 273 Connect to /lost+found? yes Inode 273 ref count is 2, should be 1. Fix? yes Unattached inode 274 Connect to /lost+found? yes Inode 274 ref count is 2, should be 1. Fix? yes Unattached inode 275 Connect to /lost+found? yes Inode 275 ref count is 2, should be 1. Fix? yes Unattached inode 276 Connect to /lost+found? yes Inode 276 ref count is 2, should be 1. Fix? yes Unattached inode 277 Connect to /lost+found? yes Inode 277 ref count is 2, should be 1. Fix? yes Unattached inode 278 Connect to /lost+found? yes Inode 278 ref count is 2, should be 1. Fix? yes Unattached inode 279 Connect to /lost+found? yes Inode 279 ref count is 2, should be 1. Fix? yes Unattached inode 280 Connect to /lost+found? yes Inode 280 ref count is 2, should be 1. Fix? yes Unattached inode 281 Connect to /lost+found? yes Inode 281 ref count is 2, should be 1. Fix? yes Unattached inode 282 Connect to /lost+found? yes Inode 282 ref count is 2, should be 1. Fix? yes Unattached inode 283 Connect to /lost+found? yes Inode 283 ref count is 2, should be 1. Fix? yes Unattached inode 284 Connect to /lost+found? yes Inode 284 ref count is 2, should be 1. Fix? yes Unattached inode 285 Connect to /lost+found? yes Inode 285 ref count is 2, should be 1. Fix? yes Unattached inode 286 Connect to /lost+found? yes Inode 286 ref count is 2, should be 1. Fix? yes Unattached inode 287 Connect to /lost+found? yes Inode 287 ref count is 2, should be 1. Fix? yes Unattached inode 288 Connect to /lost+found? yes Inode 288 ref count is 2, should be 1. Fix? yes Unattached inode 289 Connect to /lost+found? yes Inode 289 ref count is 2, should be 1. Fix? yes Unattached inode 290 Connect to /lost+found? yes Inode 290 ref count is 2, should be 1. Fix? yes Unattached inode 291 Connect to /lost+found? yes Inode 291 ref count is 2, should be 1. Fix? yes Unattached inode 292 Connect to /lost+found? yes Inode 292 ref count is 2, should be 1. Fix? yes Unattached inode 293 Connect to /lost+found? yes Inode 293 ref count is 2, should be 1. Fix? yes Unattached inode 294 Connect to /lost+found? yes Inode 294 ref count is 2, should be 1. Fix? yes Unattached inode 295 Connect to /lost+found? yes Inode 295 ref count is 2, should be 1. Fix? yes Unattached inode 320 Connect to /lost+found? yes Inode 320 ref count is 2, should be 1. Fix? yes Unattached inode 321 Connect to /lost+found? yes Inode 321 ref count is 2, should be 1. Fix? yes Unattached inode 322 Connect to /lost+found? yes Inode 322 ref count is 2, should be 1. Fix? yes Unattached inode 323 Connect to /lost+found? yes Inode 323 ref count is 2, should be 1. Fix? yes Unattached inode 324 Connect to /lost+found? yes Inode 324 ref count is 2, should be 1. Fix? yes Unattached inode 325 Connect to /lost+found? yes Inode 325 ref count is 2, should be 1. Fix? yes Unattached inode 326 Connect to /lost+found? yes Inode 326 ref count is 2, should be 1. Fix? yes Unattached inode 341 Connect to /lost+found? yes Inode 341 ref count is 2, should be 1. Fix? yes Unattached inode 342 Connect to /lost+found? yes Inode 342 ref count is 2, should be 1. Fix? yes Unattached inode 343 Connect to /lost+found? yes Inode 343 ref count is 2, should be 1. Fix? yes Unattached inode 344 Connect to /lost+found? yes Inode 344 ref count is 2, should be 1. Fix? yes Unattached inode 345 Connect to /lost+found? yes Inode 345 ref count is 2, should be 1. Fix? yes Unattached inode 346 Connect to /lost+found? yes Inode 346 ref count is 2, should be 1. Fix? yes Unattached inode 347 Connect to /lost+found? yes Inode 347 ref count is 2, should be 1. Fix? yes Unattached inode 348 Connect to /lost+found? yes Inode 348 ref count is 2, should be 1. Fix? yes Unattached inode 349 Connect to /lost+found? yes Inode 349 ref count is 2, should be 1. Fix? yes Unattached inode 350 Connect to /lost+found? yes Inode 350 ref count is 2, should be 1. Fix? yes Unattached inode 351 Connect to /lost+found? yes Inode 351 ref count is 2, should be 1. Fix? yes Unattached inode 352 Connect to /lost+found? yes Inode 352 ref count is 2, should be 1. Fix? yes Unattached inode 353 Connect to /lost+found? yes Inode 353 ref count is 2, should be 1. Fix? yes Unattached inode 354 Connect to /lost+found? yes Inode 354 ref count is 2, should be 1. Fix? yes Unattached inode 355 Connect to /lost+found? yes Inode 355 ref count is 2, should be 1. Fix? yes Unattached inode 356 Connect to /lost+found? yes Inode 356 ref count is 2, should be 1. Fix? yes Unattached inode 357 Connect to /lost+found? yes Inode 357 ref count is 2, should be 1. Fix? yes Unattached inode 358 Connect to /lost+found? yes Inode 358 ref count is 2, should be 1. Fix? yes Unattached inode 359 Connect to /lost+found? yes Inode 359 ref count is 2, should be 1. Fix? yes Unattached inode 360 Connect to /lost+found? yes Inode 360 ref count is 2, should be 1. Fix? yes Unattached inode 361 Connect to /lost+found? yes Inode 361 ref count is 2, should be 1. Fix? yes Unattached inode 362 Connect to /lost+found? yes Inode 362 ref count is 2, should be 1. Fix? yes Unattached inode 363 Connect to /lost+found? yes Inode 363 ref count is 2, should be 1. Fix? yes Unattached inode 364 Connect to /lost+found? yes Inode 364 ref count is 2, should be 1. Fix? yes Unattached inode 365 Connect to /lost+found? yes Inode 365 ref count is 2, should be 1. Fix? yes Unattached inode 366 Connect to /lost+found? yes Inode 366 ref count is 2, should be 1. Fix? yes Unattached inode 367 Connect to /lost+found? yes Inode 367 ref count is 2, should be 1. Fix? yes Unattached inode 368 Connect to /lost+found? yes Inode 368 ref count is 2, should be 1. Fix? yes Unattached inode 369 Connect to /lost+found? yes Inode 369 ref count is 2, should be 1. Fix? yes Unattached inode 370 Connect to /lost+found? yes Inode 370 ref count is 2, should be 1. Fix? yes Unattached inode 371 Connect to /lost+found? yes Inode 371 ref count is 2, should be 1. Fix? yes Unattached inode 372 Connect to /lost+found? yes Inode 372 ref count is 2, should be 1. Fix? yes Unattached inode 373 Connect to /lost+found? yes Inode 373 ref count is 2, should be 1. Fix? yes Unattached inode 374 Connect to /lost+found? yes Inode 374 ref count is 2, should be 1. Fix? yes Unattached inode 375 Connect to /lost+found? yes Inode 375 ref count is 2, should be 1. Fix? yes Unattached inode 376 Connect to /lost+found? yes Inode 376 ref count is 2, should be 1. Fix? yes Unattached inode 377 Connect to /lost+found? yes Inode 377 ref count is 2, should be 1. Fix? yes Unattached inode 378 Connect to /lost+found? yes Inode 378 ref count is 2, should be 1. Fix? yes Unattached inode 379 Connect to /lost+found? yes Inode 379 ref count is 2, should be 1. Fix? yes Unattached inode 380 Connect to /lost+found? yes Inode 380 ref count is 2, should be 1. Fix? yes Unattached inode 381 Connect to /lost+found? yes Inode 381 ref count is 2, should be 1. Fix? yes Unattached inode 382 Connect to /lost+found? yes Inode 382 ref count is 2, should be 1. Fix? yes Unattached inode 383 Connect to /lost+found? yes Inode 383 ref count is 2, should be 1. Fix? yes Unattached inode 384 Connect to /lost+found? yes Inode 384 ref count is 2, should be 1. Fix? yes Unattached inode 385 Connect to /lost+found? yes Inode 385 ref count is 2, should be 1. Fix? yes Unattached inode 386 Connect to /lost+found? yes Inode 386 ref count is 2, should be 1. Fix? yes Unattached inode 387 Connect to /lost+found? yes Inode 387 ref count is 2, should be 1. Fix? yes Unattached inode 388 Connect to /lost+found? yes Inode 388 ref count is 2, should be 1. Fix? yes Unattached inode 389 Connect to /lost+found? yes Inode 389 ref count is 2, should be 1. Fix? yes Unattached inode 390 Connect to /lost+found? yes Inode 390 ref count is 2, should be 1. Fix? yes Unattached inode 391 Connect to /lost+found? yes Inode 391 ref count is 2, should be 1. Fix? yes Unattached inode 392 Connect to /lost+found? yes Inode 392 ref count is 2, should be 1. Fix? yes Unattached inode 393 Connect to /lost+found? yes Inode 393 ref count is 2, should be 1. Fix? yes Unattached inode 394 Connect to /lost+found? yes Inode 394 ref count is 2, should be 1. Fix? yes Unattached inode 395 Connect to /lost+found? yes Inode 395 ref count is 2, should be 1. Fix? yes Unattached inode 396 Connect to /lost+found? yes Inode 396 ref count is 2, should be 1. Fix? yes Unattached inode 397 Connect to /lost+found? yes Inode 397 ref count is 2, should be 1. Fix? yes Unattached inode 398 Connect to /lost+found? yes Inode 398 ref count is 2, should be 1. Fix? yes Unattached inode 399 Connect to /lost+found? yes Inode 399 ref count is 2, should be 1. Fix? yes Unattached inode 400 Connect to /lost+found? yes Inode 400 ref count is 2, should be 1. Fix? yes Unattached inode 401 Connect to /lost+found? yes Inode 401 ref count is 2, should be 1. Fix? yes Unattached inode 402 Connect to /lost+found? yes Inode 402 ref count is 2, should be 1. Fix? yes Unattached inode 403 Connect to /lost+found? yes Inode 403 ref count is 2, should be 1. Fix? yes Unattached inode 404 Connect to /lost+found? yes Inode 404 ref count is 2, should be 1. Fix? yes Unattached inode 405 Connect to /lost+found? yes Inode 405 ref count is 2, should be 1. Fix? yes Unattached inode 406 Connect to /lost+found? yes Inode 406 ref count is 2, should be 1. Fix? yes Unattached inode 407 Connect to /lost+found? yes Inode 407 ref count is 2, should be 1. Fix? yes Unattached inode 408 Connect to /lost+found? yes Inode 408 ref count is 2, should be 1. Fix? yes Unattached inode 409 Connect to /lost+found? yes Inode 409 ref count is 2, should be 1. Fix? yes Unattached inode 410 Connect to /lost+found? yes Inode 410 ref count is 2, should be 1. Fix? yes Unattached inode 411 Connect to /lost+found? yes Inode 411 ref count is 2, should be 1. Fix? yes Unattached inode 412 Connect to /lost+found? yes Inode 412 ref count is 2, should be 1. Fix? yes Unattached inode 413 Connect to /lost+found? yes Inode 413 ref count is 2, should be 1. Fix? yes Unattached inode 414 Connect to /lost+found? yes Inode 414 ref count is 2, should be 1. Fix? yes Unattached inode 415 Connect to /lost+found? yes Inode 415 ref count is 2, should be 1. Fix? yes Unattached inode 416 Connect to /lost+found? yes Inode 416 ref count is 2, should be 1. Fix? yes Unattached inode 417 Connect to /lost+found? yes Inode 417 ref count is 2, should be 1. Fix? yes Unattached inode 418 Connect to /lost+found? yes Inode 418 ref count is 2, should be 1. Fix? yes Unattached inode 419 Connect to /lost+found? yes Inode 419 ref count is 2, should be 1. Fix? yes Unattached inode 420 Connect to /lost+found? yes Inode 420 ref count is 2, should be 1. Fix? yes Unattached inode 421 Connect to /lost+found? yes Inode 421 ref count is 2, should be 1. Fix? yes Unattached inode 422 Connect to /lost+found? yes Inode 422 ref count is 2, should be 1. Fix? yes Unattached inode 423 Connect to /lost+found? yes Inode 423 ref count is 2, should be 1. Fix? yes Unattached inode 424 Connect to /lost+found? yes Inode 424 ref count is 2, should be 1. Fix? yes Unattached inode 425 Connect to /lost+found? yes Inode 425 ref count is 2, should be 1. Fix? yes Unattached inode 426 Connect to /lost+found? yes Inode 426 ref count is 2, should be 1. Fix? yes Unattached inode 427 Connect to /lost+found? yes Inode 427 ref count is 2, should be 1. Fix? yes Unattached inode 428 Connect to /lost+found? yes Inode 428 ref count is 2, should be 1. Fix? yes Unattached inode 429 Connect to /lost+found? yes Inode 429 ref count is 2, should be 1. Fix? yes Unattached inode 430 Connect to /lost+found? yes Inode 430 ref count is 2, should be 1. Fix? yes Unattached inode 431 Connect to /lost+found? yes Inode 431 ref count is 2, should be 1. Fix? yes Unattached inode 432 Connect to /lost+found? yes Inode 432 ref count is 2, should be 1. Fix? yes Unattached inode 433 Connect to /lost+found? yes Inode 433 ref count is 2, should be 1. Fix? yes Unattached inode 434 Connect to /lost+found? yes Inode 434 ref count is 2, should be 1. Fix? yes Unattached inode 435 Connect to /lost+found? yes Inode 435 ref count is 2, should be 1. Fix? yes Unattached inode 436 Connect to /lost+found? yes Inode 436 ref count is 2, should be 1. Fix? yes Unattached inode 437 Connect to /lost+found? yes Inode 437 ref count is 2, should be 1. Fix? yes Unattached inode 438 Connect to /lost+found? yes Inode 438 ref count is 2, should be 1. Fix? yes Unattached inode 439 Connect to /lost+found? yes Inode 439 ref count is 2, should be 1. Fix? yes Unattached inode 440 Connect to /lost+found? yes Inode 440 ref count is 2, should be 1. Fix? yes Unattached inode 441 Connect to /lost+found? yes Inode 441 ref count is 2, should be 1. Fix? yes Unattached inode 442 Connect to /lost+found? yes Inode 442 ref count is 2, should be 1. Fix? yes Unattached inode 443 Connect to /lost+found? yes Inode 443 ref count is 2, should be 1. Fix? yes Unattached inode 444 Connect to /lost+found? yes Inode 444 ref count is 2, should be 1. Fix? yes Unattached inode 445 Connect to /lost+found? yes Inode 445 ref count is 2, should be 1. Fix? yes Unattached inode 446 Connect to /lost+found? yes Inode 446 ref count is 2, should be 1. Fix? yes Unattached inode 447 Connect to /lost+found? yes Inode 447 ref count is 2, should be 1. Fix? yes Unattached inode 448 Connect to /lost+found? yes Inode 448 ref count is 2, should be 1. Fix? yes Unattached inode 449 Connect to /lost+found? yes Inode 449 ref count is 2, should be 1. Fix? yes Unattached inode 450 Connect to /lost+found? yes Inode 450 ref count is 2, should be 1. Fix? yes Unattached inode 451 Connect to /lost+found? yes Inode 451 ref count is 2, should be 1. Fix? yes Unattached inode 452 Connect to /lost+found? yes Inode 452 ref count is 2, should be 1. Fix? yes Unattached inode 453 Connect to /lost+found? yes Inode 453 ref count is 2, should be 1. Fix? yes Unattached inode 454 Connect to /lost+found? yes Inode 454 ref count is 2, should be 1. Fix? yes Unattached inode 455 Connect to /lost+found? yes Inode 455 ref count is 2, should be 1. Fix? yes Unattached inode 456 Connect to /lost+found? yes Inode 456 ref count is 2, should be 1. Fix? yes Unattached inode 457 Connect to /lost+found? yes Inode 457 ref count is 2, should be 1. Fix? yes Unattached inode 458 Connect to /lost+found? yes Inode 458 ref count is 2, should be 1. Fix? yes Unattached inode 459 Connect to /lost+found? yes Inode 459 ref count is 2, should be 1. Fix? yes Unattached inode 460 Connect to /lost+found? yes Inode 460 ref count is 2, should be 1. Fix? yes Unattached inode 461 Connect to /lost+found? yes Inode 461 ref count is 2, should be 1. Fix? yes Unattached inode 462 Connect to /lost+found? yes Inode 462 ref count is 2, should be 1. Fix? yes Unattached inode 463 Connect to /lost+found? yes Inode 463 ref count is 2, should be 1. Fix? yes Unattached inode 464 Connect to /lost+found? yes Inode 464 ref count is 2, should be 1. Fix? yes Unattached inode 465 Connect to /lost+found? yes Inode 465 ref count is 2, should be 1. Fix? yes Unattached inode 466 Connect to /lost+found? yes Inode 466 ref count is 2, should be 1. Fix? yes Unattached inode 467 Connect to /lost+found? yes Inode 467 ref count is 2, should be 1. Fix? yes Unattached inode 468 Connect to /lost+found? yes Inode 468 ref count is 2, should be 1. Fix? yes Unattached inode 469 Connect to /lost+found? yes Inode 469 ref count is 2, should be 1. Fix? yes Unattached inode 470 Connect to /lost+found? yes Inode 470 ref count is 2, should be 1. Fix? yes Unattached inode 471 Connect to /lost+found? yes Inode 471 ref count is 2, should be 1. Fix? yes Unattached inode 472 Connect to /lost+found? yes Inode 472 ref count is 2, should be 1. Fix? yes Unattached inode 473 Connect to /lost+found? yes Inode 473 ref count is 2, should be 1. Fix? yes Unattached inode 474 Connect to /lost+found? yes Inode 474 ref count is 2, should be 1. Fix? yes Unattached inode 475 Connect to /lost+found? yes Inode 475 ref count is 2, should be 1. Fix? yes Unattached inode 476 Connect to /lost+found? yes Inode 476 ref count is 2, should be 1. Fix? yes Unattached inode 477 Connect to /lost+found? yes Inode 477 ref count is 2, should be 1. Fix? yes Unattached inode 478 Connect to /lost+found? yes Inode 478 ref count is 2, should be 1. Fix? yes Unattached inode 479 Connect to /lost+found? yes Inode 479 ref count is 2, should be 1. Fix? yes Unattached inode 480 Connect to /lost+found? yes Inode 480 ref count is 2, should be 1. Fix? yes Unattached inode 481 Connect to /lost+found? yes Inode 481 ref count is 2, should be 1. Fix? yes Unattached inode 482 Connect to /lost+found? yes Inode 482 ref count is 2, should be 1. Fix? yes Unattached inode 483 Connect to /lost+found? yes Inode 483 ref count is 2, should be 1. Fix? yes Unattached inode 484 Connect to /lost+found? yes Inode 484 ref count is 2, should be 1. Fix? yes Unattached inode 485 Connect to /lost+found? yes Inode 485 ref count is 2, should be 1. Fix? yes Unattached inode 486 Connect to /lost+found? yes Inode 486 ref count is 2, should be 1. Fix? yes Unattached inode 487 Connect to /lost+found? yes Inode 487 ref count is 2, should be 1. Fix? yes Unattached inode 488 Connect to /lost+found? yes Inode 488 ref count is 2, should be 1. Fix? yes Unattached inode 489 Connect to /lost+found? yes Inode 489 ref count is 2, should be 1. Fix? yes Unattached inode 490 Connect to /lost+found? yes Inode 490 ref count is 2, should be 1. Fix? yes Unattached inode 491 Connect to /lost+found? yes Inode 491 ref count is 2, should be 1. Fix? yes Unattached inode 492 Connect to /lost+found? yes Inode 492 ref count is 2, should be 1. Fix? yes Unattached inode 493 Connect to /lost+found? yes Inode 493 ref count is 2, should be 1. Fix? yes Unattached inode 494 Connect to /lost+found? yes Inode 494 ref count is 2, should be 1. Fix? yes Unattached inode 495 Connect to /lost+found? yes Inode 495 ref count is 2, should be 1. Fix? yes Unattached inode 496 Connect to /lost+found? yes Inode 496 ref count is 2, should be 1. Fix? yes Unattached inode 497 Connect to /lost+found? yes Inode 497 ref count is 2, should be 1. Fix? yes Unattached inode 498 Connect to /lost+found? yes Inode 498 ref count is 2, should be 1. Fix? yes Unattached inode 499 Connect to /lost+found? yes Inode 499 ref count is 2, should be 1. Fix? yes Unattached inode 500 Connect to /lost+found? yes Inode 500 ref count is 2, should be 1. Fix? yes Unattached inode 501 Connect to /lost+found? yes Inode 501 ref count is 2, should be 1. Fix? yes Unattached inode 502 Connect to /lost+found? yes Inode 502 ref count is 2, should be 1. Fix? yes Unattached inode 503 Connect to /lost+found? yes Inode 503 ref count is 2, should be 1. Fix? yes Unattached inode 504 Connect to /lost+found? yes Inode 504 ref count is 2, should be 1. Fix? yes Unattached inode 505 Connect to /lost+found? yes Inode 505 ref count is 2, should be 1. Fix? yes Unattached inode 506 Connect to /lost+found? yes Inode 506 ref count is 2, should be 1. Fix? yes Unattached inode 507 Connect to /lost+found? yes Inode 507 ref count is 2, should be 1. Fix? yes Unattached inode 508 Connect to /lost+found? yes Inode 508 ref count is 2, should be 1. Fix? yes Unattached inode 509 Connect to /lost+found? yes Inode 509 ref count is 2, should be 1. Fix? yes Unattached inode 510 Connect to /lost+found? yes Inode 510 ref count is 2, should be 1. Fix? yes Unattached inode 511 Connect to /lost+found? yes Inode 511 ref count is 2, should be 1. Fix? yes Unattached inode 512 Connect to /lost+found? yes Inode 512 ref count is 2, should be 1. Fix? yes Unattached inode 513 Connect to /lost+found? yes Inode 513 ref count is 2, should be 1. Fix? yes Unattached inode 514 Connect to /lost+found? yes Inode 514 ref count is 2, should be 1. Fix? yes Unattached inode 515 Connect to /lost+found? yes Inode 515 ref count is 2, should be 1. Fix? yes Unattached inode 516 Connect to /lost+found? yes Inode 516 ref count is 2, should be 1. Fix? yes Unattached inode 517 Connect to /lost+found? yes Inode 517 ref count is 2, should be 1. Fix? yes Unattached inode 518 Connect to /lost+found? yes Inode 518 ref count is 2, should be 1. Fix? yes Unattached inode 519 Connect to /lost+found? yes Inode 519 ref count is 2, should be 1. Fix? yes Unattached inode 520 Connect to /lost+found? yes Inode 520 ref count is 2, should be 1. Fix? yes Unattached inode 521 Connect to /lost+found? yes Inode 521 ref count is 2, should be 1. Fix? yes Unattached inode 522 Connect to /lost+found? yes Inode 522 ref count is 2, should be 1. Fix? yes Unattached inode 523 Connect to /lost+found? yes Inode 523 ref count is 2, should be 1. Fix? yes Unattached inode 524 Connect to /lost+found? yes Inode 524 ref count is 2, should be 1. Fix? yes Unattached inode 525 Connect to /lost+found? yes Inode 525 ref count is 2, should be 1. Fix? yes Unattached inode 526 Connect to /lost+found? yes Inode 526 ref count is 2, should be 1. Fix? yes Unattached inode 527 Connect to /lost+found? yes Inode 527 ref count is 2, should be 1. Fix? yes Unattached inode 528 Connect to /lost+found? yes Inode 528 ref count is 2, should be 1. Fix? yes Unattached inode 529 Connect to /lost+found? yes Inode 529 ref count is 2, should be 1. Fix? yes Unattached inode 530 Connect to /lost+found? yes Inode 530 ref count is 2, should be 1. Fix? yes Unattached inode 531 Connect to /lost+found? yes Inode 531 ref count is 2, should be 1. Fix? yes Unattached inode 532 Connect to /lost+found? yes Inode 532 ref count is 2, should be 1. Fix? yes Unattached inode 533 Connect to /lost+found? yes Inode 533 ref count is 2, should be 1. Fix? yes Unattached inode 534 Connect to /lost+found? yes Inode 534 ref count is 2, should be 1. Fix? yes Unattached inode 535 Connect to /lost+found? yes Inode 535 ref count is 2, should be 1. Fix? yes Unattached inode 536 Connect to /lost+found? yes Inode 536 ref count is 2, should be 1. Fix? yes Unattached inode 537 Connect to /lost+found? yes Inode 537 ref count is 2, should be 1. Fix? yes Unattached inode 538 Connect to /lost+found? yes Inode 538 ref count is 2, should be 1. Fix? yes Unattached inode 539 Connect to /lost+found? yes Inode 539 ref count is 2, should be 1. Fix? yes Unattached inode 540 Connect to /lost+found? yes Inode 540 ref count is 2, should be 1. Fix? yes Unattached inode 541 Connect to /lost+found? yes Inode 541 ref count is 2, should be 1. Fix? yes Unattached inode 542 Connect to /lost+found? yes Inode 542 ref count is 2, should be 1. Fix? yes Unattached inode 543 Connect to /lost+found? yes Inode 543 ref count is 2, should be 1. Fix? yes Unattached inode 544 Connect to /lost+found? yes Inode 544 ref count is 2, should be 1. Fix? yes Unattached inode 545 Connect to /lost+found? yes Inode 545 ref count is 2, should be 1. Fix? yes Unattached inode 546 Connect to /lost+found? yes Inode 546 ref count is 2, should be 1. Fix? yes Unattached inode 547 Connect to /lost+found? yes Inode 547 ref count is 2, should be 1. Fix? yes Unattached inode 548 Connect to /lost+found? yes Inode 548 ref count is 2, should be 1. Fix? yes Unattached inode 549 Connect to /lost+found? yes Inode 549 ref count is 2, should be 1. Fix? yes Unattached inode 550 Connect to /lost+found? yes Inode 550 ref count is 2, should be 1. Fix? yes Unattached inode 551 Connect to /lost+found? yes Inode 551 ref count is 2, should be 1. Fix? yes Unattached inode 552 Connect to /lost+found? yes Inode 552 ref count is 2, should be 1. Fix? yes Unattached inode 553 Connect to /lost+found? yes Inode 553 ref count is 2, should be 1. Fix? yes Unattached inode 554 Connect to /lost+found? yes Inode 554 ref count is 2, should be 1. Fix? yes Unattached inode 555 Connect to /lost+found? yes Inode 555 ref count is 2, should be 1. Fix? yes Unattached inode 556 Connect to /lost+found? yes Inode 556 ref count is 2, should be 1. Fix? yes Unattached inode 557 Connect to /lost+found? yes Inode 557 ref count is 2, should be 1. Fix? yes Unattached inode 558 Connect to /lost+found? yes Inode 558 ref count is 2, should be 1. Fix? yes Unattached inode 559 Connect to /lost+found? yes Inode 559 ref count is 2, should be 1. Fix? yes Unattached inode 560 Connect to /lost+found? yes Inode 560 ref count is 2, should be 1. Fix? yes Unattached inode 561 Connect to /lost+found? yes Inode 561 ref count is 2, should be 1. Fix? yes Unattached inode 562 Connect to /lost+found? yes Inode 562 ref count is 2, should be 1. Fix? yes Unattached inode 563 Connect to /lost+found? yes Inode 563 ref count is 2, should be 1. Fix? yes Unattached inode 564 Connect to /lost+found? yes Inode 564 ref count is 2, should be 1. Fix? yes Unattached inode 565 Connect to /lost+found? yes Inode 565 ref count is 2, should be 1. Fix? yes Unattached inode 566 Connect to /lost+found? yes Inode 566 ref count is 2, should be 1. Fix? yes Unattached inode 567 Connect to /lost+found? yes Inode 567 ref count is 2, should be 1. Fix? yes Unattached inode 568 Connect to /lost+found? yes Inode 568 ref count is 2, should be 1. Fix? yes Unattached inode 569 Connect to /lost+found? yes Inode 569 ref count is 2, should be 1. Fix? yes Unattached inode 570 Connect to /lost+found? yes Inode 570 ref count is 2, should be 1. Fix? yes Unattached inode 571 Connect to /lost+found? yes Inode 571 ref count is 2, should be 1. Fix? yes Unattached inode 572 Connect to /lost+found? yes Inode 572 ref count is 2, should be 1. Fix? yes Unattached inode 573 Connect to /lost+found? yes Inode 573 ref count is 2, should be 1. Fix? yes Unattached inode 574 Connect to /lost+found? yes Inode 574 ref count is 2, should be 1. Fix? yes Unattached inode 575 Connect to /lost+found? yes Inode 575 ref count is 2, should be 1. Fix? yes Unattached inode 576 Connect to /lost+found? yes Inode 576 ref count is 2, should be 1. Fix? yes Unattached inode 577 Connect to /lost+found? yes Inode 577 ref count is 2, should be 1. Fix? yes Unattached inode 578 Connect to /lost+found? yes Inode 578 ref count is 2, should be 1. Fix? yes Unattached inode 579 Connect to /lost+found? yes Inode 579 ref count is 2, should be 1. Fix? yes Unattached inode 580 Connect to /lost+found? yes Inode 580 ref count is 2, should be 1. Fix? yes Unattached inode 581 Connect to /lost+found? yes Inode 581 ref count is 2, should be 1. Fix? yes Unattached inode 582 Connect to /lost+found? yes Inode 582 ref count is 2, should be 1. Fix? yes Unattached inode 583 Connect to /lost+found? yes Inode 583 ref count is 2, should be 1. Fix? yes Unattached inode 584 Connect to /lost+found? yes Inode 584 ref count is 2, should be 1. Fix? yes Unattached inode 585 Connect to /lost+found? yes Inode 585 ref count is 2, should be 1. Fix? yes Unattached inode 586 Connect to /lost+found? yes Inode 586 ref count is 2, should be 1. Fix? yes Unattached inode 587 Connect to /lost+found? yes Inode 587 ref count is 2, should be 1. Fix? yes Unattached inode 588 Connect to /lost+found? yes Inode 588 ref count is 2, should be 1. Fix? yes Unattached inode 589 Connect to /lost+found? yes Inode 589 ref count is 2, should be 1. Fix? yes Unattached inode 590 Connect to /lost+found? yes Inode 590 ref count is 2, should be 1. Fix? yes Unattached inode 591 Connect to /lost+found? yes Inode 591 ref count is 2, should be 1. Fix? yes Unattached inode 592 Connect to /lost+found? yes Inode 592 ref count is 2, should be 1. Fix? yes Unattached inode 593 Connect to /lost+found? yes Inode 593 ref count is 2, should be 1. Fix? yes Unattached inode 594 Connect to /lost+found? yes Inode 594 ref count is 2, should be 1. Fix? yes Unattached inode 595 Connect to /lost+found? yes Inode 595 ref count is 2, should be 1. Fix? yes Unattached inode 596 Connect to /lost+found? yes Inode 596 ref count is 2, should be 1. Fix? yes Unattached inode 597 Connect to /lost+found? yes Inode 597 ref count is 2, should be 1. Fix? yes Unattached inode 598 Connect to /lost+found? yes Inode 598 ref count is 2, should be 1. Fix? yes Unattached inode 599 Connect to /lost+found? yes Inode 599 ref count is 2, should be 1. Fix? yes Unattached inode 600 Connect to /lost+found? yes Inode 600 ref count is 2, should be 1. Fix? yes Unattached inode 601 Connect to /lost+found? yes Inode 601 ref count is 2, should be 1. Fix? yes Unattached inode 602 Connect to /lost+found? yes Inode 602 ref count is 2, should be 1. Fix? yes Unattached inode 603 Connect to /lost+found? yes Inode 603 ref count is 2, should be 1. Fix? yes Unattached inode 604 Connect to /lost+found? yes Inode 604 ref count is 2, should be 1. Fix? yes Unattached inode 605 Connect to /lost+found? yes Inode 605 ref count is 2, should be 1. Fix? yes Unattached inode 606 Connect to /lost+found? yes Inode 606 ref count is 2, should be 1. Fix? yes Unattached inode 607 Connect to /lost+found? yes Inode 607 ref count is 2, should be 1. Fix? yes Unattached inode 608 Connect to /lost+found? yes Inode 608 ref count is 2, should be 1. Fix? yes Unattached inode 609 Connect to /lost+found? yes Inode 609 ref count is 2, should be 1. Fix? yes Unattached inode 610 Connect to /lost+found? yes Inode 610 ref count is 2, should be 1. Fix? yes Unattached inode 611 Connect to /lost+found? yes Inode 611 ref count is 2, should be 1. Fix? yes Unattached inode 612 Connect to /lost+found? yes Inode 612 ref count is 2, should be 1. Fix? yes Unattached inode 613 Connect to /lost+found? yes Inode 613 ref count is 2, should be 1. Fix? yes Unattached inode 614 Connect to /lost+found? yes Inode 614 ref count is 2, should be 1. Fix? yes Unattached inode 615 Connect to /lost+found? yes Inode 615 ref count is 2, should be 1. Fix? yes Unattached inode 616 Connect to /lost+found? yes Inode 616 ref count is 2, should be 1. Fix? yes Unattached inode 617 Connect to /lost+found? yes Inode 617 ref count is 2, should be 1. Fix? yes Unattached inode 618 Connect to /lost+found? yes Inode 618 ref count is 2, should be 1. Fix? yes Unattached inode 619 Connect to /lost+found? yes Inode 619 ref count is 2, should be 1. Fix? yes Unattached inode 620 Connect to /lost+found? yes Inode 620 ref count is 2, should be 1. Fix? yes Unattached inode 621 Connect to /lost+found? yes Inode 621 ref count is 2, should be 1. Fix? yes Unattached inode 622 Connect to /lost+found? yes Inode 622 ref count is 2, should be 1. Fix? yes Unattached inode 623 Connect to /lost+found? yes Inode 623 ref count is 2, should be 1. Fix? yes Unattached inode 624 Connect to /lost+found? yes Inode 624 ref count is 2, should be 1. Fix? yes Unattached inode 625 Connect to /lost+found? yes Inode 625 ref count is 2, should be 1. Fix? yes Unattached inode 626 Connect to /lost+found? yes Inode 626 ref count is 2, should be 1. Fix? yes Unattached inode 627 Connect to /lost+found? yes Inode 627 ref count is 2, should be 1. Fix? yes Unattached inode 628 Connect to /lost+found? yes Inode 628 ref count is 2, should be 1. Fix? yes Unattached inode 629 Connect to /lost+found? yes Inode 629 ref count is 2, should be 1. Fix? yes Unattached inode 630 Connect to /lost+found? yes Inode 630 ref count is 2, should be 1. Fix? yes Unattached inode 631 Connect to /lost+found? yes Inode 631 ref count is 2, should be 1. Fix? yes Unattached inode 632 Connect to /lost+found? yes Inode 632 ref count is 2, should be 1. Fix? yes Unattached inode 633 Connect to /lost+found? yes Inode 633 ref count is 2, should be 1. Fix? yes Unattached inode 634 Connect to /lost+found? yes Inode 634 ref count is 2, should be 1. Fix? yes Unattached inode 635 Connect to /lost+found? yes Inode 635 ref count is 2, should be 1. Fix? yes Unattached inode 636 Connect to /lost+found? yes Inode 636 ref count is 2, should be 1. Fix? yes Unattached inode 637 Connect to /lost+found? yes Inode 637 ref count is 2, should be 1. Fix? yes Unattached inode 638 Connect to /lost+found? yes Inode 638 ref count is 2, should be 1. Fix? yes Unattached inode 639 Connect to /lost+found? yes Inode 639 ref count is 2, should be 1. Fix? yes Unattached inode 640 Connect to /lost+found? yes Inode 640 ref count is 2, should be 1. Fix? yes Unattached inode 641 Connect to /lost+found? yes Inode 641 ref count is 2, should be 1. Fix? yes Unattached inode 642 Connect to /lost+found? yes Inode 642 ref count is 2, should be 1. Fix? yes Unattached inode 643 Connect to /lost+found? yes Inode 643 ref count is 2, should be 1. Fix? yes Unattached inode 644 Connect to /lost+found? yes Inode 644 ref count is 2, should be 1. Fix? yes Unattached inode 645 Connect to /lost+found? yes Inode 645 ref count is 2, should be 1. Fix? yes Unattached inode 646 Connect to /lost+found? yes Inode 646 ref count is 2, should be 1. Fix? yes Unattached inode 647 Connect to /lost+found? yes Inode 647 ref count is 2, should be 1. Fix? yes Unattached inode 648 Connect to /lost+found? yes Inode 648 ref count is 2, should be 1. Fix? yes Unattached inode 649 Connect to /lost+found? yes Inode 649 ref count is 2, should be 1. Fix? yes Unattached inode 650 Connect to /lost+found? yes Inode 650 ref count is 2, should be 1. Fix? yes Unattached inode 651 Connect to /lost+found? yes Inode 651 ref count is 2, should be 1. Fix? yes Unattached inode 652 Connect to /lost+found? yes Inode 652 ref count is 2, should be 1. Fix? yes Unattached inode 653 Connect to /lost+found? yes Inode 653 ref count is 2, should be 1. Fix? yes Unattached inode 654 Connect to /lost+found? yes Inode 654 ref count is 2, should be 1. Fix? yes Unattached inode 655 Connect to /lost+found? yes Inode 655 ref count is 2, should be 1. Fix? yes Unattached inode 656 Connect to /lost+found? yes Inode 656 ref count is 2, should be 1. Fix? yes Unattached inode 657 Connect to /lost+found? yes Inode 657 ref count is 2, should be 1. Fix? yes Unattached inode 658 Connect to /lost+found? yes Inode 658 ref count is 2, should be 1. Fix? yes Unattached inode 659 Connect to /lost+found? yes Inode 659 ref count is 2, should be 1. Fix? yes Unattached inode 660 Connect to /lost+found? yes Inode 660 ref count is 2, should be 1. Fix? yes Unattached inode 661 Connect to /lost+found? yes Inode 661 ref count is 2, should be 1. Fix? yes Unattached inode 662 Connect to /lost+found? yes Inode 662 ref count is 2, should be 1. Fix? yes Unattached inode 663 Connect to /lost+found? yes Inode 663 ref count is 2, should be 1. Fix? yes Unattached inode 664 Connect to /lost+found? yes Inode 664 ref count is 2, should be 1. Fix? yes Unattached inode 665 Connect to /lost+found? yes Inode 665 ref count is 2, should be 1. Fix? yes Unattached inode 666 Connect to /lost+found? yes Inode 666 ref count is 2, should be 1. Fix? yes Unattached inode 667 Connect to /lost+found? yes Inode 667 ref count is 2, should be 1. Fix? yes Unattached inode 668 Connect to /lost+found? yes Inode 668 ref count is 2, should be 1. Fix? yes Unattached inode 669 Connect to /lost+found? yes Inode 669 ref count is 2, should be 1. Fix? yes Unattached inode 670 Connect to /lost+found? yes Inode 670 ref count is 2, should be 1. Fix? yes Unattached inode 671 Connect to /lost+found? yes Inode 671 ref count is 2, should be 1. Fix? yes Unattached inode 672 Connect to /lost+found? yes Inode 672 ref count is 2, should be 1. Fix? yes Unattached inode 673 Connect to /lost+found? yes Inode 673 ref count is 2, should be 1. Fix? yes Unattached inode 674 Connect to /lost+found? yes Inode 674 ref count is 2, should be 1. Fix? yes Unattached inode 675 Connect to /lost+found? yes Inode 675 ref count is 2, should be 1. Fix? yes Unattached inode 676 Connect to /lost+found? yes Inode 676 ref count is 2, should be 1. Fix? yes Unattached inode 677 Connect to /lost+found? yes Inode 677 ref count is 2, should be 1. Fix? yes Unattached inode 678 Connect to /lost+found? yes Inode 678 ref count is 2, should be 1. Fix? yes Unattached inode 679 Connect to /lost+found? yes Inode 679 ref count is 2, should be 1. Fix? yes Unattached inode 680 Connect to /lost+found? yes Inode 680 ref count is 2, should be 1. Fix? yes Unattached inode 681 Connect to /lost+found? yes Inode 681 ref count is 2, should be 1. Fix? yes Unattached inode 682 Connect to /lost+found? yes Inode 682 ref count is 2, should be 1. Fix? yes Unattached inode 683 Connect to /lost+found? yes Inode 683 ref count is 2, should be 1. Fix? yes Unattached inode 684 Connect to /lost+found? yes Inode 684 ref count is 2, should be 1. Fix? yes Unattached inode 685 Connect to /lost+found? yes Inode 685 ref count is 2, should be 1. Fix? yes Unattached inode 686 Connect to /lost+found? yes Inode 686 ref count is 2, should be 1. Fix? yes Unattached inode 687 Connect to /lost+found? yes Inode 687 ref count is 2, should be 1. Fix? yes Unattached inode 688 Connect to /lost+found? yes Inode 688 ref count is 2, should be 1. Fix? yes Unattached inode 689 Connect to /lost+found? yes Inode 689 ref count is 2, should be 1. Fix? yes Unattached inode 690 Connect to /lost+found? yes Inode 690 ref count is 2, should be 1. Fix? yes Unattached inode 691 Connect to /lost+found? yes Inode 691 ref count is 2, should be 1. Fix? yes Unattached inode 692 Connect to /lost+found? yes Inode 692 ref count is 2, should be 1. Fix? yes Unattached inode 693 Connect to /lost+found? yes Inode 693 ref count is 2, should be 1. Fix? yes Unattached inode 694 Connect to /lost+found? yes Inode 694 ref count is 2, should be 1. Fix? yes Unattached inode 695 Connect to /lost+found? yes Inode 695 ref count is 2, should be 1. Fix? yes Unattached inode 696 Connect to /lost+found? yes Inode 696 ref count is 2, should be 1. Fix? yes Unattached inode 697 Connect to /lost+found? yes Inode 697 ref count is 2, should be 1. Fix? yes Unattached inode 698 Connect to /lost+found? yes Inode 698 ref count is 2, should be 1. Fix? yes Unattached inode 699 Connect to /lost+found? yes Inode 699 ref count is 2, should be 1. Fix? yes Unattached inode 700 Connect to /lost+found? yes Inode 700 ref count is 2, should be 1. Fix? yes Unattached inode 701 Connect to /lost+found? yes Inode 701 ref count is 2, should be 1. Fix? yes Unattached inode 702 Connect to /lost+found? yes Inode 702 ref count is 2, should be 1. Fix? yes Unattached inode 703 Connect to /lost+found? yes Inode 703 ref count is 2, should be 1. Fix? yes Unattached inode 704 Connect to /lost+found? yes Inode 704 ref count is 2, should be 1. Fix? yes Unattached inode 705 Connect to /lost+found? yes Inode 705 ref count is 2, should be 1. Fix? yes Unattached inode 706 Connect to /lost+found? yes Inode 706 ref count is 2, should be 1. Fix? yes Unattached inode 707 Connect to /lost+found? yes Inode 707 ref count is 2, should be 1. Fix? yes Unattached inode 708 Connect to /lost+found? yes Inode 708 ref count is 2, should be 1. Fix? yes Unattached inode 709 Connect to /lost+found? yes Inode 709 ref count is 2, should be 1. Fix? yes Unattached inode 710 Connect to /lost+found? yes Inode 710 ref count is 2, should be 1. Fix? yes Unattached inode 711 Connect to /lost+found? yes Inode 711 ref count is 2, should be 1. Fix? yes Unattached inode 712 Connect to /lost+found? yes Inode 712 ref count is 2, should be 1. Fix? yes Unattached inode 713 Connect to /lost+found? yes Inode 713 ref count is 2, should be 1. Fix? yes Unattached inode 714 Connect to /lost+found? yes Inode 714 ref count is 2, should be 1. Fix? yes Unattached inode 715 Connect to /lost+found? yes Inode 715 ref count is 2, should be 1. Fix? yes Unattached inode 716 Connect to /lost+found? yes Inode 716 ref count is 2, should be 1. Fix? yes Unattached inode 717 Connect to /lost+found? yes Inode 717 ref count is 2, should be 1. Fix? yes Unattached inode 718 Connect to /lost+found? yes Inode 718 ref count is 2, should be 1. Fix? yes Unattached inode 719 Connect to /lost+found? yes Inode 719 ref count is 2, should be 1. Fix? yes Unattached inode 720 Connect to /lost+found? yes Inode 720 ref count is 2, should be 1. Fix? yes Unattached inode 721 Connect to /lost+found? yes Inode 721 ref count is 2, should be 1. Fix? yes Unattached inode 722 Connect to /lost+found? yes Inode 722 ref count is 2, should be 1. Fix? yes Unattached inode 723 Connect to /lost+found? yes Inode 723 ref count is 2, should be 1. Fix? yes Unattached inode 724 Connect to /lost+found? yes Inode 724 ref count is 2, should be 1. Fix? yes Unattached inode 725 Connect to /lost+found? yes Inode 725 ref count is 2, should be 1. Fix? yes Unattached inode 726 Connect to /lost+found? yes Inode 726 ref count is 2, should be 1. Fix? yes Unattached inode 727 Connect to /lost+found? yes Inode 727 ref count is 2, should be 1. Fix? yes Unattached inode 728 Connect to /lost+found? yes Inode 728 ref count is 2, should be 1. Fix? yes Unattached inode 729 Connect to /lost+found? yes Inode 729 ref count is 2, should be 1. Fix? yes Unattached inode 730 Connect to /lost+found? yes Inode 730 ref count is 2, should be 1. Fix? yes Unattached inode 731 Connect to /lost+found? yes Inode 731 ref count is 2, should be 1. Fix? yes Unattached inode 732 Connect to /lost+found? yes Inode 732 ref count is 2, should be 1. Fix? yes Unattached inode 733 Connect to /lost+found? yes Inode 733 ref count is 2, should be 1. Fix? yes Unattached inode 734 Connect to /lost+found? yes Inode 734 ref count is 2, should be 1. Fix? yes Unattached inode 735 Connect to /lost+found? yes Inode 735 ref count is 2, should be 1. Fix? yes Unattached inode 736 Connect to /lost+found? yes Inode 736 ref count is 2, should be 1. Fix? yes Unattached inode 737 Connect to /lost+found? yes Inode 737 ref count is 2, should be 1. Fix? yes Unattached inode 738 Connect to /lost+found? yes Inode 738 ref count is 2, should be 1. Fix? yes Unattached inode 739 Connect to /lost+found? yes Inode 739 ref count is 2, should be 1. Fix? yes Unattached inode 740 Connect to /lost+found? yes Inode 740 ref count is 2, should be 1. Fix? yes Unattached inode 741 Connect to /lost+found? yes Inode 741 ref count is 2, should be 1. Fix? yes Unattached inode 742 Connect to /lost+found? yes Inode 742 ref count is 2, should be 1. Fix? yes Unattached inode 743 Connect to /lost+found? yes Inode 743 ref count is 2, should be 1. Fix? yes Unattached inode 744 Connect to /lost+found? yes Inode 744 ref count is 2, should be 1. Fix? yes Unattached inode 745 Connect to /lost+found? yes Inode 745 ref count is 2, should be 1. Fix? yes Unattached inode 746 Connect to /lost+found? yes Inode 746 ref count is 2, should be 1. Fix? yes Unattached inode 747 Connect to /lost+found? yes Inode 747 ref count is 2, should be 1. Fix? yes Unattached inode 748 Connect to /lost+found? yes Inode 748 ref count is 2, should be 1. Fix? yes Unattached inode 749 Connect to /lost+found? yes Inode 749 ref count is 2, should be 1. Fix? yes Unattached inode 750 Connect to /lost+found? yes Inode 750 ref count is 2, should be 1. Fix? yes Unattached inode 751 Connect to /lost+found? yes Inode 751 ref count is 2, should be 1. Fix? yes Unattached inode 752 Connect to /lost+found? yes Inode 752 ref count is 2, should be 1. Fix? yes Unattached inode 753 Connect to /lost+found? yes Inode 753 ref count is 2, should be 1. Fix? yes Unattached inode 754 Connect to /lost+found? yes Inode 754 ref count is 2, should be 1. Fix? yes Unattached inode 755 Connect to /lost+found? yes Inode 755 ref count is 2, should be 1. Fix? yes Unattached inode 756 Connect to /lost+found? yes Inode 756 ref count is 2, should be 1. Fix? yes Unattached inode 757 Connect to /lost+found? yes Inode 757 ref count is 2, should be 1. Fix? yes Unattached inode 758 Connect to /lost+found? yes Inode 758 ref count is 2, should be 1. Fix? yes Unattached inode 759 Connect to /lost+found? yes Inode 759 ref count is 2, should be 1. Fix? yes Unattached inode 760 Connect to /lost+found? yes Inode 760 ref count is 2, should be 1. Fix? yes Unattached inode 761 Connect to /lost+found? yes Inode 761 ref count is 2, should be 1. Fix? yes Unattached inode 762 Connect to /lost+found? yes Inode 762 ref count is 2, should be 1. Fix? yes Unattached inode 763 Connect to /lost+found? yes Inode 763 ref count is 2, should be 1. Fix? yes Unattached inode 764 Connect to /lost+found? yes Inode 764 ref count is 2, should be 1. Fix? yes Unattached inode 765 Connect to /lost+found? yes Inode 765 ref count is 2, should be 1. Fix? yes Unattached inode 766 Connect to /lost+found? yes Inode 766 ref count is 2, should be 1. Fix? yes Unattached inode 767 Connect to /lost+found? yes Inode 767 ref count is 2, should be 1. Fix? yes Unattached inode 768 Connect to /lost+found? yes Inode 768 ref count is 2, should be 1. Fix? yes Unattached inode 769 Connect to /lost+found? yes Inode 769 ref count is 2, should be 1. Fix? yes Unattached inode 770 Connect to /lost+found? yes Inode 770 ref count is 2, should be 1. Fix? yes Unattached inode 771 Connect to /lost+found? yes Inode 771 ref count is 2, should be 1. Fix? yes Unattached inode 772 Connect to /lost+found? yes Inode 772 ref count is 2, should be 1. Fix? yes Unattached inode 773 Connect to /lost+found? yes Inode 773 ref count is 2, should be 1. Fix? yes Unattached inode 774 Connect to /lost+found? yes Inode 774 ref count is 2, should be 1. Fix? yes Unattached inode 775 Connect to /lost+found? yes Inode 775 ref count is 2, should be 1. Fix? yes Unattached inode 776 Connect to /lost+found? yes Inode 776 ref count is 2, should be 1. Fix? yes Unattached inode 777 Connect to /lost+found? yes Inode 777 ref count is 2, should be 1. Fix? yes Unattached inode 778 Connect to /lost+found? yes Inode 778 ref count is 2, should be 1. Fix? yes Unattached inode 779 Connect to /lost+found? yes Inode 779 ref count is 2, should be 1. Fix? yes Unattached inode 780 Connect to /lost+found? yes Inode 780 ref count is 2, should be 1. Fix? yes Unattached inode 781 Connect to /lost+found? yes Inode 781 ref count is 2, should be 1. Fix? yes Unattached inode 782 Connect to /lost+found? yes Inode 782 ref count is 2, should be 1. Fix? yes Unattached inode 783 Connect to /lost+found? yes Inode 783 ref count is 2, should be 1. Fix? yes Unattached inode 784 Connect to /lost+found? yes Inode 784 ref count is 2, should be 1. Fix? yes Unattached inode 785 Connect to /lost+found? yes Inode 785 ref count is 2, should be 1. Fix? yes Unattached inode 786 Connect to /lost+found? yes Inode 786 ref count is 2, should be 1. Fix? yes Unattached inode 787 Connect to /lost+found? yes Inode 787 ref count is 2, should be 1. Fix? yes Unattached inode 788 Connect to /lost+found? yes Inode 788 ref count is 2, should be 1. Fix? yes Unattached inode 789 Connect to /lost+found? yes Inode 789 ref count is 2, should be 1. Fix? yes Unattached inode 790 Connect to /lost+found? yes Inode 790 ref count is 2, should be 1. Fix? yes Unattached inode 791 Connect to /lost+found? yes Inode 791 ref count is 2, should be 1. Fix? yes Unattached inode 792 Connect to /lost+found? yes Inode 792 ref count is 2, should be 1. Fix? yes Unattached inode 793 Connect to /lost+found? yes Inode 793 ref count is 2, should be 1. Fix? yes Unattached inode 794 Connect to /lost+found? yes Inode 794 ref count is 2, should be 1. Fix? yes Unattached inode 795 Connect to /lost+found? yes Inode 795 ref count is 2, should be 1. Fix? yes Unattached inode 796 Connect to /lost+found? yes Inode 796 ref count is 2, should be 1. Fix? yes Unattached inode 797 Connect to /lost+found? yes Inode 797 ref count is 2, should be 1. Fix? yes Unattached inode 798 Connect to /lost+found? yes Inode 798 ref count is 2, should be 1. Fix? yes Unattached inode 799 Connect to /lost+found? yes Inode 799 ref count is 2, should be 1. Fix? yes Unattached inode 800 Connect to /lost+found? yes Inode 800 ref count is 2, should be 1. Fix? yes Unattached inode 801 Connect to /lost+found? yes Inode 801 ref count is 2, should be 1. Fix? yes Unattached inode 802 Connect to /lost+found? yes Inode 802 ref count is 2, should be 1. Fix? yes Unattached inode 803 Connect to /lost+found? yes Inode 803 ref count is 2, should be 1. Fix? yes Unattached inode 804 Connect to /lost+found? yes Inode 804 ref count is 2, should be 1. Fix? yes Unattached inode 805 Connect to /lost+found? yes Inode 805 ref count is 2, should be 1. Fix? yes Unattached inode 806 Connect to /lost+found? yes Inode 806 ref count is 2, should be 1. Fix? yes Unattached inode 807 Connect to /lost+found? yes Inode 807 ref count is 2, should be 1. Fix? yes Unattached inode 808 Connect to /lost+found? yes Inode 808 ref count is 2, should be 1. Fix? yes Unattached inode 809 Connect to /lost+found? yes Inode 809 ref count is 2, should be 1. Fix? yes Unattached inode 810 Connect to /lost+found? yes Inode 810 ref count is 2, should be 1. Fix? yes Unattached inode 811 Connect to /lost+found? yes Inode 811 ref count is 2, should be 1. Fix? yes Unattached inode 812 Connect to /lost+found? yes Inode 812 ref count is 2, should be 1. Fix? yes Unattached inode 813 Connect to /lost+found? yes Inode 813 ref count is 2, should be 1. Fix? yes Unattached inode 814 Connect to /lost+found? yes Inode 814 ref count is 2, should be 1. Fix? yes Unattached inode 815 Connect to /lost+found? yes Inode 815 ref count is 2, should be 1. Fix? yes Unattached inode 816 Connect to /lost+found? yes Inode 816 ref count is 2, should be 1. Fix? yes Unattached inode 817 Connect to /lost+found? yes Inode 817 ref count is 2, should be 1. Fix? yes Unattached inode 818 Connect to /lost+found? yes Inode 818 ref count is 2, should be 1. Fix? yes Unattached inode 819 Connect to /lost+found? yes Inode 819 ref count is 2, should be 1. Fix? yes Unattached inode 820 Connect to /lost+found? yes Inode 820 ref count is 2, should be 1. Fix? yes Unattached inode 821 Connect to /lost+found? yes Inode 821 ref count is 2, should be 1. Fix? yes Unattached inode 822 Connect to /lost+found? yes Inode 822 ref count is 2, should be 1. Fix? yes Unattached inode 823 Connect to /lost+found? yes Inode 823 ref count is 2, should be 1. Fix? yes Unattached inode 824 Connect to /lost+found? yes Inode 824 ref count is 2, should be 1. Fix? yes Unattached inode 825 Connect to /lost+found? yes Inode 825 ref count is 2, should be 1. Fix? yes Unattached inode 826 Connect to /lost+found? yes Inode 826 ref count is 2, should be 1. Fix? yes Unattached inode 827 Connect to /lost+found? yes Inode 827 ref count is 2, should be 1. Fix? yes Unattached inode 828 Connect to /lost+found? yes Inode 828 ref count is 2, should be 1. Fix? yes Unattached inode 829 Connect to /lost+found? yes Inode 829 ref count is 2, should be 1. Fix? yes Unattached inode 830 Connect to /lost+found? yes Inode 830 ref count is 2, should be 1. Fix? yes Unattached inode 831 Connect to /lost+found? yes Inode 831 ref count is 2, should be 1. Fix? yes Unattached inode 832 Connect to /lost+found? yes Inode 832 ref count is 2, should be 1. Fix? yes Unattached inode 833 Connect to /lost+found? yes Inode 833 ref count is 2, should be 1. Fix? yes Unattached inode 834 Connect to /lost+found? yes Inode 834 ref count is 2, should be 1. Fix? yes Unattached inode 835 Connect to /lost+found? yes Inode 835 ref count is 2, should be 1. Fix? yes Unattached inode 836 Connect to /lost+found? yes Inode 836 ref count is 2, should be 1. Fix? yes Unattached inode 837 Connect to /lost+found? yes Inode 837 ref count is 2, should be 1. Fix? yes Unattached inode 838 Connect to /lost+found? yes Inode 838 ref count is 2, should be 1. Fix? yes Unattached inode 839 Connect to /lost+found? yes Inode 839 ref count is 2, should be 1. Fix? yes Unattached inode 840 Connect to /lost+found? yes Inode 840 ref count is 2, should be 1. Fix? yes Unattached inode 841 Connect to /lost+found? yes Inode 841 ref count is 2, should be 1. Fix? yes Unattached inode 842 Connect to /lost+found? yes Inode 842 ref count is 2, should be 1. Fix? yes Unattached inode 843 Connect to /lost+found? yes Inode 843 ref count is 2, should be 1. Fix? yes Unattached inode 844 Connect to /lost+found? yes Inode 844 ref count is 2, should be 1. Fix? yes Unattached inode 845 Connect to /lost+found? yes Inode 845 ref count is 2, should be 1. Fix? yes Unattached inode 846 Connect to /lost+found? yes Inode 846 ref count is 2, should be 1. Fix? yes Unattached inode 847 Connect to /lost+found? yes Inode 847 ref count is 2, should be 1. Fix? yes Unattached inode 848 Connect to /lost+found? yes Inode 848 ref count is 2, should be 1. Fix? yes Unattached inode 849 Connect to /lost+found? yes Inode 849 ref count is 2, should be 1. Fix? yes Unattached inode 850 Connect to /lost+found? yes Inode 850 ref count is 2, should be 1. Fix? yes Unattached inode 851 Connect to /lost+found? yes Inode 851 ref count is 2, should be 1. Fix? yes Unattached inode 852 Connect to /lost+found? yes Inode 852 ref count is 2, should be 1. Fix? yes Unattached inode 853 Connect to /lost+found? yes Inode 853 ref count is 2, should be 1. Fix? yes Unattached inode 854 Connect to /lost+found? yes Inode 854 ref count is 2, should be 1. Fix? yes Unattached inode 855 Connect to /lost+found? yes Inode 855 ref count is 2, should be 1. Fix? yes Unattached inode 856 Connect to /lost+found? yes Inode 856 ref count is 2, should be 1. Fix? yes Unattached inode 857 Connect to /lost+found? yes Inode 857 ref count is 2, should be 1. Fix? yes Unattached inode 858 Connect to /lost+found? yes Inode 858 ref count is 2, should be 1. Fix? yes Unattached inode 859 Connect to /lost+found? yes Inode 859 ref count is 2, should be 1. Fix? yes Unattached inode 860 Connect to /lost+found? yes Inode 860 ref count is 2, should be 1. Fix? yes Unattached inode 861 Connect to /lost+found? yes Inode 861 ref count is 2, should be 1. Fix? yes Unattached inode 862 Connect to /lost+found? yes Inode 862 ref count is 2, should be 1. Fix? yes Unattached inode 863 Connect to /lost+found? yes Inode 863 ref count is 2, should be 1. Fix? yes Unattached inode 864 Connect to /lost+found? yes Inode 864 ref count is 2, should be 1. Fix? yes Unattached inode 865 Connect to /lost+found? yes Inode 865 ref count is 2, should be 1. Fix? yes Unattached inode 866 Connect to /lost+found? yes Inode 866 ref count is 2, should be 1. Fix? yes Unattached inode 867 Connect to /lost+found? yes Inode 867 ref count is 2, should be 1. Fix? yes Unattached inode 868 Connect to /lost+found? yes Inode 868 ref count is 2, should be 1. Fix? yes Unattached inode 869 Connect to /lost+found? yes Inode 869 ref count is 2, should be 1. Fix? yes Unattached inode 870 Connect to /lost+found? yes Inode 870 ref count is 2, should be 1. Fix? yes Unattached inode 871 Connect to /lost+found? yes Inode 871 ref count is 2, should be 1. Fix? yes Unattached inode 872 Connect to /lost+found? yes Inode 872 ref count is 2, should be 1. Fix? yes Unattached inode 873 Connect to /lost+found? yes Inode 873 ref count is 2, should be 1. Fix? yes Unattached inode 874 Connect to /lost+found? yes Inode 874 ref count is 2, should be 1. Fix? yes Unattached inode 875 Connect to /lost+found? yes Inode 875 ref count is 2, should be 1. Fix? yes Unattached inode 876 Connect to /lost+found? yes Inode 876 ref count is 2, should be 1. Fix? yes Unattached inode 877 Connect to /lost+found? yes Inode 877 ref count is 2, should be 1. Fix? yes Unattached inode 878 Connect to /lost+found? yes Inode 878 ref count is 2, should be 1. Fix? yes Unattached inode 879 Connect to /lost+found? yes Inode 879 ref count is 2, should be 1. Fix? yes Unattached inode 880 Connect to /lost+found? yes Inode 880 ref count is 2, should be 1. Fix? yes Unattached inode 881 Connect to /lost+found? yes Inode 881 ref count is 2, should be 1. Fix? yes Unattached inode 882 Connect to /lost+found? yes Inode 882 ref count is 2, should be 1. Fix? yes Unattached inode 883 Connect to /lost+found? yes Inode 883 ref count is 2, should be 1. Fix? yes Unattached inode 884 Connect to /lost+found? yes Inode 884 ref count is 2, should be 1. Fix? yes Unattached inode 885 Connect to /lost+found? yes Inode 885 ref count is 2, should be 1. Fix? yes Unattached inode 886 Connect to /lost+found? yes Inode 886 ref count is 2, should be 1. Fix? yes Unattached inode 887 Connect to /lost+found? yes Inode 887 ref count is 2, should be 1. Fix? yes Unattached inode 888 Connect to /lost+found? yes Inode 888 ref count is 2, should be 1. Fix? yes Unattached inode 889 Connect to /lost+found? yes Inode 889 ref count is 2, should be 1. Fix? yes Unattached inode 890 Connect to /lost+found? yes Inode 890 ref count is 2, should be 1. Fix? yes Unattached inode 891 Connect to /lost+found? yes Inode 891 ref count is 2, should be 1. Fix? yes Unattached inode 892 Connect to /lost+found? yes Inode 892 ref count is 2, should be 1. Fix? yes Unattached inode 893 Connect to /lost+found? yes Inode 893 ref count is 2, should be 1. Fix? yes Unattached inode 894 Connect to /lost+found? yes Inode 894 ref count is 2, should be 1. Fix? yes Unattached inode 895 Connect to /lost+found? yes Inode 895 ref count is 2, should be 1. Fix? yes Unattached inode 896 Connect to /lost+found? yes Inode 896 ref count is 2, should be 1. Fix? yes Unattached inode 897 Connect to /lost+found? yes Inode 897 ref count is 2, should be 1. Fix? yes Unattached inode 898 Connect to /lost+found? yes Inode 898 ref count is 2, should be 1. Fix? yes Unattached inode 899 Connect to /lost+found? yes Inode 899 ref count is 2, should be 1. Fix? yes Unattached inode 900 Connect to /lost+found? yes Inode 900 ref count is 2, should be 1. Fix? yes Unattached inode 901 Connect to /lost+found? yes Inode 901 ref count is 2, should be 1. Fix? yes Unattached inode 902 Connect to /lost+found? yes Inode 902 ref count is 2, should be 1. Fix? yes Unattached inode 903 Connect to /lost+found? yes Inode 903 ref count is 2, should be 1. Fix? yes Unattached inode 904 Connect to /lost+found? yes Inode 904 ref count is 2, should be 1. Fix? yes Unattached inode 905 Connect to /lost+found? yes Inode 905 ref count is 2, should be 1. Fix? yes Unattached inode 906 Connect to /lost+found? yes Inode 906 ref count is 2, should be 1. Fix? yes Unattached inode 907 Connect to /lost+found? yes Inode 907 ref count is 2, should be 1. Fix? yes Unattached inode 908 Connect to /lost+found? yes Inode 908 ref count is 2, should be 1. Fix? yes Unattached inode 909 Connect to /lost+found? yes Inode 909 ref count is 2, should be 1. Fix? yes Unattached inode 910 Connect to /lost+found? yes Inode 910 ref count is 2, should be 1. Fix? yes Unattached inode 911 Connect to /lost+found? yes Inode 911 ref count is 2, should be 1. Fix? yes Unattached inode 912 Connect to /lost+found? yes Inode 912 ref count is 2, should be 1. Fix? yes Unattached inode 913 Connect to /lost+found? yes Inode 913 ref count is 2, should be 1. Fix? yes Unattached inode 914 Connect to /lost+found? yes Inode 914 ref count is 2, should be 1. Fix? yes Unattached inode 915 Connect to /lost+found? yes Inode 915 ref count is 2, should be 1. Fix? yes Unattached inode 916 Connect to /lost+found? yes Inode 916 ref count is 2, should be 1. Fix? yes Unattached inode 917 Connect to /lost+found? yes Inode 917 ref count is 2, should be 1. Fix? yes Unattached inode 918 Connect to /lost+found? yes Inode 918 ref count is 2, should be 1. Fix? yes Unattached inode 919 Connect to /lost+found? yes Inode 919 ref count is 2, should be 1. Fix? yes Unattached inode 920 Connect to /lost+found? yes Inode 920 ref count is 2, should be 1. Fix? yes Unattached inode 921 Connect to /lost+found? yes Inode 921 ref count is 2, should be 1. Fix? yes Unattached inode 922 Connect to /lost+found? yes Inode 922 ref count is 2, should be 1. Fix? yes Unattached inode 923 Connect to /lost+found? yes Inode 923 ref count is 2, should be 1. Fix? yes Unattached inode 924 Connect to /lost+found? yes Inode 924 ref count is 2, should be 1. Fix? yes Unattached inode 925 Connect to /lost+found? yes Inode 925 ref count is 2, should be 1. Fix? yes Unattached inode 926 Connect to /lost+found? yes Inode 926 ref count is 2, should be 1. Fix? yes Unattached inode 927 Connect to /lost+found? yes Inode 927 ref count is 2, should be 1. Fix? yes Unattached inode 928 Connect to /lost+found? yes Inode 928 ref count is 2, should be 1. Fix? yes Unattached inode 929 Connect to /lost+found? yes Inode 929 ref count is 2, should be 1. Fix? yes Unattached inode 930 Connect to /lost+found? yes Inode 930 ref count is 2, should be 1. Fix? yes Unattached inode 931 Connect to /lost+found? yes Inode 931 ref count is 2, should be 1. Fix? yes Unattached inode 932 Connect to /lost+found? yes Inode 932 ref count is 2, should be 1. Fix? yes Unattached inode 933 Connect to /lost+found? yes Inode 933 ref count is 2, should be 1. Fix? yes Unattached inode 934 Connect to /lost+found? yes Inode 934 ref count is 2, should be 1. Fix? yes Unattached inode 935 Connect to /lost+found? yes Inode 935 ref count is 2, should be 1. Fix? yes Unattached inode 936 Connect to /lost+found? yes Inode 936 ref count is 2, should be 1. Fix? yes Unattached inode 937 Connect to /lost+found? yes Inode 937 ref count is 2, should be 1. Fix? yes Unattached inode 938 Connect to /lost+found? yes Inode 938 ref count is 2, should be 1. Fix? yes Unattached inode 939 Connect to /lost+found? yes Inode 939 ref count is 2, should be 1. Fix? yes Unattached inode 940 Connect to /lost+found? yes Inode 940 ref count is 2, should be 1. Fix? yes Unattached inode 941 Connect to /lost+found? yes Inode 941 ref count is 2, should be 1. Fix? yes Unattached inode 942 Connect to /lost+found? yes Inode 942 ref count is 2, should be 1. Fix? yes Unattached inode 943 Connect to /lost+found? yes Inode 943 ref count is 2, should be 1. Fix? yes Unattached inode 944 Connect to /lost+found? yes Inode 944 ref count is 2, should be 1. Fix? yes Unattached inode 945 Connect to /lost+found? yes Inode 945 ref count is 2, should be 1. Fix? yes Unattached inode 946 Connect to /lost+found? yes Inode 946 ref count is 2, should be 1. Fix? yes Unattached inode 947 Connect to /lost+found? yes Inode 947 ref count is 2, should be 1. Fix? yes Unattached inode 948 Connect to /lost+found? yes Inode 948 ref count is 2, should be 1. Fix? yes Unattached inode 949 Connect to /lost+found? yes Inode 949 ref count is 2, should be 1. Fix? yes Unattached inode 950 Connect to /lost+found? yes Inode 950 ref count is 2, should be 1. Fix? yes Unattached inode 951 Connect to /lost+found? yes Inode 951 ref count is 2, should be 1. Fix? yes Unattached inode 952 Connect to /lost+found? yes Inode 952 ref count is 2, should be 1. Fix? yes Unattached inode 953 Connect to /lost+found? yes Inode 953 ref count is 2, should be 1. Fix? yes Unattached inode 954 Connect to /lost+found? yes Inode 954 ref count is 2, should be 1. Fix? yes Unattached inode 955 Connect to /lost+found? yes Inode 955 ref count is 2, should be 1. Fix? yes Unattached inode 956 Connect to /lost+found? yes Inode 956 ref count is 2, should be 1. Fix? yes Unattached inode 957 Connect to /lost+found? yes Inode 957 ref count is 2, should be 1. Fix? yes Unattached inode 958 Connect to /lost+found? yes Inode 958 ref count is 2, should be 1. Fix? yes Unattached inode 959 Connect to /lost+found? yes Inode 959 ref count is 2, should be 1. Fix? yes Unattached inode 960 Connect to /lost+found? yes Inode 960 ref count is 2, should be 1. Fix? yes Unattached inode 961 Connect to /lost+found? yes Inode 961 ref count is 2, should be 1. Fix? yes Unattached inode 962 Connect to /lost+found? yes Inode 962 ref count is 2, should be 1. Fix? yes Unattached inode 963 Connect to /lost+found? yes Inode 963 ref count is 2, should be 1. Fix? yes Unattached inode 964 Connect to /lost+found? yes Inode 964 ref count is 2, should be 1. Fix? yes Unattached inode 965 Connect to /lost+found? yes Inode 965 ref count is 2, should be 1. Fix? yes Unattached inode 966 Connect to /lost+found? yes Inode 966 ref count is 2, should be 1. Fix? yes Unattached inode 967 Connect to /lost+found? yes Inode 967 ref count is 2, should be 1. Fix? yes Unattached inode 968 Connect to /lost+found? yes Inode 968 ref count is 2, should be 1. Fix? yes Unattached inode 969 Connect to /lost+found? yes Inode 969 ref count is 2, should be 1. Fix? yes Unattached inode 970 Connect to /lost+found? yes Inode 970 ref count is 2, should be 1. Fix? yes Unattached inode 971 Connect to /lost+found? yes Inode 971 ref count is 2, should be 1. Fix? yes Unattached inode 972 Connect to /lost+found? yes Inode 972 ref count is 2, should be 1. Fix? yes Unattached inode 973 Connect to /lost+found? yes Inode 973 ref count is 2, should be 1. Fix? yes Unattached inode 974 Connect to /lost+found? yes Inode 974 ref count is 2, should be 1. Fix? yes Unattached inode 975 Connect to /lost+found? yes Inode 975 ref count is 2, should be 1. Fix? yes Unattached inode 976 Connect to /lost+found? yes Inode 976 ref count is 2, should be 1. Fix? yes Unattached inode 977 Connect to /lost+found? yes Inode 977 ref count is 2, should be 1. Fix? yes Unattached inode 978 Connect to /lost+found? yes Inode 978 ref count is 2, should be 1. Fix? yes Unattached inode 979 Connect to /lost+found? yes Inode 979 ref count is 2, should be 1. Fix? yes Unattached inode 980 Connect to /lost+found? yes Inode 980 ref count is 2, should be 1. Fix? yes Unattached inode 981 Connect to /lost+found? yes Inode 981 ref count is 2, should be 1. Fix? yes Unattached inode 982 Connect to /lost+found? yes Inode 982 ref count is 2, should be 1. Fix? yes Unattached inode 983 Connect to /lost+found? yes Inode 983 ref count is 2, should be 1. Fix? yes Unattached inode 984 Connect to /lost+found? yes Inode 984 ref count is 2, should be 1. Fix? yes Unattached inode 985 Connect to /lost+found? yes Inode 985 ref count is 2, should be 1. Fix? yes Unattached inode 986 Connect to /lost+found? yes Inode 986 ref count is 2, should be 1. Fix? yes Unattached inode 987 Connect to /lost+found? yes Inode 987 ref count is 2, should be 1. Fix? yes Unattached inode 988 Connect to /lost+found? yes Inode 988 ref count is 2, should be 1. Fix? yes Unattached inode 989 Connect to /lost+found? yes Inode 989 ref count is 2, should be 1. Fix? yes Unattached inode 990 Connect to /lost+found? yes Inode 990 ref count is 2, should be 1. Fix? yes Unattached inode 991 Connect to /lost+found? yes Inode 991 ref count is 2, should be 1. Fix? yes Unattached inode 992 Connect to /lost+found? yes Inode 992 ref count is 2, should be 1. Fix? yes Unattached inode 993 Connect to /lost+found? yes Inode 993 ref count is 2, should be 1. Fix? yes Unattached inode 994 Connect to /lost+found? yes Inode 994 ref count is 2, should be 1. Fix? yes Unattached inode 995 Connect to /lost+found? yes Inode 995 ref count is 2, should be 1. Fix? yes Unattached inode 996 Connect to /lost+found? yes Inode 996 ref count is 2, should be 1. Fix? yes Unattached inode 997 Connect to /lost+found? yes Inode 997 ref count is 2, should be 1. Fix? yes Unattached inode 998 Connect to /lost+found? yes Inode 998 ref count is 2, should be 1. Fix? yes Unattached inode 999 Connect to /lost+found? yes Inode 999 ref count is 2, should be 1. Fix? yes Unattached inode 1000 Connect to /lost+found? yes Inode 1000 ref count is 2, should be 1. Fix? yes Unattached inode 1001 Connect to /lost+found? yes Inode 1001 ref count is 2, should be 1. Fix? yes Unattached inode 1002 Connect to /lost+found? yes Inode 1002 ref count is 2, should be 1. Fix? yes Unattached inode 1003 Connect to /lost+found? yes Inode 1003 ref count is 2, should be 1. Fix? yes Unattached inode 1004 Connect to /lost+found? yes Inode 1004 ref count is 2, should be 1. Fix? yes Unattached inode 1005 Connect to /lost+found? yes Inode 1005 ref count is 2, should be 1. Fix? yes Unattached inode 1006 Connect to /lost+found? yes Inode 1006 ref count is 2, should be 1. Fix? yes Unattached inode 1007 Connect to /lost+found? yes Inode 1007 ref count is 2, should be 1. Fix? yes Unattached inode 1008 Connect to /lost+found? yes Inode 1008 ref count is 2, should be 1. Fix? yes Unattached inode 1009 Connect to /lost+found? yes Inode 1009 ref count is 2, should be 1. Fix? yes Unattached inode 1010 Connect to /lost+found? yes Inode 1010 ref count is 2, should be 1. Fix? yes Unattached inode 1011 Connect to /lost+found? yes Inode 1011 ref count is 2, should be 1. Fix? yes Unattached inode 1012 Connect to /lost+found? yes Inode 1012 ref count is 2, should be 1. Fix? yes Unattached inode 1013 Connect to /lost+found? yes Inode 1013 ref count is 2, should be 1. Fix? yes Unattached inode 1014 Connect to /lost+found? yes Inode 1014 ref count is 2, should be 1. Fix? yes Unattached inode 1015 Connect to /lost+found? yes Inode 1015 ref count is 2, should be 1. Fix? yes Unattached inode 1016 Connect to /lost+found? yes Inode 1016 ref count is 2, should be 1. Fix? yes Unattached inode 1017 Connect to /lost+found? yes Inode 1017 ref count is 2, should be 1. Fix? yes Unattached inode 1018 Connect to /lost+found? yes Inode 1018 ref count is 2, should be 1. Fix? yes Unattached inode 1019 Connect to /lost+found? yes Inode 1019 ref count is 2, should be 1. Fix? yes Unattached inode 1020 Connect to /lost+found? yes Inode 1020 ref count is 2, should be 1. Fix? yes Unattached inode 1021 Connect to /lost+found? yes Inode 1021 ref count is 2, should be 1. Fix? yes Unattached inode 1022 Connect to /lost+found? yes Inode 1022 ref count is 2, should be 1. Fix? yes Unattached inode 1023 Connect to /lost+found? yes Inode 1023 ref count is 2, should be 1. Fix? yes Unattached inode 1024 Connect to /lost+found? yes Inode 1024 ref count is 2, should be 1. Fix? yes Unattached inode 1025 Connect to /lost+found? yes Inode 1025 ref count is 2, should be 1. Fix? yes Unattached inode 1026 Connect to /lost+found? yes Inode 1026 ref count is 2, should be 1. Fix? yes Unattached inode 1027 Connect to /lost+found? yes Inode 1027 ref count is 2, should be 1. Fix? yes Unattached inode 1028 Connect to /lost+found? yes Inode 1028 ref count is 2, should be 1. Fix? yes Unattached inode 1029 Connect to /lost+found? yes Inode 1029 ref count is 2, should be 1. Fix? yes Unattached inode 1030 Connect to /lost+found? yes Inode 1030 ref count is 2, should be 1. Fix? yes Unattached inode 1031 Connect to /lost+found? yes Inode 1031 ref count is 2, should be 1. Fix? yes Unattached inode 1032 Connect to /lost+found? yes Inode 1032 ref count is 2, should be 1. Fix? yes Unattached inode 1033 Connect to /lost+found? yes Inode 1033 ref count is 2, should be 1. Fix? yes Unattached inode 1034 Connect to /lost+found? yes Inode 1034 ref count is 2, should be 1. Fix? yes Unattached inode 1035 Connect to /lost+found? yes Inode 1035 ref count is 2, should be 1. Fix? yes Unattached inode 1036 Connect to /lost+found? yes Inode 1036 ref count is 2, should be 1. Fix? yes Unattached inode 1037 Connect to /lost+found? yes Inode 1037 ref count is 2, should be 1. Fix? yes Unattached inode 1038 Connect to /lost+found? yes Inode 1038 ref count is 2, should be 1. Fix? yes Unattached inode 1039 Connect to /lost+found? yes Inode 1039 ref count is 2, should be 1. Fix? yes Unattached inode 1040 Connect to /lost+found? yes Inode 1040 ref count is 2, should be 1. Fix? yes Unattached inode 1041 Connect to /lost+found? yes Inode 1041 ref count is 2, should be 1. Fix? yes Unattached inode 1042 Connect to /lost+found? yes Inode 1042 ref count is 2, should be 1. Fix? yes Unattached inode 1043 Connect to /lost+found? yes Inode 1043 ref count is 2, should be 1. Fix? yes Unattached inode 1044 Connect to /lost+found? yes Inode 1044 ref count is 2, should be 1. Fix? yes Unattached inode 1045 Connect to /lost+found? yes Inode 1045 ref count is 2, should be 1. Fix? yes Unattached inode 1046 Connect to /lost+found? yes Inode 1046 ref count is 2, should be 1. Fix? yes Unattached inode 1047 Connect to /lost+found? yes Inode 1047 ref count is 2, should be 1. Fix? yes Unattached inode 1048 Connect to /lost+found? yes Inode 1048 ref count is 2, should be 1. Fix? yes Unattached inode 1049 Connect to /lost+found? yes Inode 1049 ref count is 2, should be 1. Fix? yes Unattached inode 1050 Connect to /lost+found? yes Inode 1050 ref count is 2, should be 1. Fix? yes Unattached inode 1051 Connect to /lost+found? yes Inode 1051 ref count is 2, should be 1. Fix? yes Unattached inode 1052 Connect to /lost+found? yes Inode 1052 ref count is 2, should be 1. Fix? yes Unattached inode 1053 Connect to /lost+found? yes Inode 1053 ref count is 2, should be 1. Fix? yes Unattached inode 1054 Connect to /lost+found? yes Inode 1054 ref count is 2, should be 1. Fix? yes Unattached inode 1055 Connect to /lost+found? yes Inode 1055 ref count is 2, should be 1. Fix? yes Unattached inode 1056 Connect to /lost+found? yes Inode 1056 ref count is 2, should be 1. Fix? yes Unattached inode 1057 Connect to /lost+found? yes Inode 1057 ref count is 2, should be 1. Fix? yes Unattached inode 1058 Connect to /lost+found? yes Inode 1058 ref count is 2, should be 1. Fix? yes Unattached inode 1059 Connect to /lost+found? yes Inode 1059 ref count is 2, should be 1. Fix? yes Unattached inode 1060 Connect to /lost+found? yes Inode 1060 ref count is 2, should be 1. Fix? yes Unattached inode 1061 Connect to /lost+found? yes Inode 1061 ref count is 2, should be 1. Fix? yes Unattached inode 1062 Connect to /lost+found? yes Inode 1062 ref count is 2, should be 1. Fix? yes Unattached inode 1063 Connect to /lost+found? yes Inode 1063 ref count is 2, should be 1. Fix? yes Unattached inode 1064 Connect to /lost+found? yes Inode 1064 ref count is 2, should be 1. Fix? yes Unattached inode 1065 Connect to /lost+found? yes Inode 1065 ref count is 2, should be 1. Fix? yes Unattached inode 1066 Connect to /lost+found? yes Inode 1066 ref count is 2, should be 1. Fix? yes Unattached inode 1067 Connect to /lost+found? yes Inode 1067 ref count is 2, should be 1. Fix? yes Unattached inode 1068 Connect to /lost+found? yes Inode 1068 ref count is 2, should be 1. Fix? yes Unattached inode 1069 Connect to /lost+found? yes Inode 1069 ref count is 2, should be 1. Fix? yes Unattached inode 1070 Connect to /lost+found? yes Inode 1070 ref count is 2, should be 1. Fix? yes Unattached inode 1071 Connect to /lost+found? yes Inode 1071 ref count is 2, should be 1. Fix? yes Unattached inode 1072 Connect to /lost+found? yes Inode 1072 ref count is 2, should be 1. Fix? yes Unattached inode 1073 Connect to /lost+found? yes Inode 1073 ref count is 2, should be 1. Fix? yes Unattached inode 1074 Connect to /lost+found? yes Inode 1074 ref count is 2, should be 1. Fix? yes Unattached inode 1075 Connect to /lost+found? yes Inode 1075 ref count is 2, should be 1. Fix? yes Unattached inode 1076 Connect to /lost+found? yes Inode 1076 ref count is 2, should be 1. Fix? yes Unattached inode 1077 Connect to /lost+found? yes Inode 1077 ref count is 2, should be 1. Fix? yes Unattached inode 1078 Connect to /lost+found? yes Inode 1078 ref count is 2, should be 1. Fix? yes Unattached inode 1079 Connect to /lost+found? yes Inode 1079 ref count is 2, should be 1. Fix? yes Unattached inode 1080 Connect to /lost+found? yes Inode 1080 ref count is 2, should be 1. Fix? yes Unattached inode 1081 Connect to /lost+found? yes Inode 1081 ref count is 2, should be 1. Fix? yes Unattached inode 1082 Connect to /lost+found? yes Inode 1082 ref count is 2, should be 1. Fix? yes Unattached inode 1083 Connect to /lost+found? yes Inode 1083 ref count is 2, should be 1. Fix? yes Unattached inode 1084 Connect to /lost+found? yes Inode 1084 ref count is 2, should be 1. Fix? yes Unattached inode 1085 Connect to /lost+found? yes Inode 1085 ref count is 2, should be 1. Fix? yes Unattached inode 1086 Connect to /lost+found? yes Inode 1086 ref count is 2, should be 1. Fix? yes Unattached inode 1087 Connect to /lost+found? yes Inode 1087 ref count is 2, should be 1. Fix? yes Unattached inode 1088 Connect to /lost+found? yes Inode 1088 ref count is 2, should be 1. Fix? yes Unattached inode 1089 Connect to /lost+found? yes Inode 1089 ref count is 2, should be 1. Fix? yes Unattached inode 1090 Connect to /lost+found? yes Inode 1090 ref count is 2, should be 1. Fix? yes Unattached inode 1091 Connect to /lost+found? yes Inode 1091 ref count is 2, should be 1. Fix? yes Unattached inode 1092 Connect to /lost+found? yes Inode 1092 ref count is 2, should be 1. Fix? yes Unattached inode 1093 Connect to /lost+found? yes Inode 1093 ref count is 2, should be 1. Fix? yes Unattached inode 1094 Connect to /lost+found? yes Inode 1094 ref count is 2, should be 1. Fix? yes Unattached inode 1095 Connect to /lost+found? yes Inode 1095 ref count is 2, should be 1. Fix? yes Unattached inode 1096 Connect to /lost+found? yes Inode 1096 ref count is 2, should be 1. Fix? yes Unattached inode 1097 Connect to /lost+found? yes Inode 1097 ref count is 2, should be 1. Fix? yes Unattached inode 1098 Connect to /lost+found? yes Inode 1098 ref count is 2, should be 1. Fix? yes Unattached inode 1099 Connect to /lost+found? yes Inode 1099 ref count is 2, should be 1. Fix? yes Unattached inode 1100 Connect to /lost+found? yes Inode 1100 ref count is 2, should be 1. Fix? yes Unattached inode 1101 Connect to /lost+found? yes Inode 1101 ref count is 2, should be 1. Fix? yes Unattached inode 1102 Connect to /lost+found? yes Inode 1102 ref count is 2, should be 1. Fix? yes Unattached inode 1103 Connect to /lost+found? yes Inode 1103 ref count is 2, should be 1. Fix? yes Unattached inode 1104 Connect to /lost+found? yes Inode 1104 ref count is 2, should be 1. Fix? yes Unattached inode 1105 Connect to /lost+found? yes Inode 1105 ref count is 2, should be 1. Fix? yes Unattached inode 1106 Connect to /lost+found? yes Inode 1106 ref count is 2, should be 1. Fix? yes Unattached inode 1107 Connect to /lost+found? yes Inode 1107 ref count is 2, should be 1. Fix? yes Unattached inode 1108 Connect to /lost+found? yes Inode 1108 ref count is 2, should be 1. Fix? yes Unattached inode 1109 Connect to /lost+found? yes Inode 1109 ref count is 2, should be 1. Fix? yes Unattached inode 1110 Connect to /lost+found? yes Inode 1110 ref count is 2, should be 1. Fix? yes Unattached inode 1111 Connect to /lost+found? yes Inode 1111 ref count is 2, should be 1. Fix? yes Unattached inode 1112 Connect to /lost+found? yes Inode 1112 ref count is 2, should be 1. Fix? yes Unattached inode 1113 Connect to /lost+found? yes Inode 1113 ref count is 2, should be 1. Fix? yes Unattached inode 1114 Connect to /lost+found? yes Inode 1114 ref count is 2, should be 1. Fix? yes Unattached inode 1115 Connect to /lost+found? yes Inode 1115 ref count is 2, should be 1. Fix? yes Unattached inode 1116 Connect to /lost+found? yes Inode 1116 ref count is 2, should be 1. Fix? yes Unattached inode 1117 Connect to /lost+found? yes Inode 1117 ref count is 2, should be 1. Fix? yes Unattached inode 1118 Connect to /lost+found? yes Inode 1118 ref count is 2, should be 1. Fix? yes Unattached inode 1119 Connect to /lost+found? yes Inode 1119 ref count is 2, should be 1. Fix? yes Unattached inode 1120 Connect to /lost+found? yes Inode 1120 ref count is 2, should be 1. Fix? yes Unattached inode 1121 Connect to /lost+found? yes Inode 1121 ref count is 2, should be 1. Fix? yes Unattached inode 1122 Connect to /lost+found? yes Inode 1122 ref count is 2, should be 1. Fix? yes Unattached inode 1123 Connect to /lost+found? yes Inode 1123 ref count is 2, should be 1. Fix? yes Unattached inode 1124 Connect to /lost+found? yes Inode 1124 ref count is 2, should be 1. Fix? yes Unattached inode 1125 Connect to /lost+found? yes Inode 1125 ref count is 2, should be 1. Fix? yes Unattached inode 1126 Connect to /lost+found? yes Inode 1126 ref count is 2, should be 1. Fix? yes Unattached inode 1127 Connect to /lost+found? yes Inode 1127 ref count is 2, should be 1. Fix? yes Unattached inode 1128 Connect to /lost+found? yes Inode 1128 ref count is 2, should be 1. Fix? yes Unattached inode 1129 Connect to /lost+found? yes Inode 1129 ref count is 2, should be 1. Fix? yes Unattached inode 1130 Connect to /lost+found? yes Inode 1130 ref count is 2, should be 1. Fix? yes Unattached inode 1131 Connect to /lost+found? yes Inode 1131 ref count is 2, should be 1. Fix? yes Unattached inode 1132 Connect to /lost+found? yes Inode 1132 ref count is 2, should be 1. Fix? yes Unattached inode 1133 Connect to /lost+found? yes Inode 1133 ref count is 2, should be 1. Fix? yes Unattached inode 1134 Connect to /lost+found? yes Inode 1134 ref count is 2, should be 1. Fix? yes Unattached inode 1135 Connect to /lost+found? yes Inode 1135 ref count is 2, should be 1. Fix? yes Unattached inode 1136 Connect to /lost+found? yes Inode 1136 ref count is 2, should be 1. Fix? yes Unattached inode 1137 Connect to /lost+found? yes Inode 1137 ref count is 2, should be 1. Fix? yes Unattached inode 1138 Connect to /lost+found? yes Inode 1138 ref count is 2, should be 1. Fix? yes Unattached inode 1139 Connect to /lost+found? yes Inode 1139 ref count is 2, should be 1. Fix? yes Unattached inode 1140 Connect to /lost+found? yes Inode 1140 ref count is 2, should be 1. Fix? yes Unattached inode 1141 Connect to /lost+found? yes Inode 1141 ref count is 2, should be 1. Fix? yes Unattached inode 1142 Connect to /lost+found? yes Inode 1142 ref count is 2, should be 1. Fix? yes Unattached inode 1143 Connect to /lost+found? yes Inode 1143 ref count is 2, should be 1. Fix? yes Unattached inode 1144 Connect to /lost+found? yes Inode 1144 ref count is 2, should be 1. Fix? yes Unattached inode 1145 Connect to /lost+found? yes Inode 1145 ref count is 2, should be 1. Fix? yes Unattached inode 1146 Connect to /lost+found? yes Inode 1146 ref count is 2, should be 1. Fix? yes Unattached inode 1147 Connect to /lost+found? yes Inode 1147 ref count is 2, should be 1. Fix? yes Unattached inode 1148 Connect to /lost+found? yes Inode 1148 ref count is 2, should be 1. Fix? yes Unattached inode 1149 Connect to /lost+found? yes Inode 1149 ref count is 2, should be 1. Fix? yes Unattached inode 1150 Connect to /lost+found? yes Inode 1150 ref count is 2, should be 1. Fix? yes Unattached inode 1151 Connect to /lost+found? yes Inode 1151 ref count is 2, should be 1. Fix? yes Unattached inode 1152 Connect to /lost+found? yes Inode 1152 ref count is 2, should be 1. Fix? yes Unattached inode 1153 Connect to /lost+found? yes Inode 1153 ref count is 2, should be 1. Fix? yes Unattached inode 1154 Connect to /lost+found? yes Inode 1154 ref count is 2, should be 1. Fix? yes Unattached inode 1155 Connect to /lost+found? yes Inode 1155 ref count is 2, should be 1. Fix? yes Unattached inode 1156 Connect to /lost+found? yes Inode 1156 ref count is 2, should be 1. Fix? yes Unattached inode 1157 Connect to /lost+found? yes Inode 1157 ref count is 2, should be 1. Fix? yes Unattached inode 1158 Connect to /lost+found? yes Inode 1158 ref count is 2, should be 1. Fix? yes Unattached inode 1159 Connect to /lost+found? yes Inode 1159 ref count is 2, should be 1. Fix? yes Unattached inode 1160 Connect to /lost+found? yes Inode 1160 ref count is 2, should be 1. Fix? yes Unattached inode 1161 Connect to /lost+found? yes Inode 1161 ref count is 2, should be 1. Fix? yes Unattached inode 1162 Connect to /lost+found? yes Inode 1162 ref count is 2, should be 1. Fix? yes Unattached inode 1163 Connect to /lost+found? yes Inode 1163 ref count is 2, should be 1. Fix? yes Unattached inode 1164 Connect to /lost+found? yes Inode 1164 ref count is 2, should be 1. Fix? yes Unattached inode 1165 Connect to /lost+found? yes Inode 1165 ref count is 2, should be 1. Fix? yes Unattached inode 1166 Connect to /lost+found? yes Inode 1166 ref count is 2, should be 1. Fix? yes Unattached inode 1167 Connect to /lost+found? yes Inode 1167 ref count is 2, should be 1. Fix? yes Unattached inode 1168 Connect to /lost+found? yes Inode 1168 ref count is 2, should be 1. Fix? yes Unattached inode 1169 Connect to /lost+found? yes Inode 1169 ref count is 2, should be 1. Fix? yes Unattached inode 1170 Connect to /lost+found? yes Inode 1170 ref count is 2, should be 1. Fix? yes Unattached inode 1171 Connect to /lost+found? yes Inode 1171 ref count is 2, should be 1. Fix? yes Unattached inode 1172 Connect to /lost+found? yes Inode 1172 ref count is 2, should be 1. Fix? yes Unattached inode 1173 Connect to /lost+found? yes Inode 1173 ref count is 2, should be 1. Fix? yes Unattached inode 1174 Connect to /lost+found? yes Inode 1174 ref count is 2, should be 1. Fix? yes Unattached inode 1175 Connect to /lost+found? yes Inode 1175 ref count is 2, should be 1. Fix? yes Unattached inode 1176 Connect to /lost+found? yes Inode 1176 ref count is 2, should be 1. Fix? yes Unattached inode 1177 Connect to /lost+found? yes Inode 1177 ref count is 2, should be 1. Fix? yes Unattached inode 1178 Connect to /lost+found? yes Inode 1178 ref count is 2, should be 1. Fix? yes Unattached inode 1179 Connect to /lost+found? yes Inode 1179 ref count is 2, should be 1. Fix? yes Unattached inode 1180 Connect to /lost+found? yes Inode 1180 ref count is 2, should be 1. Fix? yes Unattached inode 1181 Connect to /lost+found? yes Inode 1181 ref count is 2, should be 1. Fix? yes Unattached inode 1182 Connect to /lost+found? yes Inode 1182 ref count is 2, should be 1. Fix? yes Unattached inode 1183 Connect to /lost+found? yes Inode 1183 ref count is 2, should be 1. Fix? yes Unattached inode 1184 Connect to /lost+found? yes Inode 1184 ref count is 2, should be 1. Fix? yes Unattached inode 1185 Connect to /lost+found? yes Inode 1185 ref count is 2, should be 1. Fix? yes Unattached inode 1186 Connect to /lost+found? yes Inode 1186 ref count is 2, should be 1. Fix? yes Unattached inode 1187 Connect to /lost+found? yes Inode 1187 ref count is 2, should be 1. Fix? yes Unattached inode 1188 Connect to /lost+found? yes Inode 1188 ref count is 2, should be 1. Fix? yes Unattached inode 1189 Connect to /lost+found? yes Inode 1189 ref count is 2, should be 1. Fix? yes Unattached inode 1190 Connect to /lost+found? yes Inode 1190 ref count is 2, should be 1. Fix? yes Unattached inode 1191 Connect to /lost+found? yes Inode 1191 ref count is 2, should be 1. Fix? yes Unattached inode 1192 Connect to /lost+found? yes Inode 1192 ref count is 2, should be 1. Fix? yes Unattached inode 1193 Connect to /lost+found? yes Inode 1193 ref count is 2, should be 1. Fix? yes Unattached inode 1194 Connect to /lost+found? yes Inode 1194 ref count is 2, should be 1. Fix? yes Unattached inode 1195 Connect to /lost+found? yes Inode 1195 ref count is 2, should be 1. Fix? yes Unattached inode 1196 Connect to /lost+found? yes Inode 1196 ref count is 2, should be 1. Fix? yes Unattached inode 1197 Connect to /lost+found? yes Inode 1197 ref count is 2, should be 1. Fix? yes Unattached inode 1198 Connect to /lost+found? yes Inode 1198 ref count is 2, should be 1. Fix? yes Unattached inode 1199 Connect to /lost+found? yes Inode 1199 ref count is 2, should be 1. Fix? yes Unattached inode 1200 Connect to /lost+found? yes Inode 1200 ref count is 2, should be 1. Fix? yes Unattached inode 1201 Connect to /lost+found? yes Inode 1201 ref count is 2, should be 1. Fix? yes Unattached inode 1202 Connect to /lost+found? yes Inode 1202 ref count is 2, should be 1. Fix? yes Unattached inode 1203 Connect to /lost+found? yes Inode 1203 ref count is 2, should be 1. Fix? yes Unattached inode 1204 Connect to /lost+found? yes Inode 1204 ref count is 2, should be 1. Fix? yes Unattached inode 1205 Connect to /lost+found? yes Inode 1205 ref count is 2, should be 1. Fix? yes Unattached inode 1206 Connect to /lost+found? yes Inode 1206 ref count is 2, should be 1. Fix? yes Unattached inode 1207 Connect to /lost+found? yes Inode 1207 ref count is 2, should be 1. Fix? yes Unattached inode 1208 Connect to /lost+found? yes Inode 1208 ref count is 2, should be 1. Fix? yes Unattached inode 1209 Connect to /lost+found? yes Inode 1209 ref count is 2, should be 1. Fix? yes Unattached inode 1210 Connect to /lost+found? yes Inode 1210 ref count is 2, should be 1. Fix? yes Unattached inode 1211 Connect to /lost+found? yes Inode 1211 ref count is 2, should be 1. Fix? yes Unattached inode 1212 Connect to /lost+found? yes Inode 1212 ref count is 2, should be 1. Fix? yes Unattached inode 1213 Connect to /lost+found? yes Inode 1213 ref count is 2, should be 1. Fix? yes Unattached inode 1214 Connect to /lost+found? yes Inode 1214 ref count is 2, should be 1. Fix? yes Unattached inode 1215 Connect to /lost+found? yes Inode 1215 ref count is 2, should be 1. Fix? yes Unattached inode 1216 Connect to /lost+found? yes Inode 1216 ref count is 2, should be 1. Fix? yes Unattached inode 1217 Connect to /lost+found? yes Inode 1217 ref count is 2, should be 1. Fix? yes Unattached inode 1218 Connect to /lost+found? yes Inode 1218 ref count is 2, should be 1. Fix? yes Unattached inode 1219 Connect to /lost+found? yes Inode 1219 ref count is 2, should be 1. Fix? yes Unattached inode 1220 Connect to /lost+found? yes Inode 1220 ref count is 2, should be 1. Fix? yes Unattached inode 1221 Connect to /lost+found? yes Inode 1221 ref count is 2, should be 1. Fix? yes Unattached inode 1222 Connect to /lost+found? yes Inode 1222 ref count is 2, should be 1. Fix? yes Pass 4: Memory used: 292k/0k (82k/211k), time: 0.17/ 0.07/ 0.05 Pass 4: I/O read: 1MB, write: 1MB, rate: 11.93MB/s Pass 5: Checking group summary information Pass 5: Memory used: 396k/0k (81k/316k), time: 0.01/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 1MB, rate: 194.17MB/s lustre-OST0000: ***** FILE SYSTEM WAS MODIFIED ***** 1406 inodes used (1.41%, out of 100000) 7 non-contiguous files (0.5%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 1400 20061 blocks used (20.06%, out of 100000) 0 bad blocks 1 large file 1191 regular files 205 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 372 files Memory used: 396k/0k (81pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 k/316k), time: 0.25/ 0.09/ 0.08 I/O read: 3MB, write: 1MB, rate: 16.02MB/s Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-OST0000 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Stopping clients: oleg605-client.virtnet /mnt/lustre (opts:) Stopping client oleg605-client.virtnet /mnt/lustre opts: Stopping clients: oleg605-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg605-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg605-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg605-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg605-server run e2fsck again after LFSCK e2fsck -d -v -t -t -f -y /dev/mapper/ost1_flakey -m8 oleg605-server: e2fsck 1.47.1-wc2 (08-Nov-2024) oleg605-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 3], used inodes 1406/100000 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2311: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2675: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 152 badness 0 to 2 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2675: increase inode 25030 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 25031 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] Pass 1: Memory used: 292k/0k (166k/127k), time: 0.03/ 0.00/ 0.01 [Thread 0] Pass 1: I/O read: 5MB, write: 0MB, rate: 149.74MB/s [Thread 0] Scanned group range [0, 3], used inodes 1406/1407 Pass 2: Checking directory structure Pass 2: Memory used: 292k/0k (118k/175k), time: 0.02/ 0.00/ 0.01 Pass 2: I/O read: 1MB, write: 0MB, rate: 42.48MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 292k/0k (118k/175k), time: 0.08/ 0.01/ 0.03 Pass 3A: Memory used: 292k/0k (119k/174k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 292k/0k (116k/177k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 3968.25MB/s Pass 4: Checking reference counts Pass 4: Memory used: 292k/0k (80k/213k), time: 0.01/ 0.00/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 396k/0k (79k/318k), time: 0.01/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 158.45MB/s 1406 inodes used (1.41%, out of 100000) 6 non-contiguous files (0.4%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 1400 20061 blocks used (20.06%, out of 100000) 0 bad blocks 1 large file 1191 regular files 205 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 1396 files Memory used: 396k/0k (79k/317k), time: 0.10/ 0.02/ 0.03 I/O read: 2MB, write: 1MB, rate: 19.21MB/s PASS 14 (90s) == sanity-scrub test 15: Dryrun mode OI scrub ============ 05:29:02 (1743499742) oleg605-server: oleg605-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Using TIMEOUT=20 preparing... Tue Apr 1 05:31:46 EDT 2025 creating 20 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d15.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0394147 s, 26.6 MB/s creating 20 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d15.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334389 s, 31.4 MB/s prepared Tue Apr 1 05:31:56 EDT 2025. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub PASS 15 (323s) == sanity-scrub test 16: Initial OI scrub can rebuild crashed index objects ========================================================== 05:34:25 (1743500065) Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f295f664000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f295f664000.idle_timeout=debug disable quota as required fail_loc=0x199 preparing... Tue Apr 1 05:35:43 EDT 2025 creating 0 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d16.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0626582 s, 16.7 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d16.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0400995 s, 26.1 MB/s prepared Tue Apr 1 05:35:52 EDT 2025. stop mds1 stop mds2 fail_loc=0 starting MDTs without disabling OI scrub oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre PASS 16 (156s) == sanity-scrub test 17a: ENOSPC on OI insert shouldn't leak inodes ========================================================== 05:37:02 (1743500222) fail_loc=0x8000019d mkdir: cannot create directory '/mnt/lustre/d17a.sanity-scrub': No space left on device Stopping /mnt/lustre-mds1 (opts:) on oleg605-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg605-server: e2fsck 1.47.1-wc2 (08-Nov-2024) oleg605-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 4], used inodes 414/160000 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2675: increase inode 44 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 45 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 46 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 47 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 48 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 49 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 151 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 152 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 185 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 210 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 211 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 212 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 213 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 214 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 215 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 216 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 217 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 218 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 219 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 242 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 264 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 266 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 267 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 268 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 269 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 270 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 271 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 272 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 273 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 274 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 275 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 276 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 277 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 278 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 279 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 280 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 281 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 282 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 283 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 284 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 285 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 286 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 287 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 288 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 289 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 290 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 291 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 292 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 293 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 294 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 295 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 296 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 297 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 298 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 299 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 300 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 301 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 303 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 304 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 307 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 308 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 310 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 312 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 315 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 321 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 323 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 327 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 328 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 329 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 330 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 331 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 332 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 333 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 334 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 335 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 336 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 337 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 338 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 339 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 340 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 341 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 342 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 343 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 344 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 345 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 346 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 347 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 348 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 349 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 350 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 351 badness 0 to 2 for 10084 [Thread 0] group 0 finished [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] Pass 1: Memory used: 296k/0k (181k/116k), time: 0.02/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 2MB, write: 0MB, rate: 132.04MB/s [Thread 0] Scanned group range [0, 4], used inodes 414/470 Pass 2: Checking directory structure Pass 2: Memory used: 296k/0k (134k/163k), time: 0.03/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 37.30MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 296k/0k (134k/163k), time: 0.06/ 0.01/ 0.01 Pass 3: Memory used: 296k/0k (133k/164k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 296k/0k (79k/218k), time: 0.01/ 0.00/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 404k/0k (78k/326k), time: 0.01/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 123.47MB/s 414 inodes used (0.26%, out of 160000) 2 non-contiguous files (0.5%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 44701 blocks used (44.70%, out of 100000) 0 bad blocks 1 large file 283 regular files 121 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 404 files Memory used: 404k/0k (81k/324k), time: 0.09/ 0.01/ 0.01 I/O read: 1MB, write: 0MB, rate: 11.51MB/s Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-MDT0000 PASS 17a (27s) == sanity-scrub test 17b: ENOSPC on .. insertion shouldn't leak inodes ========================================================== 05:37:29 (1743500249) fail_loc=0x8000019e lfs mkdir: dirstripe error on '/mnt/lustre/d17b.sanity-scrub': No space left on device lfs setdirstripe: cannot create dir '/mnt/lustre/d17b.sanity-scrub': No space left on device Stopping /mnt/lustre-mds1 (opts:) on oleg605-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg605-server: e2fsck 1.47.1-wc2 (08-Nov-2024) oleg605-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 4], used inodes 414/160000 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2675: increase inode 44 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 45 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 46 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 47 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 48 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 49 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 151 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 152 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 185 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 210 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 211 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 212 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 213 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 214 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 215 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 216 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 217 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 218 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 219 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 242 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 264 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 266 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 267 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 268 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 269 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 270 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 271 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 272 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 273 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 274 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 275 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 276 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 277 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 278 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 279 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 280 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 281 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 282 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 283 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 284 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 285 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 286 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 287 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 288 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 289 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 290 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 291 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 292 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 293 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 294 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 295 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 296 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 297 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 298 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 299 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 300 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 301 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 303 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 304 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 307 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 308 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 310 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 312 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 315 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 321 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 323 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 327 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 328 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 329 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 330 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 331 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 332 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 333 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 334 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 335 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 336 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 337 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 338 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 339 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 340 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 341 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 342 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 343 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 344 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 345 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 346 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 347 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 348 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 349 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 350 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 351 badness 0 to 2 for 10084 [Thread 0] group 0 finished [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] Pass 1: Memory used: 296k/0k (181k/116k), time: 0.01/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 2MB, write: 0MB, rate: 217.70MB/s [Thread 0] Scanned group range [0, 4], used inodes 414/470 Pass 2: Checking directory structure Pass 2: Memory used: 296k/0k (134k/163k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 103.82MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 296k/0k (134k/163k), time: 0.03/ 0.01/ 0.01 Pass 3: Memory used: 296k/0k (133k/164k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 296k/0k (79k/218k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 404k/0k (79k/326k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 161.84MB/s 414 inodes used (0.26%, out of 160000) 2 non-contiguous files (0.5%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 44701 blocks used (44.70%, out of 100000) 0 bad blocks 1 large file 283 regular files 121 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 404 files Memory used: 404k/0k (82k/323k), time: 0.05/ 0.02/ 0.01 I/O read: 1MB, write: 0MB, rate: 20.83MB/s Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-MDT0000 PASS 17b (26s) == sanity-scrub test 18: test mount -o resetoi to recreate OI files ========================================================== 05:37:56 (1743500276) preparing... Tue Apr 1 05:38:01 EDT 2025 creating 10 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d18.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0604248 s, 17.4 MB/s creating 10 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d18.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300826 s, 34.9 MB/s prepared Tue Apr 1 05:38:10 EDT 2025. stop mds1 stop mds2 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 [ 2769.000270] Lustre: lustre-MDT0000: reset Object Index mappings [ 2808.321700] Lustre: lustre-MDT0001: reset Object Index mappings [ 2965.634283] Lustre: lustre-MDT0000: reset Object Index mappings [ 2999.945096] Lustre: lustre-MDT0001: reset Object Index mappings [ 3193.673117] Lustre: lustre-MDT0000: reset Object Index mappings [ 3222.746204] Lustre: lustre-MDT0001: reset Object Index mappings [ 3550.080761] Lustre: lustre-MDT0000: reset Object Index mappings [ 4281.929459] Lustre: lustre-MDT0000: reset Object Index mappings [ 4316.624287] Lustre: lustre-MDT0001: reset Object Index mappings [ 4655.076570] Lustre: lustre-MDT0000: reset Object Index mappings [ 4695.376364] Lustre: lustre-MDT0001: reset Object Index mappings [ 5061.993151] Lustre: lustre-MDT0000: reset Object Index mappings [ 5266.739841] Lustre: lustre-MDT0000: reset Object Index mappings [ 5659.901362] Lustre: lustre-MDT0000: reset Object Index mappings [ 6147.485798] Lustre: lustre-MDT0000: reset Object Index mappings [ 7188.064308] Lustre: lustre-MDT0000: reset Object Index mappings Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre PASS 18 (103s) == sanity-scrub test 19: LFSCK can fix multiple linked files on OST ========================================================== 05:39:39 (1743500379) total: 64 open/close in 0.94 seconds: 68.18 ops/second stopall link /mnt/lustre-ost1/O/280000401/d2/291 to /mnt/lustre-ost1/O/280000401/d2/122 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started LFSCK on the device lustre-OST0000: scrub Stopping /mnt/lustre-ost1 (opts:) on oleg605-server File: /mnt/lustre-ost1/O/280000401/d2/122 Size: 0 Blocks: 0 IO Block: 4096 regular empty file Device: fc02h/64514d Inode: 207 Links: 1 Access: (7666/-rwSrwSrwT) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.000000000 -0500 Modify: 1969-12-31 19:00:00.000000000 -0500 Change: 2025-04-01 05:40:32.486000000 -0400 Birth: 2025-04-01 05:39:29.660000000 -0400 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 PASS 19 (201s) == sanity-scrub test 20: Don't trigger OI scrub for irreparable oi repeatedly ========================================================== 05:43:01 (1743500581) Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-MDT0000 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-MDT0001 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg605-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-OST0001 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f296e811000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f296e811000.idle_timeout=debug disable quota as required fail_loc=0x193 Stopping /mnt/lustre-mds1 (opts:) on oleg605-server Starting mds1: -o localrecov -o user_xattr,noscrub /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-MDT0000 fail_loc=0x19f stat: cannot statx '/mnt/lustre/d20.sanity-scrub': Stale file handle OI scrub was triggerred 2 seconds ago stat: cannot statx '/mnt/lustre/d20.sanity-scrub': Stale file handle OI scrub was triggerred 8 seconds ago PASS 20 (117s) == sanity-scrub test 21: don't hang MDS recovery when failed to get update log ========================================================== 05:44:57 (1743500697) /dev/mapper/mds1_flakey Stopping /mnt/lustre-mds1 (opts:) on oleg605-server Stopping /mnt/lustre-mds2 (opts:) on oleg605-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-MDT0000 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-MDT0001 affected facets: mds2 oleg605-server: oleg605-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 200 oleg605-server: *.lustre-MDT0001.recovery_status status: COMPLETE PASS 21 (43s) == sanity-scrub test 22: LFSCK can recreate or fix the LASTID on MDT/OST ========================================================== 05:45:41 (1743500741) Stopping clients: oleg605-client.virtnet /mnt/lustre (opts:) Stopping client oleg605-client.virtnet /mnt/lustre opts: Stopping clients: oleg605-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg605-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg605-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg605-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg605-server debug=-1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Stopping /mnt/lustre-mds1 (opts:) on oleg605-server File: /mnt/lustre-mds1/O/1/LAST_ID Size: 8 Blocks: 8 IO Block: 4096 regular file Device: fc00h/64512d Inode: 57 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.1073741822 -0500 Modify: 1969-12-31 19:00:00.1073741822 -0500 Change: 1969-12-31 19:00:00.1073741822 -0500 Birth: 2025-04-01 05:46:38.528000000 -0400 File: /mnt/lustre-mds1/O/10/LAST_ID Size: 8 Blocks: 8 IO Block: 4096 regular file Device: fc00h/64512d Inode: 58 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.1073741822 -0500 Modify: 1969-12-31 19:00:00.1073741822 -0500 Change: 1969-12-31 19:00:00.1073741822 -0500 Birth: 2025-04-01 05:46:38.532000000 -0400 File: /mnt/lustre-mds1/O/200000003/LAST_ID Size: 8 Blocks: 8 IO Block: 4096 regular file Device: fc00h/64512d Inode: 157 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-01 05:32:29.230000000 -0400 Modify: 1969-12-31 19:00:00.000000000 -0500 Change: 2025-04-01 05:32:29.231000000 -0400 Birth: 2025-04-01 05:32:29.230000000 -0400 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 PASS 22 (94s) === sanity-scrub: start setup 05:47:15 (1743500835) === Stopping clients: oleg605-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg605-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg605-server oleg605-server: oleg605-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/vdc pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Format mds2: /dev/vdd pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Format ost1: /dev/vde pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Format ost2: /dev/vdf pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Checking servers environments Checking clients oleg605-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg605-server' oleg605-server: oleg605-server.virtnet: executing load_modules_local oleg605-server: Loading modules from /home/green/git/lustre-release/lustre oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy oleg605-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy oleg605-server: detected 4 online CPUs by sysfs oleg605-server: MODOPTS_LIBCFS= oleg605-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Commit the device label on /dev/vdc Started lustre-MDT0000 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Commit the device label on /dev/vdd Started lustre-MDT0001 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Commit the device label on /dev/vde Started lustre-OST0000 pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Commit the device label on /dev/vdf Started lustre-OST0001 Starting client: oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Starting client oleg605-client.virtnet: -o user_xattr,flock 192.168.206.105@tcp:/lustre /mnt/lustre Started clients oleg605-client.virtnet: 192.168.206.105@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f296e1a9000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f296e1a9000.idle_timeout=debug disable quota as required osd-ldiskfs.track_declares_assert=1 === sanity-scrub: finish setup 05:50:31 (1743501031) === == sanity-scrub test complete, duration 7524 sec ========= 05:50:33 (1743501033) === sanity-scrub: start cleanup 05:50:36 (1743501036) === === sanity-scrub: finish cleanup 05:50:40 (1743501040) ===