-----============= acceptance-small: sanity-scrub ============----- Thu Jan 1 19:51:03 EST 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg301-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-scrub.*ex': No such file or directory excepting tests: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions client=34668548 MDS=34668548 OSS=34668548 Stopping clients: oleg301-client.virtnet /mnt/lustre (opts:) Stopping clients: oleg301-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg301-client.virtnet /mnt/lustre opts: Stopping /mnt/lustre-mds2 (opts:-f) on oleg301-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg301-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg301-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg301-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing unload_modules_local oleg301-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. === sanity-scrub: start setup 19:53:21 (1767315201) === Stopping clients: oleg301-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg301-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 2 oleg301-server: oleg301-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions oleg301-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg301-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format ost1: /dev/vde Format ost2: /dev/vdf Format mds1: /dev/vdc Format mds2: /dev/vdd pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Commit the device label on /dev/vdd pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Commit the device label on /dev/vdc Started lustre-MDT0001 Started lustre-MDT0000 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0001-super.width=65536 seq.cli-lustre-OST0000-super.width=65536 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Commit the device label on /dev/vdf pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Commit the device label on /dev/vde Started lustre-OST0001 Started lustre-OST0000 /mnt/lustre-ost2: 0 B (0 bytes) trimmed /mnt/lustre-ost1: 0 B (0 bytes) trimmed Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001c8e9a800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001c8e9a800.idle_timeout=debug setting jobstats to procname_uid Setting lustre.sys.jobid_var from disable to procname_uid Waiting 90s for 'procname_uid' disable quota as required osd-ldiskfs.track_declares_assert=1 === sanity-scrub: finish setup 19:58:47 (1767315527) === == sanity-scrub test 0: Do not auto trigger OI scrub for non-backup/restore case ========================================================== 19:58:49 (1767315529) preparing... Thu Jan 1 19:58:51 EST 2026 creating 0 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d0.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.060293 s, 17.4 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d0.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0714452 s, 14.7 MB/s prepared Thu Jan 1 19:59:02 EST 2026. stop mds1 stop mds2 starting MDTs without disabling OI scrub oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre PASS 0 (100s) == sanity-scrub test 1a: Auto trigger initial OI scrub when server mounts ========================================================== 20:00:30 (1767315630) preparing... Thu Jan 1 20:00:37 EST 2026 creating 0 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d1a.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0390103 s, 26.9 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d1a.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0424759 s, 24.7 MB/s prepared Thu Jan 1 20:00:53 EST 2026. stop mds1 stop mds2 start mds1 without disabling OI scrub: -o localrecov -o user_xattr oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre fail_loc=0x193 fail_loc=0 192.168.203.101@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg301-client.virtnet /mnt/lustre (opts:) stop mds1 start mds1 with disabling OI scrub: -o localrecov -o user_xattr,noscrub oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 PASS 1a (135s) == sanity-scrub test 1b: Trigger OI scrub when MDT mounts for OI files remove/recreate case ========================================================== 20:02:45 (1767315765) Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001c6980800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001c6980800.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:05:09 EST 2026 creating 0 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d1b.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0369015 s, 28.4 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d1b.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0836265 s, 12.5 MB/s prepared Thu Jan 1 20:05:21 EST 2026. fail_loc=0x198 fail_loc=0 stop mds1 stop mds2 removing OI files on mds1: idx= oleg301-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg301-client: oleg301-server: ssh exited with exit code 32 sanity-scrub test_1b: @@@@@@ FAIL: (1) Failed to remove OI . on mds1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:304:scrub_remove_ois() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:168:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:383:test_1b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:392:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_1b.*.1767315953.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_1b.debug_log.oleg301-server.1767315953.log.DYgzf6" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_1b.dmesg.oleg301-server.1767315953.log.tUCFD4" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1b (195s) == sanity-scrub test 1c: Auto detect kinds of OI file(s) removed/recreated cases ========================================================== 20:06:01 (1767315961) Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0001 Started lustre-MDT0000 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001d860d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001d860d800.idle_timeout=debug disable quota as required rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_1c: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:97:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:405:test_1c() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:415:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_1c.*.1767316140.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_1c.debug_log.oleg301-server.1767316140.log.UZOUBx" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_1c.dmesg.oleg301-server.1767316140.log.tbcEPQ" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1c (185s) == sanity-scrub test 2: Trigger OI scrub when MDT mounts for backup/restore case ========================================================== 20:09:05 (1767316145) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_2: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:97:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:421:test_2() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:428:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_2.*.1767316150.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_2.debug_log.oleg301-server.1767316150.log.DcPCRW" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_2.dmesg.oleg301-server.1767316150.log.obDb9h" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 2 (8s) == sanity-scrub test 4a: Auto trigger OI scrub if bad OI mapping was found (1) ========================================================== 20:09:14 (1767316154) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_4a: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:97:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:445:test_4a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:476:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_4a.*.1767316157.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_4a.debug_log.oleg301-server.1767316157.log.I3zkh0" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_4a.dmesg.oleg301-server.1767316157.log.RA4aSx" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4a (8s) == sanity-scrub test 4b: Auto trigger OI scrub if bad OI mapping was found (2) ========================================================== 20:09:21 (1767316161) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_4b: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:97:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:482:test_4b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:563:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_4b.*.1767316165.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_4b.debug_log.oleg301-server.1767316165.log.AJZyvl" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_4b.dmesg.oleg301-server.1767316165.log.Ai2mcn" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4b (7s) == sanity-scrub test 4c: Auto trigger OI scrub if bad OI mapping was found (3) ========================================================== 20:09:29 (1767316169) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_4c: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:97:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:569:test_4c() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:650:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_4c.*.1767316173.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_4c.debug_log.oleg301-server.1767316173.log.t74nK6" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_4c.dmesg.oleg301-server.1767316173.log.wkG9FD" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4c (7s) == sanity-scrub test 4d: FID in LMA mismatch with object FID won't block create ========================================================== 20:09:37 (1767316177) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_4d: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:656:test_4d() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:673:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_4d.*.1767316181.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_4d.debug_log.oleg301-server.1767316181.log.f7Wve7" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_4d.dmesg.oleg301-server.1767316181.log.HKuuU5" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4d (7s) == sanity-scrub test 4e: FID reuse can be fixed ========== 20:09:45 (1767316185) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_4e: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:678:test_4e() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:702:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_4e.*.1767316189.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_4e.debug_log.oleg301-server.1767316189.log.jK5YXs" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_4e.dmesg.oleg301-server.1767316189.log.irDyin" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4e (7s) == sanity-scrub test 5: OI scrub state machine =========== 20:09:53 (1767316193) oleg301-server: oleg301-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Using TIMEOUT=20 preparing... Thu Jan 1 20:15:06 EST 2026 creating 100 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d5.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0493708 s, 21.2 MB/s creating 100 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d5.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290931 s, 36.0 MB/s prepared Thu Jan 1 20:15:17 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg301-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg301-client: oleg301-server: ssh exited with exit code 32 sanity-scrub test_5: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:709:test_5() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:771:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_5.*.1767316544.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_5.debug_log.oleg301-server.1767316544.log.Q8yQcv" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_5.dmesg.oleg301-server.1767316544.log.LDbnFn" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 5 (358s) == sanity-scrub test 6: OI scrub resumes from last checkpoint ========================================================== 20:15:51 (1767316551) Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0000 Started lustre-MDT0001 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001c80a4000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001c80a4000.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:18:50 EST 2026 creating 100 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d6.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347764 s, 30.2 MB/s creating 100 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d6.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0414522 s, 25.3 MB/s prepared Thu Jan 1 20:19:02 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg301-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg301-client: oleg301-server: ssh exited with exit code 32 sanity-scrub test_6: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:774:test_6() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:846:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_6.*.1767316765.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_6.debug_log.oleg301-server.1767316765.log.gtrgyb" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_6.dmesg.oleg301-server.1767316765.log.LIaYvf" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 6 (221s) == sanity-scrub test 7: System is available during OI scrub scanning ========================================================== 20:19:32 (1767316772) Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0000 Started lustre-MDT0001 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001c2dc0800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001c2dc0800.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:22:04 EST 2026 creating 500 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d7.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325131 s, 32.3 MB/s creating 500 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d7.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264718 s, 39.6 MB/s prepared Thu Jan 1 20:22:26 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg301-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg301-client: oleg301-server: ssh exited with exit code 32 sanity-scrub test_7: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:849:test_7() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:882:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_7.*.1767316971.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_7.debug_log.oleg301-server.1767316971.log.mCGqZ5" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_7.dmesg.oleg301-server.1767316971.log.k6zaqI" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 7 (204s) == sanity-scrub test 8: Control OI scrub manually ======== 20:22:56 (1767316976) Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0001 Started lustre-MDT0000 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001c8328000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001c8328000.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:25:36 EST 2026 creating 128 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d8.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271615 s, 38.6 MB/s creating 128 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d8.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0370636 s, 28.3 MB/s prepared Thu Jan 1 20:25:53 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg301-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg301-client: oleg301-server: ssh exited with exit code 32 sanity-scrub test_8: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:885:test_8() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:907:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_8.*.1767317176.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_8.debug_log.oleg301-server.1767317176.log.Y9vVnl" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_8.dmesg.oleg301-server.1767317176.log.ksewfd" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 8 (206s) == sanity-scrub test 9: OI scrub speed control =========== 20:26:22 (1767317182) Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0000 Started lustre-MDT0001 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001c2dc4800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001c2dc4800.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:29:24 EST 2026 creating 6000 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d9.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0619708 s, 16.9 MB/s creating 6000 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d9.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318607 s, 32.9 MB/s prepared Thu Jan 1 20:30:58 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg301-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg301-client: oleg301-server: ssh exited with exit code 32 sanity-scrub test_9: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:918:test_9() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:991:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_9.*.1767317485.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_9.debug_log.oleg301-server.1767317485.log.vPjMe5" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_9.dmesg.oleg301-server.1767317485.log.IeLoEb" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 9 (310s) == sanity-scrub test 10a: non-stopped OI scrub should auto restarts after MDS remount (1) ========================================================== 20:31:32 (1767317492) Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0001 Started lustre-MDT0000 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001c80a7000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001c80a7000.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:36:14 EST 2026 creating 0 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d10a.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0611836 s, 17.1 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d10a.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290708 s, 36.1 MB/s prepared Thu Jan 1 20:36:24 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg301-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg301-client: oleg301-server: ssh exited with exit code 32 sanity-scrub test_10a: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:994:test_10a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1024:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_10a.*.1767317809.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_10a.debug_log.oleg301-server.1767317809.log.3RoHtc" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_10a.dmesg.oleg301-server.1767317809.log.7hXHbn" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 10a (323s) == sanity-scrub test 11: OI scrub skips the new created objects only once ========================================================== 20:36:55 (1767317815) Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0001 Started lustre-MDT0000 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001c4c38000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001c4c38000.idle_timeout=debug disable quota as required striped dir -i0 -c1 -H crush /mnt/lustre/d11.sanity-scrub/mds1 total: 100 open/close in 1.48 seconds: 67.45 ops/second striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d11.sanity-scrub/mds2 total: 100 open/close in 1.70 seconds: 58.72 ops/second oleg301-server: Fail to start LFSCK: Invalid argument pdsh@oleg301-client: oleg301-server: ssh exited with exit code 22 sanity-scrub test_11: @@@@@@ FAIL: (3) Failed to start OI scrub on mds1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:61:scrub_start() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1074:test_11() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1108:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_11.*.1767317973.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_11.debug_log.oleg301-server.1767317973.log.aG1C0H" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_11.dmesg.oleg301-server.1767317973.log.6T0KRN" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 11 (163s) == sanity-scrub test 12: OI scrub can rebuild invalid /O entries ========================================================== 20:39:38 (1767317978) fail_loc=0x195 - precreated_ost_obj_count lustre-OST0000-osc-MDT0000 prealloc_last_id: 481 prealloc_next_id: 436 count: 46 total: 78 open/close in 1.41 seconds: 55.18 ops/second 192.168.203.101@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg301-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg301-server fail_loc=0x233 Start ost1: mount -t lustre -o localrecov -o user_xattr,noscrub /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-OST0000 /mnt/lustre-ost1: 112.2 MiB (117600256 bytes) trimmed Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started LFSCK on the device lustre-OST0000: scrub fail_loc=0 PASS 12 (227s) == sanity-scrub test 13: OI scrub can rebuild missed /O entries ========================================================== 20:43:25 (1767318205) fail_loc=0x196 - precreated_ost_obj_count lustre-OST0000-osc-MDT0000 prealloc_last_id: 545 prealloc_next_id: 514 count: 32 total: 64 open/close in 1.20 seconds: 53.45 ops/second fail_loc=0 192.168.203.101@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg301-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg301-server Start ost1: mount -t lustre -o localrecov -o user_xattr,noscrub /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-OST0000 /mnt/lustre-ost1: 0 B (0 bytes) trimmed Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started LFSCK on the device lustre-OST0000: scrub PASS 13 (231s) == sanity-scrub test 14: OI scrub can repair OST objects under lost+found ========================================================== 20:47:16 (1767318436) fail_loc=0x196 - precreated_ost_obj_count lustre-OST0000-osc-MDT0000 prealloc_last_id: 609 prealloc_next_id: 578 count: 32 - open/close 831 (time 1767318454.69 total 10.00 last 83.10) total: 1032 open/close in 12.39 seconds: 83.29 ops/second fail_loc=0 192.168.203.101@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg301-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg301-server run e2fsck e2fsck -d -v -t -t -f -y /dev/vde -m8 oleg301-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg301-server: e2fsck: Cannot continue, aborting. oleg301-server: oleg301-server: pdsh@oleg301-client: oleg301-server: ssh exited with exit code 8 /dev/vde is in use. sanity-scrub test_14: @@@@@@ FAIL: e2fsck -d -v -t -t -f -y /dev/vde -m8 returned 8, should be <= 4 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6751:run_e2fsck() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1200:test_14() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1221:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_14.*.1767318472.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_14.debug_log.oleg301-server.1767318472.log.PRUGg0" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_14.dmesg.oleg301-server.1767318472.log.dGhVRu" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 14 (42s) == sanity-scrub test 15: Dryrun mode OI scrub ============ 20:47:58 (1767318478) oleg301-server: oleg301-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Using TIMEOUT=20 preparing... Thu Jan 1 20:53:08 EST 2026 creating 20 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d15.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0382167 s, 27.4 MB/s creating 20 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d15.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345671 s, 30.3 MB/s prepared Thu Jan 1 20:53:17 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg301-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg301-client: oleg301-server: ssh exited with exit code 32 sanity-scrub test_15: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1229:test_15() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1274:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_15.*.1767318823.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_15.debug_log.oleg301-server.1767318823.log.jJxAX1" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_15.dmesg.oleg301-server.1767318823.log.vHz27b" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 15 (352s) == sanity-scrub test 16: Initial OI scrub can rebuild crashed index objects ========================================================== 20:53:50 (1767318830) Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0000 Started lustre-MDT0001 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001d0b40800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001d0b40800.idle_timeout=debug disable quota as required fail_loc=0x199 preparing... Thu Jan 1 20:56:45 EST 2026 creating 0 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d16.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340816 s, 30.8 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d16.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344211 s, 30.5 MB/s prepared Thu Jan 1 20:56:56 EST 2026. stop mds1 stop mds2 fail_loc=0 starting MDTs without disabling OI scrub oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre PASS 16 (268s) == sanity-scrub test 17a: ENOSPC on OI insert shouldn't leak inodes ========================================================== 20:58:18 (1767319098) fail_loc=0x8000019d mkdir: cannot create directory '/mnt/lustre/d17a.sanity-scrub': No space left on device Stopping /mnt/lustre-mds1 (opts:) on oleg301-server e2fsck -d -v -t -t -f -n /dev/vdc -m8 oleg301-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg301-server: Use max possible thread num: 1 instead Warning! /dev/vdc is in use. Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 4], used inodes 381/160000 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 90 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 90 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 95 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 95 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 96 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 96 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 97 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 97 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 98 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 98 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 99 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 99 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 100 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 100 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 101 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 101 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 102 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 102 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 103 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 103 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 104 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 104 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 105 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 105 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 106 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 106 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 107 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 107 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 108 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 108 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 109 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 109 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 110 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 110 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 111 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 111 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 112 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 112 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 119 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 121 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 122 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 132 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 146 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 147 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 148 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 148 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 149 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 149 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 150 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 150 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 153 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 0 to 2 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 32013 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32013 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32024 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32024 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32025 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32025 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32026 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32026 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32027 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32027 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32028 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32028 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32029 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 32030 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32030 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32031 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32031 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32032 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32032 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32033 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32033 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32034 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32034 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32035 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 32036 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 32037 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] Pass 1: Memory used: 304k/0k (184k/121k), time: 0.02/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 53.70MB/s [Thread 0] Scanned group range [0, 4], used inodes 381/383 Pass 2: Checking directory structure Entry 'fld' in / (2) has deleted/unused inode 162. Clear? no Entry 'lfsck_namespace' in / (2) has deleted/unused inode 164. Clear? no check_dir_block:1649: increase inode 13 badness 0 to 1 for 20047 Entry 'nodemap' in /CONFIGS (13) references inode 333 found in group 0's unused inodes area. Fix? no Entry 'nodemap' in /CONFIGS (13) has deleted/unused inode 333. Clear? no check_dir_block:1649: increase inode 32002 badness 0 to 1 for 20047 Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) references inode 267 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) has deleted/unused inode 267. Clear? no check_filetype:716: increase inode 32002 badness 1 to 2 for 20028 Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 2 to 3 for 20047 Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) references inode 268 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) has deleted/unused inode 268. Clear? no check_filetype:716: increase inode 32002 badness 3 to 4 for 20028 Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 4 to 5 for 20047 Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) references inode 269 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) has deleted/unused inode 269. Clear? no check_filetype:716: increase inode 32002 badness 5 to 6 for 20028 Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 6 to 7 for 20047 Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) references inode 270 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) has deleted/unused inode 270. Clear? no check_filetype:716: increase inode 32002 badness 7 to 8 for 20028 Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 8 to 9 for 20047 Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) references inode 271 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) has deleted/unused inode 271. Clear? no check_filetype:716: increase inode 32002 badness 9 to 10 for 20028 Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 10 to 11 for 20047 Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) references inode 272 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) has deleted/unused inode 272. Clear? no check_filetype:716: increase inode 32002 badness 11 to 12 for 20028 Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 12 to 13 for 20047 Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) references inode 273 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) has deleted/unused inode 273. Clear? no check_filetype:716: increase inode 32002 badness 13 to 14 for 20028 Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 14 to 15 for 20047 Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) references inode 274 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) has deleted/unused inode 274. Clear? no check_filetype:716: increase inode 32002 badness 15 to 16 for 20028 Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 16 to 17 for 20047 Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) references inode 275 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) has deleted/unused inode 275. Clear? no check_filetype:716: increase inode 32002 badness 17 to 18 for 20028 Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 18 to 19 for 20047 Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) references inode 276 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) has deleted/unused inode 276. Clear? no check_filetype:716: increase inode 32002 badness 19 to 20 for 20028 Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 20 to 21 for 20047 Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) references inode 277 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) has deleted/unused inode 277. Clear? no check_filetype:716: increase inode 32002 badness 21 to 22 for 20028 Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 22 to 23 for 20047 Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) references inode 278 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) has deleted/unused inode 278. Clear? no check_filetype:716: increase inode 32002 badness 23 to 24 for 20028 Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 24 to 25 for 20047 Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) references inode 279 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) has deleted/unused inode 279. Clear? no check_filetype:716: increase inode 32002 badness 25 to 26 for 20028 Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 26 to 27 for 20047 Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) references inode 280 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) has deleted/unused inode 280. Clear? no check_filetype:716: increase inode 32002 badness 27 to 28 for 20028 Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 28 to 29 for 20047 Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) references inode 281 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) has deleted/unused inode 281. Clear? no check_filetype:716: increase inode 32002 badness 29 to 30 for 20028 Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 30 to 31 for 20047 Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) references inode 282 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) has deleted/unused inode 282. Clear? no check_filetype:716: increase inode 32002 badness 31 to 32 for 20028 Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 32 to 33 for 20047 Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) references inode 283 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) has deleted/unused inode 283. Clear? no check_filetype:716: increase inode 32002 badness 33 to 34 for 20028 Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 34 to 35 for 20047 Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) references inode 284 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) has deleted/unused inode 284. Clear? no check_filetype:716: increase inode 32002 badness 35 to 36 for 20028 Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 36 to 37 for 20047 Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) references inode 285 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) has deleted/unused inode 285. Clear? no check_filetype:716: increase inode 32002 badness 37 to 38 for 20028 Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 38 to 39 for 20047 Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) references inode 286 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) has deleted/unused inode 286. Clear? no check_filetype:716: increase inode 32002 badness 39 to 40 for 20028 Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 40 to 41 for 20047 Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) references inode 287 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) has deleted/unused inode 287. Clear? no check_filetype:716: increase inode 32002 badness 41 to 42 for 20028 Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 42 to 43 for 20047 Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) references inode 288 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) has deleted/unused inode 288. Clear? no check_filetype:716: increase inode 32002 badness 43 to 44 for 20028 Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 44 to 45 for 20047 Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) references inode 289 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) has deleted/unused inode 289. Clear? no check_filetype:716: increase inode 32002 badness 45 to 46 for 20028 Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 46 to 47 for 20047 Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) references inode 290 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) has deleted/unused inode 290. Clear? no check_filetype:716: increase inode 32002 badness 47 to 48 for 20028 Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 48 to 49 for 20047 Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) references inode 291 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) has deleted/unused inode 291. Clear? no check_filetype:716: increase inode 32002 badness 49 to 50 for 20028 Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 50 to 51 for 20047 Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) references inode 292 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) has deleted/unused inode 292. Clear? no check_filetype:716: increase inode 32002 badness 51 to 52 for 20028 Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 52 to 53 for 20047 Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) references inode 293 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) has deleted/unused inode 293. Clear? no check_filetype:716: increase inode 32002 badness 53 to 54 for 20028 Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 54 to 55 for 20047 Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) references inode 294 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) has deleted/unused inode 294. Clear? no check_filetype:716: increase inode 32002 badness 55 to 56 for 20028 Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 56 to 57 for 20047 Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) references inode 295 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 295. Clear? no check_filetype:716: increase inode 32002 badness 57 to 58 for 20028 Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 58 to 59 for 20047 Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) references inode 296 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 296. Clear? no check_filetype:716: increase inode 32002 badness 59 to 60 for 20028 Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 60 to 61 for 20047 Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) references inode 297 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 297. Clear? no check_filetype:716: increase inode 32002 badness 61 to 62 for 20028 Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 62 to 63 for 20047 Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) references inode 298 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 298. Clear? no check_filetype:716: increase inode 32002 badness 63 to 64 for 20028 Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 64 to 65 for 20047 Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) references inode 299 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 299. Clear? no check_filetype:716: increase inode 32002 badness 65 to 66 for 20028 Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 66 to 67 for 20047 Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) references inode 300 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 300. Clear? no check_filetype:716: increase inode 32002 badness 67 to 68 for 20028 Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32025 badness 3 to 4 for 20047 Entry '0x10000' in /quota_master/md-0x0 (32025) references inode 348 found in group 0's unused inodes area. Fix? no Entry '0x10000' in /quota_master/md-0x0 (32025) has deleted/unused inode 348. Clear? no check_dir_block:1649: increase inode 32025 badness 4 to 5 for 20047 Entry '0x1010000' in /quota_master/md-0x0 (32025) references inode 346 found in group 0's unused inodes area. Fix? no Entry '0x1010000' in /quota_master/md-0x0 (32025) has deleted/unused inode 346. Clear? no check_dir_block:1649: increase inode 32025 badness 5 to 6 for 20047 Entry '0x2010000' in /quota_master/md-0x0 (32025) references inode 347 found in group 0's unused inodes area. Fix? no Entry '0x2010000' in /quota_master/md-0x0 (32025) has deleted/unused inode 347. Clear? no check_dir_block:1649: increase inode 32026 badness 3 to 4 for 20047 Entry '0x20000' in /quota_master/dt-0x0 (32026) references inode 351 found in group 0's unused inodes area. Fix? no Entry '0x20000' in /quota_master/dt-0x0 (32026) has deleted/unused inode 351. Clear? no check_dir_block:1649: increase inode 32026 badness 4 to 5 for 20047 Entry '0x1020000' in /quota_master/dt-0x0 (32026) references inode 350 found in group 0's unused inodes area. Fix? no Entry '0x1020000' in /quota_master/dt-0x0 (32026) has deleted/unused inode 350. Clear? no check_dir_block:1649: increase inode 32026 badness 5 to 6 for 20047 Entry '0x2020000' in /quota_master/dt-0x0 (32026) references inode 349 found in group 0's unused inodes area. Fix? no Entry '0x2020000' in /quota_master/dt-0x0 (32026) has deleted/unused inode 349. Clear? no check_dir_block:1649: increase inode 32027 badness 3 to 4 for 20047 Entry '0x10000' in /quota_slave (32027) references inode 345 found in group 0's unused inodes area. Fix? no Entry '0x10000' in /quota_slave (32027) has deleted/unused inode 345. Clear? no check_dir_block:1649: increase inode 32027 badness 4 to 5 for 20047 Entry '0x10000-MDT0000' in /quota_slave (32027) references inode 337 found in group 0's unused inodes area. Fix? no Entry '0x10000-MDT0000' in /quota_slave (32027) has deleted/unused inode 337. Clear? no check_dir_block:1649: increase inode 32027 badness 5 to 6 for 20047 Entry '0x1010000' in /quota_slave (32027) references inode 334 found in group 0's unused inodes area. Fix? no Entry '0x1010000' in /quota_slave (32027) has deleted/unused inode 334. Clear? no check_dir_block:1649: increase inode 32027 badness 6 to 7 for 20047 Entry '0x1010000-MDT0000' in /quota_slave (32027) references inode 343 found in group 0's unused inodes area. Fix? no Entry '0x1010000-MDT0000' in /quota_slave (32027) has deleted/unused inode 343. Clear? no check_dir_block:1649: increase inode 32027 badness 7 to 8 for 20047 Entry '0x2010000' in /quota_slave (32027) references inode 344 found in group 0's unused inodes area. Fix? no Entry '0x2010000' in /quota_slave (32027) has deleted/unused inode 344. Clear? no check_dir_block:1649: increase inode 32027 badness 8 to 9 for 20047 Entry '0x2010000-MDT0000' in /quota_slave (32027) references inode 341 found in group 0's unused inodes area. Fix? no Entry '0x2010000-MDT0000' in /quota_slave (32027) has deleted/unused inode 341. Clear? no check_dir_block:1649: increase inode 32027 badness 9 to 10 for 20047 Entry '0x20000' in /quota_slave (32027) references inode 340 found in group 0's unused inodes area. Fix? no Entry '0x20000' in /quota_slave (32027) has deleted/unused inode 340. Clear? no check_dir_block:1649: increase inode 32027 badness 10 to 11 for 20047 Entry '0x20000-MDT0000' in /quota_slave (32027) references inode 339 found in group 0's unused inodes area. Fix? no Entry '0x20000-MDT0000' in /quota_slave (32027) has deleted/unused inode 339. Clear? no check_dir_block:1649: increase inode 32027 badness 11 to 12 for 20047 Entry '0x1020000' in /quota_slave (32027) references inode 338 found in group 0's unused inodes area. Fix? no Entry '0x1020000' in /quota_slave (32027) has deleted/unused inode 338. Clear? no check_dir_block:1649: increase inode 32027 badness 12 to 13 for 20047 Entry '0x1020000-MDT0000' in /quota_slave (32027) references inode 342 found in group 0's unused inodes area. Fix? no Entry '0x1020000-MDT0000' in /quota_slave (32027) has deleted/unused inode 342. Clear? no check_dir_block:1649: increase inode 32027 badness 13 to 14 for 20047 Entry '0x2020000' in /quota_slave (32027) references inode 335 found in group 0's unused inodes area. Fix? no Entry '0x2020000' in /quota_slave (32027) has deleted/unused inode 335. Clear? no check_dir_block:1649: increase inode 32027 badness 14 to 15 for 20047 Entry '0x2020000-MDT0000' in /quota_slave (32027) references inode 336 found in group 0's unused inodes area. Fix? no Entry '0x2020000-MDT0000' in /quota_slave (32027) has deleted/unused inode 336. Clear? no check_dir_block:1649: increase inode 32034 badness 3 to 4 for 20047 Entry 'lfsck_layout_00' in /LFSCK (32034) references inode 321 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_00' in /LFSCK (32034) has deleted/unused inode 321. Clear? no check_filetype:716: increase inode 32034 badness 4 to 5 for 20028 Entry 'lfsck_layout_00' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 5 to 6 for 20047 Entry 'lfsck_layout_01' in /LFSCK (32034) references inode 316 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_01' in /LFSCK (32034) has deleted/unused inode 316. Clear? no check_filetype:716: increase inode 32034 badness 6 to 7 for 20028 Entry 'lfsck_layout_01' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 7 to 8 for 20047 Entry 'lfsck_layout_02' in /LFSCK (32034) references inode 306 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_02' in /LFSCK (32034) has deleted/unused inode 306. Clear? no check_filetype:716: increase inode 32034 badness 8 to 9 for 20028 Entry 'lfsck_layout_02' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 9 to 10 for 20047 Entry 'lfsck_layout_03' in /LFSCK (32034) references inode 322 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_03' in /LFSCK (32034) has deleted/unused inode 322. Clear? no check_filetype:716: increase inode 32034 badness 10 to 11 for 20028 Entry 'lfsck_layout_03' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 11 to 12 for 20047 Entry 'lfsck_layout_04' in /LFSCK (32034) references inode 329 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_04' in /LFSCK (32034) has deleted/unused inode 329. Clear? no check_filetype:716: increase inode 32034 badness 12 to 13 for 20028 Entry 'lfsck_layout_04' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 13 to 14 for 20047 Entry 'lfsck_layout_05' in /LFSCK (32034) references inode 313 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_05' in /LFSCK (32034) has deleted/unused inode 313. Clear? no check_filetype:716: increase inode 32034 badness 14 to 15 for 20028 Entry 'lfsck_layout_05' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 15 to 16 for 20047 Entry 'lfsck_layout_06' in /LFSCK (32034) references inode 319 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_06' in /LFSCK (32034) has deleted/unused inode 319. Clear? no check_filetype:716: increase inode 32034 badness 16 to 17 for 20028 Entry 'lfsck_layout_06' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 17 to 18 for 20047 Entry 'lfsck_layout_07' in /LFSCK (32034) references inode 311 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_07' in /LFSCK (32034) has deleted/unused inode 311. Clear? no check_filetype:716: increase inode 32034 badness 18 to 19 for 20028 Entry 'lfsck_layout_07' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 19 to 20 for 20047 Entry 'lfsck_layout_08' in /LFSCK (32034) references inode 326 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_08' in /LFSCK (32034) has deleted/unused inode 326. Clear? no check_filetype:716: increase inode 32034 badness 20 to 21 for 20028 Entry 'lfsck_layout_08' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 21 to 22 for 20047 Entry 'lfsck_layout_09' in /LFSCK (32034) references inode 325 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_09' in /LFSCK (32034) has deleted/unused inode 325. Clear? no check_filetype:716: increase inode 32034 badness 22 to 23 for 20028 Entry 'lfsck_layout_09' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 23 to 24 for 20047 Entry 'lfsck_layout_10' in /LFSCK (32034) references inode 323 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_10' in /LFSCK (32034) has deleted/unused inode 323. Clear? no check_filetype:716: increase inode 32034 badness 24 to 25 for 20028 Entry 'lfsck_layout_10' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 25 to 26 for 20047 Entry 'lfsck_layout_11' in /LFSCK (32034) references inode 331 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_11' in /LFSCK (32034) has deleted/unused inode 331. Clear? no check_filetype:716: increase inode 32034 badness 26 to 27 for 20028 Entry 'lfsck_layout_11' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 27 to 28 for 20047 Entry 'lfsck_layout_12' in /LFSCK (32034) references inode 324 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_12' in /LFSCK (32034) has deleted/unused inode 324. Clear? no check_filetype:716: increase inode 32034 badness 28 to 29 for 20028 Entry 'lfsck_layout_12' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 29 to 30 for 20047 Entry 'lfsck_layout_13' in /LFSCK (32034) references inode 328 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_13' in /LFSCK (32034) has deleted/unused inode 328. Clear? no check_filetype:716: increase inode 32034 badness 30 to 31 for 20028 Entry 'lfsck_layout_13' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 31 to 32 for 20047 Entry 'lfsck_layout_14' in /LFSCK (32034) references inode 315 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_14' in /LFSCK (32034) has deleted/unused inode 315. Clear? no check_filetype:716: increase inode 32034 badness 32 to 33 for 20028 Entry 'lfsck_layout_14' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 33 to 34 for 20047 Entry 'lfsck_layout_15' in /LFSCK (32034) references inode 304 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_15' in /LFSCK (32034) has deleted/unused inode 304. Clear? no check_filetype:716: increase inode 32034 badness 34 to 35 for 20028 Entry 'lfsck_layout_15' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no Pass 2: Memory used: 416k/0k (137k/280k), time: 0.09/ 0.01/ 0.01 Pass 2: I/O read: 1MB, write: 0MB, rate:oleg301-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) oleg301-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) oleg301-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) pdsh@oleg301-client: oleg301-server: ssh exited with exit code 4 11.46MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 416k/0k (138k/279k), time: 0.13/ 0.01/ 0.01 Pass 3: Memory used: 416k/0k (136k/281k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Unattached inode 82 Connect to /lost+found? no Unattached inode 90 Connect to /lost+found? no Unattached inode 112 Connect to /lost+found? no Unattached inode 119 Connect to /lost+found? no Unattached inode 121 Connect to /lost+found? no Unattached inode 122 Connect to /lost+found? no Unattached inode 123 Connect to /lost+found? no Unattached inode 124 Connect to /lost+found? no Unattached inode 125 Connect to /lost+found? no Unattached inode 126 Connect to /lost+found? no Unattached inode 127 Connect to /lost+found? no Unattached inode 128 Connect to /lost+found? no Unattached inode 129 Connect to /lost+found? no Unattached inode 130 Connect to /lost+found? no Unattached inode 131 Connect to /lost+found? no Unattached inode 132 Connect to /lost+found? no Unattached inode 133 Connect to /lost+found? no Unattached inode 134 Connect to /lost+found? no Unattached inode 135 Connect to /lost+found? no Unattached inode 136 Connect to /lost+found? no Unattached inode 137 Connect to /lost+found? no Unattached inode 139 Connect to /lost+found? no Unattached inode 140 Connect to /lost+found? no Unattached inode 141 Connect to /lost+found? no Unattached inode 142 Connect to /lost+found? no Unattached inode 143 Connect to /lost+found? no Unattached inode 144 Connect to /lost+found? no Unattached inode 145 Connect to /lost+found? no Unattached inode 146 Connect to /lost+found? no Unattached inode 147 Connect to /lost+found? no Unattached inode 148 Connect to /lost+found? no Unattached inode 149 Connect to /lost+found? no Unattached inode 150 Connect to /lost+found? no Unattached inode 151 Connect to /lost+found? no Unattached inode 152 Connect to /lost+found? no Unattached inode 153 Connect to /lost+found? no Unattached inode 154 Connect to /lost+found? no Unattached inode 165 Connect to /lost+found? no Unattached inode 166 Connect to /lost+found? no Pass 4: Memory used: 416k/0k (83k/334k), time: 0.01/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 86.56MB/s Pass 5: Checking group summary information Block bitmap differences: -(22953--22954) Fix? no Pass 5: Memory used: 416k/0k (82k/335k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 89.17MB/s Update quota info for quota type 0? no Update quota info for quota type 1? no Update quota info for quota type 2? no lustre-MDT0000: ********** WARNING: Filesystem still has errors ********** 381 inodes used (0.24%, out of 160000) 2 non-contiguous files (0.5%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 306 44647 blocks used (44.65%, out of 100000) 0 bad blocks 1 large file 250 regular files 121 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 403 files Memory used: 416k/0k (85k/332k), time: 0.16/ 0.02/ 0.01 I/O read: 1MB, write: 0MB, rate: 6.32MB/s sanity-scrub test_17a: @@@@@@ FAIL: e2fsck -d -v -t -t -f -n /dev/vdc -m8 returned 4, should be <= 0 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6751:run_e2fsck() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1304:test_17a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1307:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_17a.*.1767319110.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_17a.debug_log.oleg301-server.1767319110.log.aDfkXJ" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_17a.dmesg.oleg301-server.1767319110.log.9gPL15" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0000 FAIL 17a (40s) == sanity-scrub test 17b: ENOSPC on .. insertion shouldn't leak inodes ========================================================== 20:58:58 (1767319138) fail_loc=0x8000019e lfs mkdir: dirstripe error on '/mnt/lustre/d17b.sanity-scrub': No space left on device lfs setdirstripe: cannot create dir '/mnt/lustre/d17b.sanity-scrub': No space left on device Stopping /mnt/lustre-mds1 (opts:) on oleg301-server e2fsck -d -v -t -t -f -n /dev/vdc -m8 oleg301-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg301-server: Use max possible thread num: 1 instead Warning! /dev/vdc is in use. Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 4], used inodes 381/160000 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 90 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 90 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 95 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 95 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 96 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 96 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 97 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 97 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 98 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 98 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 99 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 99 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 100 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 100 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 101 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 101 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 102 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 102 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 103 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 103 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 104 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 104 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 105 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 105 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 106 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 106 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 107 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 107 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 108 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 108 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 109 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 109 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 110 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 110 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 111 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 111 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 112 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 112 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 119 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 121 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 122 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 132 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 146 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 147 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 148 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 148 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 149 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 149 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 150 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 150 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 153 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 0 to 2 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 32013 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32013 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32024 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32024 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32025 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32025 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32026 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32026 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32027 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32027 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32028 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32028 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32029 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 32030 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32030 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32031 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32031 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32032 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32032 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32033 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32033 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32034 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32034 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32035 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 32036 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 32037 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] Pass 1: Memory used: 304k/0k (184k/121k), time: 0.00/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 244.02MB/s [Thread 0] Scanned group range [0, 4], used inodes 381/383 Pass 2: Checking directory structure Entry 'fld' in / (2) has deleted/unused inode 162. Clear? no Entry 'lfsck_namespace' in / (2) has deleted/unused inode 164. Clear? no check_dir_block:1649: increase inode 13 badness 0 to 1 for 20047 Entry 'nodemap' in /CONFIGS (13) references inode 333 found in group 0's unused inodes area. Fix? no Entry 'nodemap' in /CONFIGS (13) has deleted/unused inode 333. Clear? no check_dir_block:1649: increase inode 32002 badness 0 to 1 for 20047 Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) references inode 267 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) has deleted/unused inode 267. Clear? no check_filetype:716: increase inode 32002 badness 1 to 2 for 20028 Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 2 to 3 for 20047 Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) references inode 268 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) has deleted/unused inode 268. Clear? no check_filetype:716: increase inode 32002 badness 3 to 4 for 20028 Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 4 to 5 for 20047 Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) references inode 269 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) has deleted/unused inode 269. Clear? no check_filetype:716: increase inode 32002 badness 5 to 6 for 20028 Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 6 to 7 for 20047 Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) references inode 270 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) has deleted/unused inode 270. Clear? no check_filetype:716: increase inode 32002 badness 7 to 8 for 20028 Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 8 to 9 for 20047 Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) references inode 271 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) has deleted/unused inode 271. Clear? no check_filetype:716: increase inode 32002 badness 9 to 10 for 20028 Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 10 to 11 for 20047 Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) references inode 272 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) has deleted/unused inode 272. Clear? no check_filetype:716: increase inode 32002 badness 11 to 12 for 20028 Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 12 to 13 for 20047 Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) references inode 273 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) has deleted/unused inode 273. Clear? no check_filetype:716: increase inode 32002 badness 13 to 14 for 20028 Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 14 to 15 for 20047 Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) references inode 274 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) has deleted/unused inode 274. Clear? no check_filetype:716: increase inode 32002 badness 15 to 16 for 20028 Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 16 to 17 for 20047 Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) references inode 275 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) has deleted/unused inode 275. Clear? no check_filetype:716: increase inode 32002 badness 17 to 18 for 20028 Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 18 to 19 for 20047 Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) references inode 276 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) has deleted/unused inode 276. Clear? no check_filetype:716: increase inode 32002 badness 19 to 20 for 20028 Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 20 to 21 for 20047 Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) references inode 277 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) has deleted/unused inode 277. Clear? no check_filetype:716: increase inode 32002 badness 21 to 22 for 20028 Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 22 to 23 for 20047 Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) references inode 278 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) has deleted/unused inode 278. Clear? no check_filetype:716: increase inode 32002 badness 23 to 24 for 20028 Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 24 to 25 for 20047 Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) references inode 279 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) has deleted/unused inode 279. Clear? no check_filetype:716: increase inode 32002 badness 25 to 26 for 20028 Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 26 to 27 for 20047 Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) references inode 280 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) has deleted/unused inode 280. Clear? no check_filetype:716: increase inode 32002 badness 27 to 28 for 20028 Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 28 to 29 for 20047 Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) references inode 281 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) has deleted/unused inode 281. Clear? no check_filetype:716: increase inode 32002 badness 29 to 30 for 20028 Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 30 to 31 for 20047 Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) references inode 282 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) has deleted/unused inode 282. Clear? no check_filetype:716: increase inode 32002 badness 31 to 32 for 20028 Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 32 to 33 for 20047 Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) references inode 283 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) has deleted/unused inode 283. Clear? no check_filetype:716: increase inode 32002 badness 33 to 34 for 20028 Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 34 to 35 for 20047 Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) references inode 284 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) has deleted/unused inode 284. Clear? no check_filetype:716: increase inode 32002 badness 35 to 36 for 20028 Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 36 to 37 for 20047 Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) references inode 285 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) has deleted/unused inode 285. Clear? no check_filetype:716: increase inode 32002 badness 37 to 38 for 20028 Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 38 to 39 for 20047 Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) references inode 286 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) has deleted/unused inode 286. Clear? no check_filetype:716: increase inode 32002 badness 39 to 40 for 20028 Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 40 to 41 for 20047 Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) references inode 287 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) has deleted/unused inode 287. Clear? no check_filetype:716: increase inode 32002 badness 41 to 42 for 20028 Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 42 to 43 for 20047 Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) references inode 288 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) has deleted/unused inode 288. Clear? no check_filetype:716: increase inode 32002 badness 43 to 44 for 20028 Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 44 to 45 for 20047 Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) references inode 289 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) has deleted/unused inode 289. Clear? no check_filetype:716: increase inode 32002 badness 45 to 46 for 20028 Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 46 to 47 for 20047 Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) references inode 290 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) has deleted/unused inode 290. Clear? no check_filetype:716: increase inode 32002 badness 47 to 48 for 20028 Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 48 to 49 for 20047 Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) references inode 291 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) has deleted/unused inode 291. Clear? no check_filetype:716: increase inode 32002 badness 49 to 50 for 20028 Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 50 to 51 for 20047 Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) references inode 292 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) has deleted/unused inode 292. Clear? no check_filetype:716: increase inode 32002 badness 51 to 52 for 20028 Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 52 to 53 for 20047 Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) references inode 293 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) has deleted/unused inode 293. Clear? no check_filetype:716: increase inode 32002 badness 53 to 54 for 20028 Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 54 to 55 for 20047 Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) references inode 294 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) has deleted/unused inode 294. Clear? no check_filetype:716: increase inode 32002 badness 55 to 56 for 20028 Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 56 to 57 for 20047 Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) references inode 295 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 295. Clear? no check_filetype:716: increase inode 32002 badness 57 to 58 for 20028 Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 58 to 59 for 20047 Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) references inode 296 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 296. Clear? no check_filetype:716: increase inode 32002 badness 59 to 60 for 20028 Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 60 to 61 for 20047 Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) references inode 297 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 297. Clear? no check_filetype:716: increase inode 32002 badness 61 to 62 for 20028 Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 62 to 63 for 20047 Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) references inode 298 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 298. Clear? no check_filetype:716: increase inode 32002 badness 63 to 64 for 20028 Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 64 to 65 for 20047 Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) references inode 299 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 299. Clear? no check_filetype:716: increase inode 32002 badness 65 to 66 for 20028 Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 66 to 67 for 20047 Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) references inode 300 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 300. Clear? no check_filetype:716: increase inode 32002 badness 67 to 68 for 20028 Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32025 badness 3 to 4 for 20047 Entry '0x10000' in /quota_master/md-0x0 (32025) references inode 348 found in group 0's unused inodes area. Fix? no Entry '0x10000' in /quota_master/md-0x0 (32025) has deleted/unused inode 348. Clear? no check_dir_block:1649: increase inode 32025 badness 4 to 5 for 20047 Entry '0x1010000' in /quota_master/md-0x0 (32025) references inode 346 found in group 0's unused inodes area. Fix? no Entry '0x1010000' in /quota_master/md-0x0 (32025) has deleted/unused inode 346. Clear? no check_dir_block:1649: increase inode 32025 badness 5 to 6 for 20047 Entry '0x2010000' in /quota_master/md-0x0 (32025) references inode 347 found in group 0's unused inodes area. Fix? no Entry '0x2010000' in /quota_master/md-0x0 (32025) has deleted/unused inode 347. Clear? no check_dir_block:1649: increase inode 32026 badness 3 to 4 for 20047 Entry '0x20000' in /quota_master/dt-0x0 (32026) references inode 351 found in group 0's unused inodes area. Fix? no Entry '0x20000' in /quota_master/dt-0x0 (32026) has deleted/unused inode 351. Clear? no check_dir_block:1649: increase inode 32026 badness 4 to 5 for 20047 Entry '0x1020000' in /quota_master/dt-0x0 (32026) references inode 350 found in group 0's unused inodes area. Fix? no Entry '0x1020000' in /quota_master/dt-0x0 (32026) has deleted/unused inode 350. Clear? no check_dir_block:1649: increase inode 32026 badness 5 to 6 for 20047 Entry '0x2020000' in /quota_master/dt-0x0 (32026) references inode 349 found in group 0's unused inodes area. Fix? no Entry '0x2020000' in /quota_master/dt-0x0 (32026) has deleted/unused inode 349. Clear? no check_dir_block:1649: increase inode 32027 badness 3 to 4 for 20047 Entry '0x10000' in /quota_slave (32027) references inode 345 found in group 0's unused inodes area. Fix? no Entry '0x10000' in /quota_slave (32027) has deleted/unused inode 345. Clear? no check_dir_block:1649: increase inode 32027 badness 4 to 5 for 20047 Entry '0x10000-MDT0000' in /quota_slave (32027) references inode 337 found in group 0's unused inodes area. Fix? no Entry '0x10000-MDT0000' in /quota_slave (32027) has deleted/unused inode 337. Clear? no check_dir_block:1649: increase inode 32027 badness 5 to 6 for 20047 Entry '0x1010000' in /quota_slave (32027) references inode 334 found in group 0's unused inodes area. Fix? no Entry '0x1010000' in /quota_slave (32027) has deleted/unused inode 334. Clear? no check_dir_block:1649: increase inode 32027 badness 6 to 7 for 20047 Entry '0x1010000-MDT0000' in /quota_slave (32027) references inode 343 found in group 0's unused inodes area. Fix? no Entry '0x1010000-MDT0000' in /quota_slave (32027) has deleted/unused inode 343. Clear? no check_dir_block:1649: increase inode 32027 badness 7 to 8 for 20047 Entry '0x2010000' in /quota_slave (32027) references inode 344 found in group 0's unused inodes area. Fix? no Entry '0x2010000' in /quota_slave (32027) has deleted/unused inode 344. Clear? no check_dir_block:1649: increase inode 32027 badness 8 to 9 for 20047 Entry '0x2010000-MDT0000' in /quota_slave (32027) references inode 341 found in group 0's unused inodes area. Fix? no Entry '0x2010000-MDT0000' in /quota_slave (32027) has deleted/unused inode 341. Clear? no check_dir_block:1649: increase inode 32027 badness 9 to 10 for 20047 Entry '0x20000' in /quota_slave (32027) references inode 340 found in group 0's unused inodes area. Fix? no Entry '0x20000' in /quota_slave (32027) has deleted/unused inode 340. Clear? no check_dir_block:1649: increase inode 32027 badness 10 to 11 for 20047 Entry '0x20000-MDT0000' in /quota_slave (32027) references inode 339 found in group 0's unused inodes area. Fix? no Entry '0x20000-MDT0000' in /quota_slave (32027) has deleted/unused inode 339. Clear? no check_dir_block:1649: increase inode 32027 badness 11 to 12 for 20047 Entry '0x1020000' in /quota_slave (32027) references inode 338 found in group 0's unused inodes area. Fix? no Entry '0x1020000' in /quota_slave (32027) has deleted/unused inode 338. Clear? no check_dir_block:1649: increase inode 32027 badness 12 to 13 for 20047 Entry '0x1020000-MDT0000' in /quota_slave (32027) references inode 342 found in group 0's unused inodes area. Fix? no Entry '0x1020000-MDT0000' in /quota_slave (32027) has deleted/unused inode 342. Clear? no check_dir_block:1649: increase inode 32027 badness 13 to 14 for 20047 Entry '0x2020000' in /quota_slave (32027) references inode 335 found in group 0's unused inodes area. Fix? no Entry '0x2020000' in /quota_slave (32027) has deleted/unused inode 335. Clear? no check_dir_block:1649: increase inode 32027 badness 14 to 15 for 20047 Entry '0x2020000-MDT0000' in /quota_slave (32027) references inode 336 found in group 0's unused inodes area. Fix? no Entry '0x2020000-MDT0000' in /quota_slave (32027) has deleted/unused inode 336. Clear? no check_dir_block:1649: increase inode 32034 badness 3 to 4 for 20047 Entry 'lfsck_layout_00' in /LFSCK (32034) references inode 321 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_00' in /LFSCK (32034) has deleted/unused inode 321. Clear? no check_filetype:716: increase inode 32034 badness 4 to 5 for 20028 Entry 'lfsck_layout_00' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 5 to 6 for 20047 Entry 'lfsck_layout_01' in /LFSCK (32034) references inode 316 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_01' in /LFSCK (32034) has deleted/unused inode 316. Clear? no check_filetype:716: increase inode 32034 badness 6 to 7 for 20028 Entry 'lfsck_layout_01' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 7 to 8 for 20047 Entry 'lfsck_layout_02' in /LFSCK (32034) references inode 306 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_02' in /LFSCK (32034) has deleted/unused inode 306. Clear? no check_filetype:716: increase inode 32034 badness 8 to 9 for 20028 Entry 'lfsck_layout_02' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 9 to 10 for 20047 Entry 'lfsck_layout_03' in /LFSCK (32034) references inode 322 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_03' in /LFSCK (32034) has deleted/unused inode 322. Clear? no check_filetype:716: increase inode 32034 badness 10 to 11 for 20028 Entry 'lfsck_layout_03' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 11 to 12 for 20047 Entry 'lfsck_layout_04' in /LFSCK (32034) references inode 329 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_04' in /LFSCK (32034) has deleted/unused inode 329. Clear? no check_filetype:716: increase inode 32034 badness 12 to 13 for 20028 Entry 'lfsck_layout_04' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 13 to 14 for 20047 Entry 'lfsck_layout_05' in /LFSCK (32034) references inode 313 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_05' in /LFSCK (32034) has deleted/unused inode 313. Clear? no check_filetype:716: increase inode 32034 badness 14 to 15 for 20028 Entry 'lfsck_layout_05' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 15 to 16 for 20047 Entry 'lfsck_layout_06' in /LFSCK (32034) references inode 319 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_06' in /LFSCK (32034) has deleted/unused inode 319. Clear? no check_filetype:716: increase inode 32034 badness 16 to 17 for 20028 Entry 'lfsck_layout_06' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 17 to 18 for 20047 Entry 'lfsck_layout_07' in /LFSCK (32034) references inode 311 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_07' in /LFSCK (32034) has deleted/unused inode 311. Clear? no check_filetype:716: increase inode 32034 badness 18 to 19 for 20028 Entry 'lfsck_layout_07' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 19 to 20 for 20047 Entry 'lfsck_layout_08' in /LFSCK (32034) references inode 326 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_08' in /LFSCK (32034) has deleted/unused inode 326. Clear? no check_filetype:716: increase inode 32034 badness 20 to 21 for 20028 Entry 'lfsck_layout_08' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 21 to 22 for 20047 Entry 'lfsck_layout_09' in /LFSCK (32034) references inode 325 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_09' in /LFSCK (32034) has deleted/unused inode 325. Clear? no check_filetype:716: increase inode 32034 badness 22 to 23 for 20028 Entry 'lfsck_layout_09' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 23 to 24 for 20047 Entry 'lfsck_layout_10' in /LFSCK (32034) references inode 323 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_10' in /LFSCK (32034) has deleted/unused inode 323. Clear? no check_filetype:716: increase inode 32034 badness 24 to 25 for 20028 Entry 'lfsck_layout_10' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 25 to 26 for 20047 Entry 'lfsck_layout_11' in /LFSCK (32034) references inode 331 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_11' in /LFSCK (32034) has deleted/unused inode 331. Clear? no check_filetype:716: increase inode 32034 badness 26 to 27 for 20028 Entry 'lfsck_layout_11' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 27 to 28 for 20047 Entry 'lfsck_layout_12' in /LFSCK (32034) references inode 324 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_12' in /LFSCK (32034) has deleted/unused inode 324. Clear? no check_filetype:716: increase inode 32034 badness 28 to 29 for 20028 Entry 'lfsck_layout_12' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 29 to 30 for 20047 Entry 'lfsck_layout_13' in /LFSCK (32034) references inode 328 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_13' in /LFSCK (32034) has deleted/unused inode 328. Clear? no check_filetype:716: increase inode 32034 badness 30 to 31 for 20028 Entry 'lfsck_layout_13' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 31 to 32 for 20047 Entry 'lfsck_layout_14' in /LFSCK (32034) references inode 315 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_14' in /LFSCK (32034) has deleted/unused inode 315. Clear? no check_filetype:716: increase inode 32034 badness 32 to 33 for 20028 Entry 'lfsck_layout_14' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 33 to 34 for 20047 Entry 'lfsck_layout_15' in /LFSCK (32034) references inode 304 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_15' in /LFSCK (32034) has deleted/unused inode 304. Clear? no check_filetype:716: increase inode 32034 badness 34 to 35 for 20028 Entry 'lfsck_layout_15' in /LFSCK (32034) has an incorrect filetype (was 1, should be 0). Fix? no Pass 2: Memory used: 416k/0k (137k/280k), time: 0.09/ 0.01/ 0.01 Pass 2: I/O read: 1MB, write: 0MB, rateoleg301-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) oleg301-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) oleg301-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) pdsh@oleg301-client: oleg301-server: ssh exited with exit code 4 : 10.75MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 416k/0k (138k/279k), time: 0.12/ 0.01/ 0.01 Pass 3: Memory used: 416k/0k (136k/281k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Unattached inode 82 Connect to /lost+found? no Unattached inode 90 Connect to /lost+found? no Unattached inode 112 Connect to /lost+found? no Unattached inode 119 Connect to /lost+found? no Unattached inode 121 Connect to /lost+found? no Unattached inode 122 Connect to /lost+found? no Unattached inode 123 Connect to /lost+found? no Unattached inode 124 Connect to /lost+found? no Unattached inode 125 Connect to /lost+found? no Unattached inode 126 Connect to /lost+found? no Unattached inode 127 Connect to /lost+found? no Unattached inode 128 Connect to /lost+found? no Unattached inode 129 Connect to /lost+found? no Unattached inode 130 Connect to /lost+found? no Unattached inode 131 Connect to /lost+found? no Unattached inode 132 Connect to /lost+found? no Unattached inode 133 Connect to /lost+found? no Unattached inode 134 Connect to /lost+found? no Unattached inode 135 Connect to /lost+found? no Unattached inode 136 Connect to /lost+found? no Unattached inode 137 Connect to /lost+found? no Unattached inode 139 Connect to /lost+found? no Unattached inode 140 Connect to /lost+found? no Unattached inode 141 Connect to /lost+found? no Unattached inode 142 Connect to /lost+found? no Unattached inode 143 Connect to /lost+found? no Unattached inode 144 Connect to /lost+found? no Unattached inode 145 Connect to /lost+found? no Unattached inode 146 Connect to /lost+found? no Unattached inode 147 Connect to /lost+found? no Unattached inode 148 Connect to /lost+found? no Unattached inode 149 Connect to /lost+found? no Unattached inode 150 Connect to /lost+found? no Unattached inode 151 Connect to /lost+found? no Unattached inode 152 Connect to /lost+found? no Unattached inode 153 Connect to /lost+found? no Unattached inode 154 Connect to /lost+found? no Unattached inode 165 Connect to /lost+found? no Unattached inode 166 Connect to /lost+found? no Pass 4: Memory used: 416k/0k (83k/334k), time: 0.02/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 50.92MB/s Pass 5: Checking group summary information Block bitmap differences: -(22953--22954) Fix? no Pass 5: Memory used: 416k/0k (82k/335k), time: 0.02/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 43.63MB/s Update quota info for quota type 0? no Update quota info for quota type 1? no Update quota info for quota type 2? no lustre-MDT0000: ********** WARNING: Filesystem still has errors ********** 381 inodes used (0.24%, out of 160000) 2 non-contiguous files (0.5%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 306 44647 blocks used (44.65%, out of 100000) 0 bad blocks 1 large file 250 regular files 121 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 403 files Memory used: 416k/0k (85k/332k), time: 0.16/ 0.02/ 0.01 I/O read: 1MB, write: 0MB, rate: 6.27MB/s sanity-scrub test_17b: @@@@@@ FAIL: e2fsck -d -v -t -t -f -n /dev/vdc -m8 returned 4, should be <= 0 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6751:run_e2fsck() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1319:test_17b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1322:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_17b.*.1767319151.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_17b.debug_log.oleg301-server.1767319151.log.CUKpfc" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_17b.dmesg.oleg301-server.1767319151.log.sbasHq" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0000 FAIL 17b (43s) == sanity-scrub test 18: test mount -o resetoi to recreate OI files ========================================================== 20:59:41 (1767319181) preparing... Thu Jan 1 20:59:46 EST 2026 creating 10 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d18.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0350125 s, 29.9 MB/s creating 10 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d18.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0389183 s, 26.9 MB/s prepared Thu Jan 1 20:59:56 EST 2026. stop mds1 stop mds2 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 [ 4489.501699] Lustre: lustre-MDT0000: reset Object Index mappings Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre PASS 18 (151s) == sanity-scrub test 19: LFSCK can fix multiple linked files on OST ========================================================== 21:02:12 (1767319332) total: 64 open/close in 0.87 seconds: 73.43 ops/second stopall link /mnt/lustre-ost1/O/2c0000400/d2/291 to /mnt/lustre-ost1/O/2c0000400/d2/122 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started LFSCK on the device lustre-OST0000: scrub Stopping /mnt/lustre-ost1 (opts:) on oleg301-server File: /mnt/lustre-ost1/O/2c0000400/d2/122 Size: 0 Blocks: 0 IO Block: 4096 regular empty file Device: fc03h/64515d Inode: 186 Links: 1 Access: (7666/-rwSrwSrwT) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.000000000 -0500 Modify: 1969-12-31 19:00:00.000000000 -0500 Change: 2026-01-01 21:02:45.648000000 -0500 Birth: 2026-01-01 21:02:03.510000000 -0500 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 PASS 19 (193s) == sanity-scrub test 20: Don't trigger OI scrub for irreparable oi repeatedly ========================================================== 21:05:25 (1767319525) Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0000 Started lustre-MDT0001 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg301-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 seq.cli-lustre-OST0001-super.width=65536 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-OST0001 /mnt/lustre-ost2: 114.2 MiB (119697408 bytes) trimmed Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001d0028800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001d0028800.idle_timeout=debug disable quota as required fail_loc=0x193 Stopping /mnt/lustre-mds1 (opts:) on oleg301-server Start mds1: mount -t lustre -o localrecov -o user_xattr,noscrub /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0000 fail_loc=0x19f stat: cannot statx '/mnt/lustre/d20.sanity-scrub': Stale file handle OI scrub was triggerred 2 seconds ago stat: cannot statx '/mnt/lustre/d20.sanity-scrub': Stale file handle OI scrub was triggerred 8 seconds ago PASS 20 (215s) == sanity-scrub test 21: don't hang MDS recovery when failed to get update log ========================================================== 21:09:00 (1767319740) /dev/vdc Stopping /mnt/lustre-mds1 (opts:) on oleg301-server Stopping /mnt/lustre-mds2 (opts:) on oleg301-server oleg301-server: mount: /tmp/d21.sanity-scrub: /dev/vdc already mounted or mount point busy. oleg301-server: umount: /tmp/d21.sanity-scrub: not mounted. Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0000 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started lustre-MDT0001 affected facets: mds2 oleg301-server: oleg301-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 200 oleg301-server: *.lustre-MDT0001.recovery_status status: COMPLETE PASS 21 (77s) == sanity-scrub test 22: LFSCK can recreate or fix the LASTID on MDT/OST ========================================================== 21:10:17 (1767319817) Stopping clients: oleg301-client.virtnet /mnt/lustre (opts:) Stopping clients: oleg301-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg301-client.virtnet /mnt/lustre opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg301-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg301-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg301-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg301-server debug=-1 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Stopping /mnt/lustre-mds1 (opts:) on oleg301-server File: /mnt/lustre-mds1/O/1/LAST_ID Size: 8 Blocks: 8 IO Block: 4096 regular file Device: fc01h/64513d Inode: 82 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.1073741822 -0500 Modify: 1969-12-31 19:00:00.1073741822 -0500 Change: 1969-12-31 19:00:00.1073741822 -0500 Birth: 2026-01-01 21:11:04.065000000 -0500 File: /mnt/lustre-mds1/O/10/LAST_ID Size: 8 Blocks: 8 IO Block: 4096 regular file Device: fc01h/64513d Inode: 83 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.1073741822 -0500 Modify: 1969-12-31 19:00:00.1073741822 -0500 Change: 1969-12-31 19:00:00.1073741822 -0500 Birth: 2026-01-01 21:11:04.067000000 -0500 File: /mnt/lustre-mds1/O/200000003/LAST_ID Size: 8 Blocks: 8 IO Block: 4096 regular file Device: fc01h/64513d Inode: 81 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.1073741822 -0500 Modify: 1969-12-31 19:00:00.1073741822 -0500 Change: 1969-12-31 19:00:00.1073741822 -0500 Birth: 2026-01-01 20:52:08.251000000 -0500 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 PASS 22 (100s) === sanity-scrub: start setup 21:11:57 (1767319917) === Stopping clients: oleg301-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg301-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg301-server oleg301-server: oleg301-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format ost1: /dev/vde Format mds2: /dev/vdd Format mds1: /dev/vdc Format ost2: /dev/vdf pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Checking servers environments Checking clients oleg301-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg301-server' oleg301-server: oleg301-server.virtnet: executing load_modules_local oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg301-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg301-server: Loading modules from /home/green/git/lustre-release/lustre oleg301-server: detected 4 online CPUs by sysfs oleg301-server: MODOPTS_LIBCFS= oleg301-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Commit the device label on /dev/vdc pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Commit the device label on /dev/vdd Started lustre-MDT0000 Started lustre-MDT0001 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Commit the device label on /dev/vde pdsh@oleg301-client: oleg301-server: ssh exited with exit code 1 Commit the device label on /dev/vdf Started lustre-OST0000 Started lustre-OST0001 /mnt/lustre-ost2: 0 B (0 bytes) trimmed /mnt/lustre-ost1: 0 B (0 bytes) trimmed Starting client: oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Starting client oleg301-client.virtnet: -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre Started clients oleg301-client.virtnet: 192.168.203.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9001cb914800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9001cb914800.idle_timeout=debug disable quota as required osd-ldiskfs.track_declares_assert=1 === sanity-scrub: finish setup 21:17:12 (1767320232) === == sanity-scrub test complete, duration 5170 sec ========= 21:17:14 (1767320234) sanity-scrub: FAIL: test_1b (1) Failed to remove OI . on mds1 sanity-scrub: FAIL: test_1c Fail to cleanup the env! sanity-scrub: FAIL: test_2 Fail to cleanup the env! sanity-scrub: FAIL: test_4a Fail to cleanup the env! sanity-scrub: FAIL: test_4b Fail to cleanup the env! sanity-scrub: FAIL: test_4c Fail to cleanup the env! sanity-scrub: FAIL: test_4d Fail to cleanup the env! sanity-scrub: FAIL: test_4e Fail to cleanup the env! sanity-scrub: FAIL: test_5 Backup/restore on mds1 failed sanity-scrub: FAIL: test_6 Backup/restore on mds1 failed sanity-scrub: FAIL: test_7 Backup/restore on mds1 failed sanity-scrub: FAIL: test_8 Backup/restore on mds1 failed sanity-scrub: FAIL: test_9 Backup/restore on mds1 failed sanity-scrub: FAIL: test_10a Backup/restore on mds1 failed sanity-scrub: FAIL: test_11 (3) Failed to start OI scrub on mds1 sanity-scrub: FAIL: test_14 e2fsck -d -v -t -t -f -y /dev/vde -m8 returned 8, should be <= 4 sanity-scrub: FAIL: test_15 Backup/restore on mds1 failed sanity-scrub: FAIL: test_17a e2fsck -d -v -t -t -f -n /dev/vdc -m8 returned 4, should be <= 0 sanity-scrub: FAIL: test_17b e2fsck -d -v -t -t -f -n /dev/vdc -m8 returned 4, should be <= 0 === sanity-scrub: start cleanup 21:17:16 (1767320236) === === sanity-scrub: finish cleanup 21:17:20 (1767320240) ===