-----============= acceptance-small: sanity-scrub ============----- Thu Jan 1 19:50:08 EST 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg225-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-scrub.*ex': No such file or directory excepting tests: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions client=34668548 MDS=34668548 OSS=34668548 Stopping clients: oleg225-client.virtnet /mnt/lustre2 (opts:) Stopping clients: oleg225-client.virtnet /mnt/lustre (opts:) Stopping client oleg225-client.virtnet /mnt/lustre opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg225-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg225-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg225-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg225-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing unload_modules_local oleg225-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. === sanity-scrub: start setup 19:52:36 (1767315156) === Stopping clients: oleg225-client.virtnet /mnt/lustre2 (opts:-f) Stopping clients: oleg225-client.virtnet /mnt/lustre (opts:-f) pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 2 oleg225-server: oleg225-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions oleg225-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg225-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format ost1: /dev/vde Format mds1: /dev/vdc Format mds2: /dev/vdd Format ost2: /dev/vdf pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Commit the device label on /dev/vdd pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Commit the device label on /dev/vdc Started lustre-MDT0001 Started lustre-MDT0000 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0001-super.width=65536 seq.cli-lustre-OST0000-super.width=65536 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Commit the device label on /dev/vdf pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Commit the device label on /dev/vde Started lustre-OST0001 Started lustre-OST0000 /mnt/lustre-ost2: 0 B (0 bytes) trimmed /mnt/lustre-ost1: 0 B (0 bytes) trimmed Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c76d1800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c76d1800.idle_timeout=debug setting jobstats to procname_uid Setting lustre.sys.jobid_var from disable to procname_uid Waiting 90s for 'procname_uid' Updated after 4s: want 'procname_uid' got 'procname_uid' disable quota as required osd-ldiskfs.track_declares_assert=1 === sanity-scrub: finish setup 19:58:22 (1767315502) === == sanity-scrub test 0: Do not auto trigger OI scrub for non-backup/restore case ========================================================== 19:58:23 (1767315503) preparing... Thu Jan 1 19:58:25 EST 2026 creating 0 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d0.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0630858 s, 16.6 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d0.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316701 s, 33.1 MB/s prepared Thu Jan 1 19:58:35 EST 2026. stop mds1 stop mds2 starting MDTs without disabling OI scrub oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre PASS 0 (92s) == sanity-scrub test 1a: Auto trigger initial OI scrub when server mounts ========================================================== 19:59:55 (1767315595) preparing... Thu Jan 1 19:59:59 EST 2026 creating 0 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d1a.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162293 s, 64.6 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d1a.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0495052 s, 21.2 MB/s prepared Thu Jan 1 20:00:06 EST 2026. stop mds1 stop mds2 start mds1 without disabling OI scrub: -o localrecov -o user_xattr oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre fail_loc=0x193 fail_loc=0 192.168.202.125@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg225-client.virtnet /mnt/lustre (opts:) stop mds1 start mds1 with disabling OI scrub: -o localrecov -o user_xattr,noscrub oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 PASS 1a (119s) == sanity-scrub test 1b: Trigger OI scrub when MDT mounts for OI files remove/recreate case ========================================================== 20:01:54 (1767315714) Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c7c44000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c7c44000.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:04:27 EST 2026 creating 0 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d1b.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0379016 s, 27.7 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d1b.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0469921 s, 22.3 MB/s prepared Thu Jan 1 20:04:37 EST 2026. fail_loc=0x198 fail_loc=0 stop mds1 stop mds2 removing OI files on mds1: idx= oleg225-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg225-client: oleg225-server: ssh exited with exit code 32 sanity-scrub test_1b: @@@@@@ FAIL: (1) Failed to remove OI . on mds1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:304:scrub_remove_ois() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:168:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:383:test_1b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:392:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_1b.*.1767315905.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_1b.debug_log.oleg225-server.1767315905.log.O8ueQV" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_1b.dmesg.oleg225-server.1767315905.log.XjhOVO" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1b (198s) == sanity-scrub test 1c: Auto detect kinds of OI file(s) removed/recreated cases ========================================================== 20:05:12 (1767315912) Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0000 Started lustre-MDT0001 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c6cdc800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c6cdc800.idle_timeout=debug disable quota as required rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_1c: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:97:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:405:test_1c() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:415:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_1c.*.1767316095.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_1c.debug_log.oleg225-server.1767316095.log.5UaCyA" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_1c.dmesg.oleg225-server.1767316095.log.xIiUD1" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1c (187s) == sanity-scrub test 2: Trigger OI scrub when MDT mounts for backup/restore case ========================================================== 20:08:19 (1767316099) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_2: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:97:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:421:test_2() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:428:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_2.*.1767316103.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_2.debug_log.oleg225-server.1767316103.log.VExF0E" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_2.dmesg.oleg225-server.1767316103.log.2BybgL" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 2 (7s) == sanity-scrub test 4a: Auto trigger OI scrub if bad OI mapping was found (1) ========================================================== 20:08:27 (1767316107) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_4a: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:97:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:445:test_4a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:476:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_4a.*.1767316110.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_4a.debug_log.oleg225-server.1767316110.log.lwVlBy" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_4a.dmesg.oleg225-server.1767316110.log.UhYoXF" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4a (7s) == sanity-scrub test 4b: Auto trigger OI scrub if bad OI mapping was found (2) ========================================================== 20:08:34 (1767316114) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_4b: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:97:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:482:test_4b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:563:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_4b.*.1767316118.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_4b.debug_log.oleg225-server.1767316118.log.RqAJyW" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_4b.dmesg.oleg225-server.1767316118.log.nSj0F4" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4b (7s) == sanity-scrub test 4c: Auto trigger OI scrub if bad OI mapping was found (3) ========================================================== 20:08:41 (1767316121) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_4c: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:97:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:569:test_4c() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:650:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_4c.*.1767316126.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_4c.debug_log.oleg225-server.1767316126.log.xdtaIX" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_4c.dmesg.oleg225-server.1767316126.log.zl3OS0" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4c (8s) == sanity-scrub test 4d: FID in LMA mismatch with object FID won't block create ========================================================== 20:08:50 (1767316130) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_4d: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:656:test_4d() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:673:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_4d.*.1767316133.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_4d.debug_log.oleg225-server.1767316133.log.0y070g" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_4d.dmesg.oleg225-server.1767316133.log.0E20g7" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4d (7s) == sanity-scrub test 4e: FID reuse can be fixed ========== 20:08:57 (1767316137) rm: cannot remove '/mnt/lustre/d1b.sanity-scrub/mds2': Directory not empty sanity-scrub test_4e: @@@@@@ FAIL: Fail to cleanup the env! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:10575:check_mount_and_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:678:test_4e() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:702:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_4e.*.1767316140.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_4e.debug_log.oleg225-server.1767316140.log.XdyjS1" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_4e.dmesg.oleg225-server.1767316140.log.5JvghH" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4e (5s) == sanity-scrub test 5: OI scrub state machine =========== 20:09:03 (1767316143) oleg225-server: oleg225-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Using TIMEOUT=20 preparing... Thu Jan 1 20:13:58 EST 2026 creating 100 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d5.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314769 s, 33.3 MB/s creating 100 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d5.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0621169 s, 16.9 MB/s prepared Thu Jan 1 20:14:08 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg225-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg225-client: oleg225-server: ssh exited with exit code 32 sanity-scrub test_5: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:709:test_5() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:771:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_5.*.1767316470.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_5.debug_log.oleg225-server.1767316470.log.VxkYaE" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_5.dmesg.oleg225-server.1767316470.log.vzGc6i" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 5 (332s) == sanity-scrub test 6: OI scrub resumes from last checkpoint ========================================================== 20:14:35 (1767316475) Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0001 Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c7c44000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c7c44000.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:17:10 EST 2026 creating 100 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d6.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0459677 s, 22.8 MB/s creating 100 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d6.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307832 s, 34.1 MB/s prepared Thu Jan 1 20:17:20 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg225-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg225-client: oleg225-server: ssh exited with exit code 32 sanity-scrub test_6: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:774:test_6() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:846:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_6.*.1767316662.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_6.debug_log.oleg225-server.1767316662.log.j66y9x" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_6.dmesg.oleg225-server.1767316662.log.bmlclu" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 6 (193s) == sanity-scrub test 7: System is available during OI scrub scanning ========================================================== 20:17:48 (1767316668) Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0001 Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c578d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c578d800.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:20:18 EST 2026 creating 500 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d7.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0691977 s, 15.2 MB/s creating 500 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d7.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222783 s, 47.1 MB/s prepared Thu Jan 1 20:20:37 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg225-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg225-client: oleg225-server: ssh exited with exit code 32 sanity-scrub test_7: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:849:test_7() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:882:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_7.*.1767316860.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_7.debug_log.oleg225-server.1767316860.log.5GJNRr" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_7.dmesg.oleg225-server.1767316860.log.lw8lRK" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 7 (197s) == sanity-scrub test 8: Control OI scrub manually ======== 20:21:05 (1767316865) Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0001 Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c578e000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c578e000.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:23:47 EST 2026 creating 128 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d8.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270892 s, 38.7 MB/s creating 128 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d8.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0487495 s, 21.5 MB/s prepared Thu Jan 1 20:24:03 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg225-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg225-client: oleg225-server: ssh exited with exit code 32 sanity-scrub test_8: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:885:test_8() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:907:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_8.*.1767317069.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_8.debug_log.oleg225-server.1767317069.log.ajNyXV" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_8.dmesg.oleg225-server.1767317069.log.vwkdnS" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 8 (210s) == sanity-scrub test 9: OI scrub speed control =========== 20:24:35 (1767317075) Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0001 Started lustre-MDT0000 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c5f08000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c5f08000.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:27:01 EST 2026 creating 6000 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d9.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0488899 s, 21.4 MB/s creating 6000 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d9.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291827 s, 35.9 MB/s prepared Thu Jan 1 20:28:35 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg225-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg225-client: oleg225-server: ssh exited with exit code 32 sanity-scrub test_9: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:918:test_9() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:991:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_9.*.1767317338.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_9.debug_log.oleg225-server.1767317338.log.Gbq7Ed" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_9.dmesg.oleg225-server.1767317338.log.F4vyhb" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 9 (268s) == sanity-scrub test 10a: non-stopped OI scrub should auto restarts after MDS remount (1) ========================================================== 20:29:03 (1767317343) Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0001 Started lustre-MDT0000 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c892a000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c892a000.idle_timeout=debug disable quota as required preparing... Thu Jan 1 20:33:30 EST 2026 creating 0 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d10a.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272696 s, 38.5 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d10a.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0418429 s, 25.1 MB/s prepared Thu Jan 1 20:33:39 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg225-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg225-client: oleg225-server: ssh exited with exit code 32 sanity-scrub test_10a: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:994:test_10a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1024:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_10a.*.1767317644.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_10a.debug_log.oleg225-server.1767317644.log.1NVyS3" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_10a.dmesg.oleg225-server.1767317644.log.qettre" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 10a (307s) == sanity-scrub test 11: OI scrub skips the new created objects only once ========================================================== 20:34:10 (1767317650) Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0000 Started lustre-MDT0001 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c76d7800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c76d7800.idle_timeout=debug disable quota as required striped dir -i0 -c1 -H all_char /mnt/lustre/d11.sanity-scrub/mds1 total: 100 open/close in 1.47 seconds: 68.11 ops/second striped dir -i1 -c1 -H all_char /mnt/lustre/d11.sanity-scrub/mds2 total: 100 open/close in 1.37 seconds: 73.01 ops/second oleg225-server: Fail to start LFSCK: Invalid argument pdsh@oleg225-client: oleg225-server: ssh exited with exit code 22 sanity-scrub test_11: @@@@@@ FAIL: (3) Failed to start OI scrub on mds1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:61:scrub_start() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1074:test_11() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1108:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_11.*.1767317810.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_11.debug_log.oleg225-server.1767317810.log.II7Ce8" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_11.dmesg.oleg225-server.1767317810.log.KdoV9G" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 11 (164s) == sanity-scrub test 12: OI scrub can rebuild invalid /O entries ========================================================== 20:36:54 (1767317814) fail_loc=0x195 - precreated_ost_obj_count lustre-OST0000-osc-MDT0000 prealloc_last_id: 481 prealloc_next_id: 436 count: 46 total: 78 open/close in 1.13 seconds: 69.13 ops/second 192.168.202.125@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg225-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg225-server fail_loc=0x233 Start ost1: mount -t lustre -o localrecov -o user_xattr,noscrub /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-OST0000 /mnt/lustre-ost1: 116.2 MiB (121794560 bytes) trimmed Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started LFSCK on the device lustre-OST0000: scrub fail_loc=0 PASS 12 (223s) == sanity-scrub test 13: OI scrub can rebuild missed /O entries ========================================================== 20:40:37 (1767318037) fail_loc=0x196 - precreated_ost_obj_count lustre-OST0000-osc-MDT0000 prealloc_last_id: 545 prealloc_next_id: 514 count: 32 total: 64 open/close in 0.97 seconds: 65.87 ops/second fail_loc=0 192.168.202.125@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg225-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg225-server Start ost1: mount -t lustre -o localrecov -o user_xattr,noscrub /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-OST0000 /mnt/lustre-ost1: 0 B (0 bytes) trimmed Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started LFSCK on the device lustre-OST0000: scrub PASS 13 (221s) == sanity-scrub test 14: OI scrub can repair OST objects under lost+found ========================================================== 20:44:18 (1767318258) fail_loc=0x196 - precreated_ost_obj_count lustre-OST0000-osc-MDT0000 prealloc_last_id: 609 prealloc_next_id: 578 count: 32 - open/close 901 (time 1767318275.93 total 10.00 last 90.07) total: 1032 open/close in 12.10 seconds: 85.31 ops/second fail_loc=0 192.168.202.125@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg225-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg225-server run e2fsck e2fsck -d -v -t -t -f -y /dev/vde -m8 oleg225-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg225-server: e2fsck: Cannot continue, aborting. oleg225-server: oleg225-server: pdsh@oleg225-client: oleg225-server: ssh exited with exit code 8 /dev/vde is in use. sanity-scrub test_14: @@@@@@ FAIL: e2fsck -d -v -t -t -f -y /dev/vde -m8 returned 8, should be <= 4 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6751:run_e2fsck() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1200:test_14() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1221:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_14.*.1767318291.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_14.debug_log.oleg225-server.1767318291.log.GkpphP" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_14.dmesg.oleg225-server.1767318291.log.9Kuj8y" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 14 (38s) == sanity-scrub test 15: Dryrun mode OI scrub ============ 20:44:56 (1767318296) oleg225-server: oleg225-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Using TIMEOUT=20 preparing... Thu Jan 1 20:49:49 EST 2026 creating 20 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d15.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0381026 s, 27.5 MB/s creating 20 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d15.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263113 s, 39.9 MB/s prepared Thu Jan 1 20:49:57 EST 2026. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/vdc oleg225-server: mount: /mnt/lustre-brpt: /dev/vdc already mounted or mount point busy. pdsh@oleg225-client: oleg225-server: ssh exited with exit code 32 sanity-scrub test_15: @@@@@@ FAIL: Backup/restore on mds1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:165:scrub_prep() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1229:test_15() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1274:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_15.*.1767318622.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_15.debug_log.oleg225-server.1767318622.log.X8MW6j" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_15.dmesg.oleg225-server.1767318622.log.9IvoC5" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 15 (332s) == sanity-scrub test 16: Initial OI scrub can rebuild crashed index objects ========================================================== 20:50:28 (1767318628) Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0001 Started lustre-MDT0000 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c578b000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c578b000.idle_timeout=debug disable quota as required fail_loc=0x199 preparing... Thu Jan 1 20:53:00 EST 2026 creating 0 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d16.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.040759 s, 25.7 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d16.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0601368 s, 17.4 MB/s prepared Thu Jan 1 20:53:08 EST 2026. stop mds1 stop mds2 fail_loc=0 starting MDTs without disabling OI scrub oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre PASS 16 (231s) == sanity-scrub test 17a: ENOSPC on OI insert shouldn't leak inodes ========================================================== 20:54:19 (1767318859) fail_loc=0x8000019d mkdir: cannot create directory '/mnt/lustre/d17a.sanity-scrub': No space left on device Stopping /mnt/lustre-mds1 (opts:) on oleg225-server e2fsck -d -v -t -t -f -n /dev/vdc -m8 oleg225-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg225-server: Use max possible thread num: 1 instead Warning! /dev/vdc is in use. Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 4], used inodes 381/160000 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 88 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 88 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 93 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 93 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 94 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 94 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 95 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 95 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 96 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 96 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 97 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 97 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 98 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 98 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 100 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 100 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 101 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 101 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 102 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 102 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 103 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 103 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 104 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 104 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 105 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 105 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 106 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 106 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 107 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 107 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 108 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 108 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 109 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 109 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 110 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 110 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 111 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 111 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 120 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 121 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 122 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 132 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 146 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 147 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 148 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 148 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 149 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 149 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 150 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 150 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 153 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 0 to 2 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 32020 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32020 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32033 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32033 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32034 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32034 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32035 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32035 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32036 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32036 badness 1 to 3 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 64031 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 64031 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 64032 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 64033 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 64033 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 64034 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 64034 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 64035 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 64035 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 64036 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 64036 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 64037 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 64038 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 64039 badness 0 to 1 for 1005c [Thread 0] group 2 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 96031 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 96031 badness 1 to 3 for 10084 [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] Pass 1: Memory used: 304k/0k (184k/121k), time: 0.02/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 66.44MB/s [Thread 0] Scanned group range [0, 4], used inodes 381/383 Pass 2: Checking directory structure Entry 'fld' in / (2) has deleted/unused inode 164. Clear? no Entry 'lfsck_namespace' in / (2) has deleted/unused inode 162. Clear? no check_dir_block:1649: increase inode 13 badness 0 to 1 for 20047 Entry 'nodemap' in /CONFIGS (13) references inode 345 found in group 0's unused inodes area. Fix? no Entry 'nodemap' in /CONFIGS (13) has deleted/unused inode 345. Clear? no check_dir_block:1649: increase inode 32002 badness 0 to 1 for 20047 Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) references inode 267 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) has deleted/unused inode 267. Clear? no check_filetype:716: increase inode 32002 badness 1 to 2 for 20028 Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 2 to 3 for 20047 Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) references inode 268 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) has deleted/unused inode 268. Clear? no check_filetype:716: increase inode 32002 badness 3 to 4 for 20028 Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 4 to 5 for 20047 Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) references inode 269 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) has deleted/unused inode 269. Clear? no check_filetype:716: increase inode 32002 badness 5 to 6 for 20028 Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 6 to 7 for 20047 Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) references inode 270 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) has deleted/unused inode 270. Clear? no check_filetype:716: increase inode 32002 badness 7 to 8 for 20028 Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 8 to 9 for 20047 Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) references inode 271 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) has deleted/unused inode 271. Clear? no check_filetype:716: increase inode 32002 badness 9 to 10 for 20028 Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 10 to 11 for 20047 Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) references inode 272 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) has deleted/unused inode 272. Clear? no check_filetype:716: increase inode 32002 badness 11 to 12 for 20028 Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 12 to 13 for 20047 Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) references inode 273 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) has deleted/unused inode 273. Clear? no check_filetype:716: increase inode 32002 badness 13 to 14 for 20028 Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 14 to 15 for 20047 Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) references inode 274 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) has deleted/unused inode 274. Clear? no check_filetype:716: increase inode 32002 badness 15 to 16 for 20028 Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 16 to 17 for 20047 Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) references inode 275 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) has deleted/unused inode 275. Clear? no check_filetype:716: increase inode 32002 badness 17 to 18 for 20028 Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 18 to 19 for 20047 Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) references inode 276 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) has deleted/unused inode 276. Clear? no check_filetype:716: increase inode 32002 badness 19 to 20 for 20028 Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 20 to 21 for 20047 Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) references inode 277 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) has deleted/unused inode 277. Clear? no check_filetype:716: increase inode 32002 badness 21 to 22 for 20028 Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 22 to 23 for 20047 Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) references inode 278 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) has deleted/unused inode 278. Clear? no check_filetype:716: increase inode 32002 badness 23 to 24 for 20028 Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 24 to 25 for 20047 Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) references inode 279 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) has deleted/unused inode 279. Clear? no check_filetype:716: increase inode 32002 badness 25 to 26 for 20028 Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 26 to 27 for 20047 Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) references inode 280 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) has deleted/unused inode 280. Clear? no check_filetype:716: increase inode 32002 badness 27 to 28 for 20028 Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 28 to 29 for 20047 Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) references inode 281 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) has deleted/unused inode 281. Clear? no check_filetype:716: increase inode 32002 badness 29 to 30 for 20028 Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 30 to 31 for 20047 Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) references inode 282 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) has deleted/unused inode 282. Clear? no check_filetype:716: increase inode 32002 badness 31 to 32 for 20028 Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 32 to 33 for 20047 Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) references inode 283 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) has deleted/unused inode 283. Clear? no check_filetype:716: increase inode 32002 badness 33 to 34 for 20028 Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 34 to 35 for 20047 Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) references inode 284 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) has deleted/unused inode 284. Clear? no check_filetype:716: increase inode 32002 badness 35 to 36 for 20028 Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 36 to 37 for 20047 Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) references inode 285 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) has deleted/unused inode 285. Clear? no check_filetype:716: increase inode 32002 badness 37 to 38 for 20028 Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 38 to 39 for 20047 Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) references inode 286 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) has deleted/unused inode 286. Clear? no check_filetype:716: increase inode 32002 badness 39 to 40 for 20028 Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 40 to 41 for 20047 Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) references inode 287 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) has deleted/unused inode 287. Clear? no check_filetype:716: increase inode 32002 badness 41 to 42 for 20028 Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 42 to 43 for 20047 Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) references inode 288 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) has deleted/unused inode 288. Clear? no check_filetype:716: increase inode 32002 badness 43 to 44 for 20028 Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 44 to 45 for 20047 Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) references inode 289 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) has deleted/unused inode 289. Clear? no check_filetype:716: increase inode 32002 badness 45 to 46 for 20028 Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 46 to 47 for 20047 Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) references inode 290 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) has deleted/unused inode 290. Clear? no check_filetype:716: increase inode 32002 badness 47 to 48 for 20028 Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 48 to 49 for 20047 Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) references inode 291 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) has deleted/unused inode 291. Clear? no check_filetype:716: increase inode 32002 badness 49 to 50 for 20028 Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 50 to 51 for 20047 Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) references inode 292 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) has deleted/unused inode 292. Clear? no check_filetype:716: increase inode 32002 badness 51 to 52 for 20028 Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 52 to 53 for 20047 Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) references inode 293 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) has deleted/unused inode 293. Clear? no check_filetype:716: increase inode 32002 badness 53 to 54 for 20028 Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 54 to 55 for 20047 Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) references inode 294 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) has deleted/unused inode 294. Clear? no check_filetype:716: increase inode 32002 badness 55 to 56 for 20028 Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 56 to 57 for 20047 Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) references inode 295 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 295. Clear? no check_filetype:716: increase inode 32002 badness 57 to 58 for 20028 Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 58 to 59 for 20047 Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) references inode 296 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 296. Clear? no check_filetype:716: increase inode 32002 badness 59 to 60 for 20028 Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 60 to 61 for 20047 Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) references inode 297 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 297. Clear? no check_filetype:716: increase inode 32002 badness 61 to 62 for 20028 Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 62 to 63 for 20047 Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) references inode 298 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 298. Clear? no check_filetype:716: increase inode 32002 badness 63 to 64 for 20028 Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 64 to 65 for 20047 Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) references inode 299 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 299. Clear? no check_filetype:716: increase inode 32002 badness 65 to 66 for 20028 Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 66 to 67 for 20047 Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) references inode 300 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 300. Clear? no check_filetype:716: increase inode 32002 badness 67 to 68 for 20028 Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 3 to 4 for 20047 Entry '0x10000' in /quota_master/md-0x0 (32034) references inode 349 found in group 0's unused inodes area. Fix? no Entry '0x10000' in /quota_master/md-0x0 (32034) has deleted/unused inode 349. Clear? no check_dir_block:1649: increase inode 32034 badness 4 to 5 for 20047 Entry '0x1010000' in /quota_master/md-0x0 (32034) references inode 350 found in group 0's unused inodes area. Fix? no Entry '0x1010000' in /quota_master/md-0x0 (32034) has deleted/unused inode 350. Clear? no check_dir_block:1649: increase inode 32034 badness 5 to 6 for 20047 Entry '0x2010000' in /quota_master/md-0x0 (32034) references inode 351 found in group 0's unused inodes area. Fix? no Entry '0x2010000' in /quota_master/md-0x0 (32034) has deleted/unused inode 351. Clear? no check_dir_block:1649: increase inode 32035 badness 3 to 4 for 20047 Entry '0x20000' in /quota_master/dt-0x0 (32035) references inode 348 found in group 0's unused inodes area. Fix? no Entry '0x20000' in /quota_master/dt-0x0 (32035) has deleted/unused inode 348. Clear? no check_dir_block:1649: increase inode 32035 badness 4 to 5 for 20047 Entry '0x1020000' in /quota_master/dt-0x0 (32035) references inode 346 found in group 0's unused inodes area. Fix? no Entry '0x1020000' in /quota_master/dt-0x0 (32035) has deleted/unused inode 346. Clear? no check_dir_block:1649: increase inode 32035 badness 5 to 6 for 20047 Entry '0x2020000' in /quota_master/dt-0x0 (32035) references inode 347 found in group 0's unused inodes area. Fix? no Entry '0x2020000' in /quota_master/dt-0x0 (32035) has deleted/unused inode 347. Clear? no check_dir_block:1649: increase inode 32036 badness 3 to 4 for 20047 Entry '0x10000' in /quota_slave (32036) references inode 303 found in group 0's unused inodes area. Fix? no Entry '0x10000' in /quota_slave (32036) has deleted/unused inode 303. Clear? no check_filetype:716: increase inode 32036 badness 4 to 5 for 20028 Entry '0x10000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 5 to 6 for 20047 Entry '0x10000-MDT0000' in /quota_slave (32036) references inode 305 found in group 0's unused inodes area. Fix? no Entry '0x10000-MDT0000' in /quota_slave (32036) has deleted/unused inode 305. Clear? no check_filetype:716: increase inode 32036 badness 6 to 7 for 20028 Entry '0x10000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 7 to 8 for 20047 Entry '0x1010000' in /quota_slave (32036) references inode 307 found in group 0's unused inodes area. Fix? no Entry '0x1010000' in /quota_slave (32036) has deleted/unused inode 307. Clear? no check_filetype:716: increase inode 32036 badness 8 to 9 for 20028 Entry '0x1010000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 9 to 10 for 20047 Entry '0x1010000-MDT0000' in /quota_slave (32036) references inode 308 found in group 0's unused inodes area. Fix? no Entry '0x1010000-MDT0000' in /quota_slave (32036) has deleted/unused inode 308. Clear? no check_filetype:716: increase inode 32036 badness 10 to 11 for 20028 Entry '0x1010000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 11 to 12 for 20047 Entry '0x2010000' in /quota_slave (32036) references inode 309 found in group 0's unused inodes area. Fix? no Entry '0x2010000' in /quota_slave (32036) has deleted/unused inode 309. Clear? no check_filetype:716: increase inode 32036 badness 12 to 13 for 20028 Entry '0x2010000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 13 to 14 for 20047 Entry '0x2010000-MDT0000' in /quota_slave (32036) references inode 304 found in group 0's unused inodes area. Fix? no Entry '0x2010000-MDT0000' in /quota_slave (32036) has deleted/unused inode 304. Clear? no check_filetype:716: increase inode 32036 badness 14 to 15 for 20028 Entry '0x2010000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 15 to 16 for 20047 Entry '0x20000' in /quota_slave (32036) references inode 312 found in group 0's unused inodes area. Fix? no Entry '0x20000' in /quota_slave (32036) has deleted/unused inode 312. Clear? no check_filetype:716: increase inode 32036 badness 16 to 17 for 20028 Entry '0x20000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 17 to 18 for 20047 Entry '0x20000-MDT0000' in /quota_slave (32036) references inode 311 found in group 0's unused inodes area. Fix? no Entry '0x20000-MDT0000' in /quota_slave (32036) has deleted/unused inode 311. Clear? no check_filetype:716: increase inode 32036 badness 18 to 19 for 20028 Entry '0x20000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 19 to 20 for 20047 Entry '0x1020000' in /quota_slave (32036) references inode 301 found in group 0's unused inodes area. Fix? no Entry '0x1020000' in /quota_slave (32036) has deleted/unused inode 301. Clear? no check_filetype:716: increase inode 32036 badness 20 to 21 for 20028 Entry '0x1020000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 21 to 22 for 20047 Entry '0x1020000-MDT0000' in /quota_slave (32036) references inode 306 found in group 0's unused inodes area. Fix? no Entry '0x1020000-MDT0000' in /quota_slave (32036) has deleted/unused inode 306. Clear? no check_filetype:716: increase inode 32036 badness 22 to 23 for 20028 Entry '0x1020000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 23 to 24 for 20047 Entry '0x2020000' in /quota_slave (32036) references inode 310 found in group 0's unused inodes area. Fix? no Entry '0x2020000' in /quota_slave (32036) has deleted/unused inode 310. Clear? no check_filetype:716: increase inode 32036 badness 24 to 25 for 20028 Entry '0x2020000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 25 to 26 for 20047 Entry '0x2020000-MDT0000' in /quota_slave (32036) references inode 302 found in group 0's unused inodes area. Fix? no Entry '0x2020000-MDT0000' in /quota_slave (32036) has deleted/unused inode 302. Clear? no check_filetype:716: increase inode 32036 badness 26 to 27 for 20028 Entry '0x2020000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 3 to 4 for 20047 Entry 'lfsck_layout_00' in /LFSCK (96031) references inode 320 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_00' in /LFSCK (96031) has deleted/unused inode 320. Clear? no check_filetype:716: increase inode 96031 badness 4 to 5 for 20028 Entry 'lfsck_layout_00' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 5 to 6 for 20047 Entry 'lfsck_layout_01' in /LFSCK (96031) references inode 315 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_01' in /LFSCK (96031) has deleted/unused inode 315. Clear? no check_filetype:716: increase inode 96031 badness 6 to 7 for 20028 Entry 'lfsck_layout_01' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 7 to 8 for 20047 Entry 'lfsck_layout_02' in /LFSCK (96031) references inode 319 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_02' in /LFSCK (96031) has deleted/unused inode 319. Clear? no check_filetype:716: increase inode 96031 badness 8 to 9 for 20028 Entry 'lfsck_layout_02' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 9 to 10 for 20047 Entry 'lfsck_layout_03' in /LFSCK (96031) references inode 329 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_03' in /LFSCK (96031) has deleted/unused inode 329. Clear? no check_filetype:716: increase inode 96031 badness 10 to 11 for 20028 Entry 'lfsck_layout_03' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 11 to 12 for 20047 Entry 'lfsck_layout_04' in /LFSCK (96031) references inode 327 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_04' in /LFSCK (96031) has deleted/unused inode 327. Clear? no check_filetype:716: increase inode 96031 badness 12 to 13 for 20028 Entry 'lfsck_layout_04' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 13 to 14 for 20047 Entry 'lfsck_layout_05' in /LFSCK (96031) references inode 326 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_05' in /LFSCK (96031) has deleted/unused inode 326. Clear? no check_filetype:716: increase inode 96031 badness 14 to 15 for 20028 Entry 'lfsck_layout_05' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 15 to 16 for 20047 Entry 'lfsck_layout_06' in /LFSCK (96031) references inode 324 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_06' in /LFSCK (96031) has deleted/unused inode 324. Clear? no check_filetype:716: increase inode 96031 badness 16 to 17 for 20028 Entry 'lfsck_layout_06' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 17 to 18 for 20047 Entry 'lfsck_layout_07' in /LFSCK (96031) references inode 336 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_07' in /LFSCK (96031) has deleted/unused inode 336. Clear? no check_dir_block:1649: increase inode 96031 badness 18 to 19 for 20047 Entry 'lfsck_layout_08' in /LFSCK (96031) references inode 321 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_08' in /LFSCK (96031) has deleted/unused inode 321. Clear? no check_filetype:716: increase inode 96031 badness 19 to 20 for 20028 Entry 'lfsck_layout_08' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 20 to 21 for 20047 Entry 'lfsck_layout_09' in /LFSCK (96031) references inode 313 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_09' in /LFSCK (96031) has deleted/unused inode 313. Clear? no check_filetype:716: increase inode 96031 badness 21 to 22 for 20028 Entry 'lfsck_layout_09' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 22 to 23 for 20047 Entry 'lfsck_layout_10' in /LFSCK (96031) references inode 339 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_10' in /LFSCK (96031) has deleted/unused inode 339. Clear? no check_dir_block:1649: increase inode 96031 badness 23 to 24 for 20047 Entry 'lfsck_layout_11' in /LFSCK (96031) references inode 334 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_11' in /LFSCK (96031) has deleted/unused inode 334. Clear? no check_dir_block:1649: increase inode 96031 badness 24 to 25 for 20047 Entry 'lfsck_layout_12' in /LFSCK (96031) references inode 325 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_12' in /LFSCK (96031) has deleted/unused inode 325. Clear? no check_filetype:716: increaseoleg225-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) oleg225-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) oleg225-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) inode 96031 badness 25 to 26 for 20028 Entry 'lfsck_layout_12' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 26 to 27 for 20047 Entry 'lfsck_layout_13' in /LFSCK (96031) references inode 337 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_13' in /LFSCK (96031) has deleted/unused inode 337. Clear? no check_dir_block:1649: increase inode 96031 badness 27 to 28 for 20047 Entry 'lfsck_layout_14' in /LFSCK (96031) references inode 341 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_14' in /LFSCK (96031) has deleted/unused inode 341. Clear? no check_dir_block:1649: increase inode 96031 badness 28 to 29 for 20047 Entry 'lfsck_layout_15' in /LFSCK (96031) references inode 333 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_15' in /LFSCK (96031) has deleted/unused inode 333. Clear? no Pass 2: Memory used: 416k/0k (137k/280k), time: 0.07/ 0.00/ 0.01 Pass 2: I/O read: 1MB, write: 0MB, rate: 13.95MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 416k/0k (138k/279k), time: 0.12/ 0.01/ 0.02 Pass 3: Memory used: 416k/0k (136k/281k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Unattached inode 82 Connect to /lost+found? no Unattached inode 88 Connect to /lost+found? no Unattached inode 111 Connect to /lost+found? no Unattached inode 118 Connect to /lost+found? no Unattached inode 120 Connect to /lost+found? no Unattached inode 121 Connect to /lost+found? no Unattached inode 122 Connect to /lost+found? no Unattached inode 123 Connect to /lost+found? no Unattached inode 124 Connect to /lost+found? no Unattached inode 125 Connect to /lost+found? no Unattached inode 126 Connect to /lost+found? no Unattached inode 127 Connect to /lost+found? no Unattached inode 128 Connect to /lost+found? no Unattached inode 129 Connect to /lost+found? no Unattached inode 130 Connect to /lost+found? no Unattached inode 131 Connect to /lost+found? no Unattached inode 132 Connect to /lost+found? no Unattached inode 133 Connect to /lost+found? no Unattached inode 134 Connect to /lost+found? no Unattached inode 135 Connect to /lost+found? no Unattached inode 136 Connect to /lost+found? no Unattached inode 138 Connect to /lost+found? no Unattached inode 139 Connect to /lost+found? no Unattached inode 140 Connect to /lost+found? no Unattached inode 141 Connect to /lost+found? no Unattached inode 142 Connect to /lost+found? no Unattached inode 143 Connect to /lost+found? no Unattached inode 144 Connect to /lost+found? no Unattached inode 145 Connect to /lost+found? no Unattached inode 146 Connect to /lost+found? no Unattached inode 147 Connect to /lost+found? no Unattached inode 148 Connect to /lost+found? no Unattached inode 149 Connect to /lost+found? no Unattached inode 150 Connect to /lost+found? no Unattached inode 151 Connect to /lost+found? no Unattached inode 152 Connect to /lost+found? no Unattached inode 153 Connect to /lost+found? no Unattached inode 265 Connect to /lost+found? no Unattached inode 266 Connect to /lost+found? no Pass 4: Memory used: 416k/0k (83k/334k), time: 0.02/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 64.75MB/s Pass 5: Checking group summary information Block bitmap differences: -(22951--22954) +(22956--22957) Fix? no Pass 5: Memory used: 416k/0k (82k/335k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 117.22MB/s Update quota info for quota type 0? no Update quota info for quota type 1? no Update quota info for quota type 2? no lustre-MDT0000: ********** WARNING: Filesystem still has errors ********** 381 inodes used (0.24%, out of 160000) 1 non-contiguous file (0.3%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 306 44647 blocks used (44.65%, out of 100000) 0 bad blocks 1 large file pdsh@oleg225-client: oleg225-server: ssh exited with exit code 4 250 regular files 121 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 403 files Memory used: 416k/0k (84k/333k), time: 0.14/ 0.02/ 0.02 I/O read: 1MB, write: 0MB, rate: 6.96MB/s sanity-scrub test_17a: @@@@@@ FAIL: e2fsck -d -v -t -t -f -n /dev/vdc -m8 returned 4, should be <= 0 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6751:run_e2fsck() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1304:test_17a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1307:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_17a.*.1767318868.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_17a.debug_log.oleg225-server.1767318868.log.w8xF4F" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_17a.dmesg.oleg225-server.1767318868.log.2GOjYZ" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0000 FAIL 17a (38s) == sanity-scrub test 17b: ENOSPC on .. insertion shouldn't leak inodes ========================================================== 20:54:57 (1767318897) fail_loc=0x8000019e lfs mkdir: dirstripe error on '/mnt/lustre/d17b.sanity-scrub': No space left on device lfs setdirstripe: cannot create dir '/mnt/lustre/d17b.sanity-scrub': No space left on device Stopping /mnt/lustre-mds1 (opts:) on oleg225-server e2fsck -d -v -t -t -f -n /dev/vdc -m8 oleg225-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg225-server: Use max possible thread num: 1 instead Warning! /dev/vdc is in use. Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 4], used inodes 381/160000 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 88 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 88 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 93 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 93 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 94 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 94 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 95 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 95 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 96 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 96 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 97 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 97 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 98 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 98 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 100 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 100 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 101 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 101 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 102 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 102 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 103 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 103 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 104 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 104 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 105 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 105 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 106 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 106 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 107 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 107 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 108 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 108 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 109 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 109 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 110 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 110 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 111 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 111 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 120 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 121 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 122 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 132 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 146 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 147 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 148 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 148 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 149 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 149 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 150 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 150 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 153 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 0 to 2 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 32020 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32020 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32033 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32033 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32034 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32034 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32035 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32035 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 32036 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 32036 badness 1 to 3 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 64031 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 64031 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 64032 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 64033 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 64033 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 64034 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 64034 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 64035 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 64035 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 64036 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 64036 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 64037 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 64038 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 64039 badness 0 to 1 for 1005c [Thread 0] group 2 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 96031 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 96031 badness 1 to 3 for 10084 [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] Pass 1: Memory used: 304k/0k (184k/121k), time: 0.03/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 38.94MB/s [Thread 0] Scanned group range [0, 4], used inodes 381/383 Pass 2: Checking directory structure Entry 'fld' in / (2) has deleted/unused inode 164. Clear? no Entry 'lfsck_namespace' in / (2) has deleted/unused inode 162. Clear? no check_dir_block:1649: increase inode 13 badness 0 to 1 for 20047 Entry 'nodemap' in /CONFIGS (13) references inode 345 found in group 0's unused inodes area. Fix? no Entry 'nodemap' in /CONFIGS (13) has deleted/unused inode 345. Clear? no check_dir_block:1649: increase inode 32002 badness 0 to 1 for 20047 Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) references inode 267 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) has deleted/unused inode 267. Clear? no check_filetype:716: increase inode 32002 badness 1 to 2 for 20028 Entry '0x200000003:0x1f:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 2 to 3 for 20047 Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) references inode 268 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) has deleted/unused inode 268. Clear? no check_filetype:716: increase inode 32002 badness 3 to 4 for 20028 Entry '0x200000003:0x20:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 4 to 5 for 20047 Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) references inode 269 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) has deleted/unused inode 269. Clear? no check_filetype:716: increase inode 32002 badness 5 to 6 for 20028 Entry '0x200000003:0x21:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 6 to 7 for 20047 Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) references inode 270 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) has deleted/unused inode 270. Clear? no check_filetype:716: increase inode 32002 badness 7 to 8 for 20028 Entry '0x200000003:0x22:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 8 to 9 for 20047 Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) references inode 271 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) has deleted/unused inode 271. Clear? no check_filetype:716: increase inode 32002 badness 9 to 10 for 20028 Entry '0x200000003:0x23:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 10 to 11 for 20047 Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) references inode 272 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) has deleted/unused inode 272. Clear? no check_filetype:716: increase inode 32002 badness 11 to 12 for 20028 Entry '0x200000003:0x25:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 12 to 13 for 20047 Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) references inode 273 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) has deleted/unused inode 273. Clear? no check_filetype:716: increase inode 32002 badness 13 to 14 for 20028 Entry '0x200000003:0x26:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 14 to 15 for 20047 Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) references inode 274 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) has deleted/unused inode 274. Clear? no check_filetype:716: increase inode 32002 badness 15 to 16 for 20028 Entry '0x200000003:0x27:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 16 to 17 for 20047 Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) references inode 275 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) has deleted/unused inode 275. Clear? no check_filetype:716: increase inode 32002 badness 17 to 18 for 20028 Entry '0x200000003:0x28:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 18 to 19 for 20047 Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) references inode 276 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) has deleted/unused inode 276. Clear? no check_filetype:716: increase inode 32002 badness 19 to 20 for 20028 Entry '0x200000003:0x29:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 20 to 21 for 20047 Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) references inode 277 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) has deleted/unused inode 277. Clear? no check_filetype:716: increase inode 32002 badness 21 to 22 for 20028 Entry '0x200000003:0x2a:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 22 to 23 for 20047 Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) references inode 278 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) has deleted/unused inode 278. Clear? no check_filetype:716: increase inode 32002 badness 23 to 24 for 20028 Entry '0x200000003:0x2b:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 24 to 25 for 20047 Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) references inode 279 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) has deleted/unused inode 279. Clear? no check_filetype:716: increase inode 32002 badness 25 to 26 for 20028 Entry '0x200000003:0x2c:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 26 to 27 for 20047 Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) references inode 280 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) has deleted/unused inode 280. Clear? no check_filetype:716: increase inode 32002 badness 27 to 28 for 20028 Entry '0x200000003:0x2d:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 28 to 29 for 20047 Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) references inode 281 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) has deleted/unused inode 281. Clear? no check_filetype:716: increase inode 32002 badness 29 to 30 for 20028 Entry '0x200000003:0x2e:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 30 to 31 for 20047 Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) references inode 282 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) has deleted/unused inode 282. Clear? no check_filetype:716: increase inode 32002 badness 31 to 32 for 20028 Entry '0x200000003:0x2f:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 32 to 33 for 20047 Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) references inode 283 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) has deleted/unused inode 283. Clear? no check_filetype:716: increase inode 32002 badness 33 to 34 for 20028 Entry '0x200000003:0x30:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 34 to 35 for 20047 Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) references inode 284 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) has deleted/unused inode 284. Clear? no check_filetype:716: increase inode 32002 badness 35 to 36 for 20028 Entry '0x200000003:0x31:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 36 to 37 for 20047 Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) references inode 285 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) has deleted/unused inode 285. Clear? no check_filetype:716: increase inode 32002 badness 37 to 38 for 20028 Entry '0x200000003:0x32:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 38 to 39 for 20047 Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) references inode 286 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) has deleted/unused inode 286. Clear? no check_filetype:716: increase inode 32002 badness 39 to 40 for 20028 Entry '0x200000003:0x33:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 40 to 41 for 20047 Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) references inode 287 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) has deleted/unused inode 287. Clear? no check_filetype:716: increase inode 32002 badness 41 to 42 for 20028 Entry '0x200000003:0x34:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 42 to 43 for 20047 Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) references inode 288 found in group 0's unused inodes area. Fix? no Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) has deleted/unused inode 288. Clear? no check_filetype:716: increase inode 32002 badness 43 to 44 for 20028 Entry '0x200000003:0x35:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 44 to 45 for 20047 Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) references inode 289 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) has deleted/unused inode 289. Clear? no check_filetype:716: increase inode 32002 badness 45 to 46 for 20028 Entry '0x200000005:0x1:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 46 to 47 for 20047 Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) references inode 290 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) has deleted/unused inode 290. Clear? no check_filetype:716: increase inode 32002 badness 47 to 48 for 20028 Entry '0x200000005:0x2:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 48 to 49 for 20047 Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) references inode 291 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) has deleted/unused inode 291. Clear? no check_filetype:716: increase inode 32002 badness 49 to 50 for 20028 Entry '0x200000005:0x3:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 50 to 51 for 20047 Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) references inode 292 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) has deleted/unused inode 292. Clear? no check_filetype:716: increase inode 32002 badness 51 to 52 for 20028 Entry '0x200000005:0x20001:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 52 to 53 for 20047 Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) references inode 293 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) has deleted/unused inode 293. Clear? no check_filetype:716: increase inode 32002 badness 53 to 54 for 20028 Entry '0x200000005:0x20002:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 54 to 55 for 20047 Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) references inode 294 found in group 0's unused inodes area. Fix? no Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) has deleted/unused inode 294. Clear? no check_filetype:716: increase inode 32002 badness 55 to 56 for 20028 Entry '0x200000005:0x20003:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 56 to 57 for 20047 Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) references inode 295 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 295. Clear? no check_filetype:716: increase inode 32002 badness 57 to 58 for 20028 Entry '0x200000006:0x10000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 58 to 59 for 20047 Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) references inode 296 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 296. Clear? no check_filetype:716: increase inode 32002 badness 59 to 60 for 20028 Entry '0x200000006:0x20000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 60 to 61 for 20047 Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) references inode 297 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 297. Clear? no check_filetype:716: increase inode 32002 badness 61 to 62 for 20028 Entry '0x200000006:0x1010000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 62 to 63 for 20047 Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) references inode 298 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 298. Clear? no check_filetype:716: increase inode 32002 badness 63 to 64 for 20028 Entry '0x200000006:0x1020000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 64 to 65 for 20047 Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) references inode 299 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 299. Clear? no check_filetype:716: increase inode 32002 badness 65 to 66 for 20028 Entry '0x200000006:0x2010000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32002 badness 66 to 67 for 20047 Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) references inode 300 found in group 0's unused inodes area. Fix? no Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) has deleted/unused inode 300. Clear? no check_filetype:716: increase inode 32002 badness 67 to 68 for 20028 Entry '0x200000006:0x2020000:0x0.lbx' in /index_backup (32002) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32034 badness 3 to 4 for 20047 Entry '0x10000' in /quota_master/md-0x0 (32034) references inode 349 found in group 0's unused inodes area. Fix? no Entry '0x10000' in /quota_master/md-0x0 (32034) has deleted/unused inode 349. Clear? no check_dir_block:1649: increase inode 32034 badness 4 to 5 for 20047 Entry '0x1010000' in /quota_master/md-0x0 (32034) references inode 350 found in group 0's unused inodes area. Fix? no Entry '0x1010000' in /quota_master/md-0x0 (32034) has deleted/unused inode 350. Clear? no check_dir_block:1649: increase inode 32034 badness 5 to 6 for 20047 Entry '0x2010000' in /quota_master/md-0x0 (32034) references inode 351 found in group 0's unused inodes area. Fix? no Entry '0x2010000' in /quota_master/md-0x0 (32034) has deleted/unused inode 351. Clear? no check_dir_block:1649: increase inode 32035 badness 3 to 4 for 20047 Entry '0x20000' in /quota_master/dt-0x0 (32035) references inode 348 found in group 0's unused inodes area. Fix? no Entry '0x20000' in /quota_master/dt-0x0 (32035) has deleted/unused inode 348. Clear? no check_dir_block:1649: increase inode 32035 badness 4 to 5 for 20047 Entry '0x1020000' in /quota_master/dt-0x0 (32035) references inode 346 found in group 0's unused inodes area. Fix? no Entry '0x1020000' in /quota_master/dt-0x0 (32035) has deleted/unused inode 346. Clear? no check_dir_block:1649: increase inode 32035 badness 5 to 6 for 20047 Entry '0x2020000' in /quota_master/dt-0x0 (32035) references inode 347 found in group 0's unused inodes area. Fix? no Entry '0x2020000' in /quota_master/dt-0x0 (32035) has deleted/unused inode 347. Clear? no check_dir_block:1649: increase inode 32036 badness 3 to 4 for 20047 Entry '0x10000' in /quota_slave (32036) references inode 303 found in group 0's unused inodes area. Fix? no Entry '0x10000' in /quota_slave (32036) has deleted/unused inode 303. Clear? no check_filetype:716: increase inode 32036 badness 4 to 5 for 20028 Entry '0x10000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 5 to 6 for 20047 Entry '0x10000-MDT0000' in /quota_slave (32036) references inode 305 found in group 0's unused inodes area. Fix? no Entry '0x10000-MDT0000' in /quota_slave (32036) has deleted/unused inode 305. Clear? no check_filetype:716: increase inode 32036 badness 6 to 7 for 20028 Entry '0x10000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 7 to 8 for 20047 Entry '0x1010000' in /quota_slave (32036) references inode 307 found in group 0's unused inodes area. Fix? no Entry '0x1010000' in /quota_slave (32036) has deleted/unused inode 307. Clear? no check_filetype:716: increase inode 32036 badness 8 to 9 for 20028 Entry '0x1010000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 9 to 10 for 20047 Entry '0x1010000-MDT0000' in /quota_slave (32036) references inode 308 found in group 0's unused inodes area. Fix? no Entry '0x1010000-MDT0000' in /quota_slave (32036) has deleted/unused inode 308. Clear? no check_filetype:716: increase inode 32036 badness 10 to 11 for 20028 Entry '0x1010000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 11 to 12 for 20047 Entry '0x2010000' in /quota_slave (32036) references inode 309 found in group 0's unused inodes area. Fix? no Entry '0x2010000' in /quota_slave (32036) has deleted/unused inode 309. Clear? no check_filetype:716: increase inode 32036 badness 12 to 13 for 20028 Entry '0x2010000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 13 to 14 for 20047 Entry '0x2010000-MDT0000' in /quota_slave (32036) references inode 304 found in group 0's unused inodes area. Fix? no Entry '0x2010000-MDT0000' in /quota_slave (32036) has deleted/unused inode 304. Clear? no check_filetype:716: increase inode 32036 badness 14 to 15 for 20028 Entry '0x2010000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 15 to 16 for 20047 Entry '0x20000' in /quota_slave (32036) references inode 312 found in group 0's unused inodes area. Fix? no Entry '0x20000' in /quota_slave (32036) has deleted/unused inode 312. Clear? no check_filetype:716: increase inode 32036 badness 16 to 17 for 20028 Entry '0x20000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 17 to 18 for 20047 Entry '0x20000-MDT0000' in /quota_slave (32036) references inode 311 found in group 0's unused inodes area. Fix? no Entry '0x20000-MDT0000' in /quota_slave (32036) has deleted/unused inode 311. Clear? no check_filetype:716: increase inode 32036 badness 18 to 19 for 20028 Entry '0x20000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 19 to 20 for 20047 Entry '0x1020000' in /quota_slave (32036) references inode 301 found in group 0's unused inodes area. Fix? no Entry '0x1020000' in /quota_slave (32036) has deleted/unused inode 301. Clear? no check_filetype:716: increase inode 32036 badness 20 to 21 for 20028 Entry '0x1020000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 21 to 22 for 20047 Entry '0x1020000-MDT0000' in /quota_slave (32036) references inode 306 found in group 0's unused inodes area. Fix? no Entry '0x1020000-MDT0000' in /quota_slave (32036) has deleted/unused inode 306. Clear? no check_filetype:716: increase inode 32036 badness 22 to 23 for 20028 Entry '0x1020000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 23 to 24 for 20047 Entry '0x2020000' in /quota_slave (32036) references inode 310 found in group 0's unused inodes area. Fix? no Entry '0x2020000' in /quota_slave (32036) has deleted/unused inode 310. Clear? no check_filetype:716: increase inode 32036 badness 24 to 25 for 20028 Entry '0x2020000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 32036 badness 25 to 26 for 20047 Entry '0x2020000-MDT0000' in /quota_slave (32036) references inode 302 found in group 0's unused inodes area. Fix? no Entry '0x2020000-MDT0000' in /quota_slave (32036) has deleted/unused inode 302. Clear? no check_filetype:716: increase inode 32036 badness 26 to 27 for 20028 Entry '0x2020000-MDT0000' in /quota_slave (32036) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 3 to 4 for 20047 Entry 'lfsck_layout_00' in /LFSCK (96031) references inode 320 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_00' in /LFSCK (96031) has deleted/unused inode 320. Clear? no check_filetype:716: increase inode 96031 badness 4 to 5 for 20028 Entry 'lfsck_layout_00' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 5 to 6 for 20047 Entry 'lfsck_layout_01' in /LFSCK (96031) references inode 315 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_01' in /LFSCK (96031) has deleted/unused inode 315. Clear? no check_filetype:716: increase inode 96031 badness 6 to 7 for 20028 Entry 'lfsck_layout_01' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 7 to 8 for 20047 Entry 'lfsck_layout_02' in /LFSCK (96031) references inode 319 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_02' in /LFSCK (96031) has deleted/unused inode 319. Clear? no check_filetype:716: increase inode 96031 badness 8 to 9 for 20028 Entry 'lfsck_layout_02' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 9 to 10 for 20047 Entry 'lfsck_layout_03' in /LFSCK (96031) references inode 329 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_03' in /LFSCK (96031) has deleted/unused inode 329. Clear? no check_filetype:716: increase inode 96031 badness 10 to 11 for 20028 Entry 'lfsck_layout_03' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 11 to 12 for 20047 Entry 'lfsck_layout_04' in /LFSCK (96031) references inode 327 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_04' in /LFSCK (96031) has deleted/unused inode 327. Clear? no check_filetype:716: increase inode 96031 badness 12 to 13 for 20028 Entry 'lfsck_layout_04' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 13 to 14 for 20047 Entry 'lfsck_layout_05' in /LFSCK (96031) references inode 326 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_05' in /LFSCK (96031) has deleted/unused inode 326. Clear? no check_filetype:716: increase inode 96031 badness 14 to 15 for 20028 Entry 'lfsck_layout_05' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 15 to 16 for 20047 Entry 'lfsck_layout_06' in /LFSCK (96031) references inode 324 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_06' in /LFSCK (96031) has deleted/unused inode 324. Clear? no check_filetype:716: increase inode 96031 badness 16 to 17 for 20028 Entry 'lfsck_layout_06' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 17 to 18 for 20047 Entry 'lfsck_layout_07' in /LFSCK (96031) references inode 336 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_07' in /LFSCK (96031) has deleted/unused inode 336. Clear? no check_dir_block:1649: increase inode 96031 badness 18 to 19 for 20047 Entry 'lfsck_layout_08' in /LFSCK (96031) references inode 321 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_08' in /LFSCK (96031) has deleted/unused inode 321. Clear? no check_filetype:716: increase inode 96031 badness 19 to 20 for 20028 Entry 'lfsck_layout_08' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 20 to 21 for 20047 Entry 'lfsck_layout_09' in /LFSCK (96031) references inode 313 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_09' in /LFSCK (96031) has deleted/unused inode 313. Clear? no check_filetype:716: increase inode 96031 badness 21 to 22 for 20028 Entry 'lfsck_layout_09' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 22 to 23 for 20047 Entry 'lfsck_layout_10' in /LFSCK (96031) references inode 339 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_10' in /LFSCK (96031) has deleted/unused inode 339. Clear? no check_dir_block:1649: increase inode 96031 badness 23 to 24 for 20047 Entry 'lfsck_layout_11' in /LFSCK (96031) references inode 334 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_11' in /LFSCK (96031) has deleted/unused inode 334. Clear? no check_dir_block:1649: increase inode 96031 badness 24 to 25 for 20047 Entry 'lfsck_layout_12' in /LFSCK (96031) references inode 325 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_12' in /LFSCK (96031) has deleted/unused inode 325. Clear? no check_filetype:716: increaseoleg225-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) inode 96031 badness 25 to 26 for 20028 Entry 'lfsck_layout_12' in /LFSCK (96031) has an incorrect filetype (was 1, should be 0). Fix? no check_dir_block:1649: increase inode 96031 badness 26 to 27 for 20047 Entry 'lfsck_layout_13' in /LFSCK (96031) references inode 337 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_13' in /LFSCK (96031) has deleted/unused inode 337. Clear? no check_dir_block:1649: increase inode 96031 badness 27 to 28 for 20047 Entry 'lfsck_layout_14' in /LFSCK (96031) references inode 341 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_14' in /LFSCK (96031) has deleted/unused inode 341. Clear? no check_dir_block:1649: increase inode 96031 badness 28 to 29 for 20047 Entry 'lfsck_layout_15' in /LFSCK (96031) references inode 333 found in group 0's unused inodes area. Fix? no Entry 'lfsck_layout_15' in /LFSCK (96031) has deleted/unused inode 333. Clear? no Pass 2: Memory used: 416k/0k (137k/280k), time: 0.05/ 0.01/ 0.01 Pass 2: I/O read: 1MB, write: 0MB, rate: 20.23MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 416k/0k (138k/279k), time: 0.09/ 0.01/ 0.01 Pass 3: Memory used: 416k/0k (136k/281k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Unattached inode 82 Connect to /lost+found? no Unattached inode 88 Connect to /lost+found? no Unattached inode 111 Connect to /lost+found? no Unattached inode 118 Connect to /lost+found? no Unattached inode 120 Connect to /lost+found? no Unattached inode 121 Connect to /lost+found? no Unattached inode 122 Connect to /lost+found? no Unattached inode 123 Connect to /lost+found? no Unattached inode 124 Connect to /lost+found? no Unattached inode 125 Connect to /lost+found? no Unattached inode 126 Connect to /lost+found? no Unattached inode 127 Connect to /lost+found? no Unattached inode 128 Connect to /lost+found? no Unattached inode 129 Connect to /lost+found? no Unattached inode 130 Connect to /lost+found? no Unattached inode 131 Connect to /lost+found? no Unattached inode 132 Connect to /lost+found? no Unattached inode 133 Connect to /lost+found? no Unattached inode 134 Connect to /lost+found? no Unattached inode 135 Connect to /lost+found? no Unattached inode 136 Connect to /lost+found? no Unattached inode 138 Connect to /lost+found? no Unattached inode 139 Connect to /lost+found? no Unattached inode 140 Connect to /lost+found? no Unattached inode 141 Connect to /lost+found? no Unattached inode 142 Connect to /lost+found? no Unattached inode 143 Connect to /lost+found? no Unattached inode 144 Connect to /lost+found? no Unattached inode 145 Connect to /lost+found? no Unattached inode 146 Connect to /lost+found? no Unattached inode 147 Connect to /lost+found? no Unattached inode 148 Connect to /lost+found? no Unattached inode 149 Connect to /lost+found? no Unattached inode 150 Connect to /lost+found? no Unattached inode 151 Connect to /lost+found? no Unattached inode 152 Connect to /lost+found? no Unattached inode 153 Connect to /lost+found? no Unattached inode 265 Connect to /lost+found? no Unattached inode 266 Connect to /lost+found? no Pass 4: Memory used: 416k/0k (83k/334k), time: 0.01/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 105.60MB/s Pass 5: Checking group summary information Block bitmap differences: -(22951--22954) +(22956--22957) Fix? no Pass 5: Memory used: 416k/0k (82k/335k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 87.93MB/s Update quota info for quota type 0? no Update quota info for quota type 1? no Update quota info for quota type 2? no lustre-MDT0000: ********** WARNING: Filesystem still has errors ********** 381 inodes used (0.24%, out of 160000) 1 non-contiguous file (0.3%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 306 44647 blocks used (44.65%, out of 100000) 0 bad blocks 1 large file oleg225-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) oleg225-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (1736704, 371) != expected (1921024, 403) pdsh@oleg225-client: oleg225-server: ssh exited with exit code 4 250 regular files 121 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 403 files Memory used: 416k/0k (84k/333k), time: 0.11/ 0.02/ 0.01 I/O read: 1MB, write: 0MB, rate: 8.76MB/s sanity-scrub test_17b: @@@@@@ FAIL: e2fsck -d -v -t -t -f -n /dev/vdc -m8 returned 4, should be <= 0 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7487:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6751:run_e2fsck() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1319:test_17b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7863:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7926:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7741:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-scrub.sh:1322:main() Dumping lctl log to /tmp/testlogs//sanity-scrub.test_17b.*.1767318906.log rsync: chown "/tmp/testlogs/.sanity-scrub.test_17b.debug_log.oleg225-server.1767318906.log.c0MQow" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-scrub.test_17b.dmesg.oleg225-server.1767318906.log.iyRLMD" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0000 FAIL 17b (37s) == sanity-scrub test 18: test mount -o resetoi to recreate OI files ========================================================== 20:55:35 (1767318935) preparing... Thu Jan 1 20:55:38 EST 2026 creating 10 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d18.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027923 s, 37.6 MB/s creating 10 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d18.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209076 s, 50.2 MB/s prepared Thu Jan 1 20:55:45 EST 2026. stop mds1 stop mds2 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 [ 4274.714626] Lustre: lustre-MDT0000: reset Object Index mappings Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre PASS 18 (134s) == sanity-scrub test 19: LFSCK can fix multiple linked files on OST ========================================================== 20:57:50 (1767319070) total: 64 open/close in 0.71 seconds: 90.45 ops/second stopall link /mnt/lustre-ost1/O/280000401/d2/291 to /mnt/lustre-ost1/O/280000401/d2/122 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started LFSCK on the device lustre-OST0000: scrub Stopping /mnt/lustre-ost1 (opts:) on oleg225-server File: /mnt/lustre-ost1/O/280000401/d2/122 Size: 0 Blocks: 0 IO Block: 4096 regular empty file Device: fc03h/64515d Inode: 208 Links: 1 Access: (7666/-rwSrwSrwT) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.000000000 -0500 Modify: 1969-12-31 19:00:00.000000000 -0500 Change: 2026-01-01 20:58:19.534000000 -0500 Birth: 2026-01-01 20:57:42.782000000 -0500 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 PASS 19 (172s) == sanity-scrub test 20: Don't trigger OI scrub for irreparable oi repeatedly ========================================================== 21:00:42 (1767319242) Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0001 Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg225-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 seq.cli-lustre-OST0001-super.width=65536 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-OST0001 /mnt/lustre-ost2: 114.2 MiB (119697408 bytes) trimmed Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c8780000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c8780000.idle_timeout=debug disable quota as required fail_loc=0x193 Stopping /mnt/lustre-mds1 (opts:) on oleg225-server Start mds1: mount -t lustre -o localrecov -o user_xattr,noscrub /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0000 fail_loc=0x19f stat: cannot statx '/mnt/lustre/d20.sanity-scrub': Stale file handle OI scrub was triggerred 2 seconds ago stat: cannot statx '/mnt/lustre/d20.sanity-scrub': Stale file handle OI scrub was triggerred 8 seconds ago PASS 20 (167s) == sanity-scrub test 21: don't hang MDS recovery when failed to get update log ========================================================== 21:03:29 (1767319409) /dev/vdc Stopping /mnt/lustre-mds1 (opts:) on oleg225-server Stopping /mnt/lustre-mds2 (opts:) on oleg225-server oleg225-server: mount: /tmp/d21.sanity-scrub: /dev/vdc already mounted or mount point busy. oleg225-server: umount: /tmp/d21.sanity-scrub: not mounted. Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0000 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started lustre-MDT0001 affected facets: mds2 oleg225-server: oleg225-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 200 oleg225-server: *.lustre-MDT0001.recovery_status status: COMPLETE PASS 21 (63s) == sanity-scrub test 22: LFSCK can recreate or fix the LASTID on MDT/OST ========================================================== 21:04:32 (1767319472) Stopping clients: oleg225-client.virtnet /mnt/lustre (opts:) Stopping clients: oleg225-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg225-client.virtnet /mnt/lustre opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg225-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg225-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg225-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg225-server debug=-1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Stopping /mnt/lustre-mds1 (opts:) on oleg225-server File: /mnt/lustre-mds1/O/1/LAST_ID Size: 8 Blocks: 8 IO Block: 4096 regular file Device: fc00h/64512d Inode: 82 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.1073741822 -0500 Modify: 1969-12-31 19:00:00.1073741822 -0500 Change: 1969-12-31 19:00:00.1073741822 -0500 Birth: 2026-01-01 21:05:11.831000000 -0500 File: /mnt/lustre-mds1/O/10/LAST_ID Size: 8 Blocks: 8 IO Block: 4096 regular file Device: fc00h/64512d Inode: 83 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.1073741822 -0500 Modify: 1969-12-31 19:00:00.1073741822 -0500 Change: 1969-12-31 19:00:00.1073741822 -0500 Birth: 2026-01-01 21:05:11.834000000 -0500 File: /mnt/lustre-mds1/O/200000003/LAST_ID Size: 8 Blocks: 8 IO Block: 4096 regular file Device: fc00h/64512d Inode: 81 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.1073741822 -0500 Modify: 1969-12-31 19:00:00.1073741822 -0500 Change: 1969-12-31 19:00:00.1073741822 -0500 Birth: 2026-01-01 20:48:46.406000000 -0500 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 PASS 22 (81s) === sanity-scrub: start setup 21:05:53 (1767319553) === Stopping clients: oleg225-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg225-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg225-server waited 0 for 5 ST mdt lustre-MDT0000 lustre-MDT0000_UUID 3 oleg225-server: oleg225-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format ost2: /dev/vdf Format ost1: /dev/vde Format mds1: /dev/vdc Format mds2: /dev/vdd pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Checking servers environments Checking clients oleg225-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg225-server' oleg225-server: oleg225-server.virtnet: executing load_modules_local oleg225-server: Loading modules from /home/green/git/lustre-release/lustre oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1053: echo: write error: Device or resource busy oleg225-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1054: echo: write error: Device or resource busy oleg225-server: detected 4 online CPUs by sysfs oleg225-server: MODOPTS_LIBCFS= oleg225-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Commit the device label on /dev/vdc pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Commit the device label on /dev/vdd Started lustre-MDT0000 Started lustre-MDT0001 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 seq.cli-lustre-OST0000-super.width=65536 oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all oleg225-server: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Commit the device label on /dev/vdf pdsh@oleg225-client: oleg225-server: ssh exited with exit code 1 Commit the device label on /dev/vde Started lustre-OST0001 Started lustre-OST0000 /mnt/lustre-ost2: 0 B (0 bytes) trimmed /mnt/lustre-ost1: 0 B (0 bytes) trimmed Starting client: oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Starting client oleg225-client.virtnet: -o user_xattr,flock 192.168.202.125@tcp:/lustre /mnt/lustre Started clients oleg225-client.virtnet: 192.168.202.125@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9e04c5664800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9e04c5664800.idle_timeout=debug disable quota as required osd-ldiskfs.track_declares_assert=1 === sanity-scrub: finish setup 21:10:04 (1767319804) === == sanity-scrub test complete, duration 4794 sec ========= 21:10:05 (1767319805) sanity-scrub: FAIL: test_1b (1) Failed to remove OI . on mds1 sanity-scrub: FAIL: test_1c Fail to cleanup the env! sanity-scrub: FAIL: test_2 Fail to cleanup the env! sanity-scrub: FAIL: test_4a Fail to cleanup the env! sanity-scrub: FAIL: test_4b Fail to cleanup the env! sanity-scrub: FAIL: test_4c Fail to cleanup the env! sanity-scrub: FAIL: test_4d Fail to cleanup the env! sanity-scrub: FAIL: test_4e Fail to cleanup the env! sanity-scrub: FAIL: test_5 Backup/restore on mds1 failed sanity-scrub: FAIL: test_6 Backup/restore on mds1 failed sanity-scrub: FAIL: test_7 Backup/restore on mds1 failed sanity-scrub: FAIL: test_8 Backup/restore on mds1 failed sanity-scrub: FAIL: test_9 Backup/restore on mds1 failed sanity-scrub: FAIL: test_10a Backup/restore on mds1 failed sanity-scrub: FAIL: test_11 (3) Failed to start OI scrub on mds1 sanity-scrub: FAIL: test_14 e2fsck -d -v -t -t -f -y /dev/vde -m8 returned 8, should be <= 4 sanity-scrub: FAIL: test_15 Backup/restore on mds1 failed sanity-scrub: FAIL: test_17a e2fsck -d -v -t -t -f -n /dev/vdc -m8 returned 4, should be <= 0 sanity-scrub: FAIL: test_17b e2fsck -d -v -t -t -f -n /dev/vdc -m8 returned 4, should be <= 0 === sanity-scrub: start cleanup 21:10:07 (1767319807) === === sanity-scrub: finish cleanup 21:10:11 (1767319811) ===