== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 06:36:02 (1787394962) oleg414-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg414-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg414-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg414-client: oleg414-server: ssh exited with exit code 2 oleg414-server: oleg414-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg414-server' oleg414-server: oleg414-server.virtnet: executing load_modules_local oleg414-server: Loading modules from /home/green/git/lustre-release/lustre oleg414-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg414-server: detected 4 online CPUs by sysfs oleg414-server: MODOPTS_LIBCFS= oleg414-server: Force libcfs to create 2 CPU partitions oleg414-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg414-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg414-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg414-server' oleg414-server: oleg414-server.virtnet: executing load_modules_local oleg414-server: Loading modules from /home/green/git/lustre-release/lustre oleg414-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg414-server: detected 4 online CPUs by sysfs oleg414-server: MODOPTS_LIBCFS= oleg414-server: Force libcfs to create 2 CPU partitions Permanent disk data: Device: /dev/mapper/mds1_flakey Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg414-server: oleg414-server.virtnet: executing set_default_debug -1 all pdsh@oleg414-client: oleg414-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg414-server: oleg414-server.virtnet: executing set_default_debug -1 all pdsh@oleg414-client: oleg414-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg414-client.virtnet: -o user_xattr,flock 192.168.204.114@tcp:/lustre /mnt/lustre Starting client oleg414-client.virtnet: -o user_xattr,flock 192.168.204.114@tcp:/lustre /mnt/lustre Started clients oleg414-client.virtnet: 192.168.204.114@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg414-client.virtnet: -o user_xattr,flock 192.168.204.114@tcp:/lustre /mnt/lustre2 Starting client oleg414-client.virtnet: -o user_xattr,flock 192.168.204.114@tcp:/lustre /mnt/lustre2 Started clients oleg414-client.virtnet: 192.168.204.114@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 173871 173886 to complete - link 515 (time 1787395086.41 total 10.00 last 51.50) - link 1056 (time 1787395096.42 total 20.00 last 54.10) - link 1656 (time 1787395106.43 total 30.01 last 59.93) - link 2235 (time 1787395116.43 total 40.02 last 57.86) - link 2837 (time 1787395126.44 total 50.03 last 60.14) - link 3424 (time 1787395136.46 total 60.04 last 58.62) - link 3980 (time 1787395146.46 total 70.05 last 55.57) - link 4452 (time 1787395156.49 total 80.08 last 47.07) - link 4964 (time 1787395166.50 total 90.09 last 51.16) - link 5486 (time 1787395176.51 total 100.10 last 52.13) - link 6069 (time 1787395186.54 total 110.12 last 58.16) - link 6668 (time 1787395196.54 total 120.13 last 59.85) - link 7256 (time 1787395206.55 total 130.13 last 58.78) - link 7836 (time 1787395216.55 total 140.14 last 57.97) - link 8415 (time 1787395226.56 total 150.14 last 57.88) - link 9006 (time 1787395236.56 total 160.14 last 59.10) - link 9476 (time 1787395246.56 total 170.14 last 47.00) - link 10000 (time 1787395256.24 total 179.82 last 54.13) - link 10527 (time 1787395266.25 total 189.84 last 52.62) - link 11037 (time 1787395276.30 total 199.89 last 50.75) - link 11534 (time 1787395286.32 total 209.90 last 49.63) - link 12025 (time 1787395296.32 total 219.91 last 49.07) - link 12499 (time 1787395306.33 total 229.92 last 47.34) - link 13043 (time 1787395316.33 total 239.92 last 54.40) - link 13630 (time 1787395326.35 total 249.93 last 58.63) - link 14140 (time 1787395336.35 total 259.94 last 50.99) - link 14689 (time 1787395346.35 total 269.94 last 54.89) - link 15287 (time 1787395356.37 total 279.95 last 59.71) - link 15803 (time 1787395366.38 total 289.96 last 51.55) - link 16358 (time 1787395376.39 total 299.98 last 55.42) - link 16820 (time 1787395386.40 total 309.99 last 46.13) - link 17303 (time 1787395396.42 total 320.01 last 48.22) - link 17854 (time 1787395406.43 total 330.01 last 55.07) - link 18355 (time 1787395416.44 total 340.03 last 50.04) - link 18899 (time 1787395426.45 total 350.04 last 54.33) - link 19377 (time 1787395436.45 total 360.04 last 47.80) - link 19880 (time 1787395446.46 total 370.05 last 50.25) total: 20000 link in 372.81 seconds: 53.65 ops/second - link 506 (time 1787395086.01 total 10.02 last 50.52) - link 1035 (time 1787395096.03 total 20.04 last 52.79) - link 1643 (time 1787395106.03 total 30.04 last 60.79) - link 2236 (time 1787395116.03 total 40.04 last 59.28) - link 2831 (time 1787395126.04 total 50.04 last 59.48) - link 3409 (time 1787395136.04 total 60.04 last 57.80) - link 3971 (time 1787395146.05 total 70.06 last 56.12) - link 4443 (time 1787395156.06 total 80.07 last 47.15) - link 4965 (time 1787395166.08 total 90.08 last 52.13) - link 5489 (time 1787395176.09 total 100.09 last 52.35) - link 6093 (time 1787395186.10 total 110.10 last 60.34) - link 6691 (time 1787395196.12 total 120.13 last 59.64) - link 7299 (time 1787395206.13 total 130.13 last 60.79) - link 7870 (time 1787395216.13 total 140.14 last 57.07) - link 8451 (time 1787395226.14 total 150.14 last 58.07) - link 9052 (time 1787395236.15 total 160.16 last 59.98) - link 9526 (time 1787395246.16 total 170.17 last 47.35) - link 10000 (time 1787395255.12 total 179.13 last 52.92) - link 10545 (time 1787395265.13 total 189.14 last 54.46) - link 11035 (time 1787395275.16 total 199.16 last 48.87) - link 11519 (time 1787395285.16 total 209.17 last 48.36) - link 12001 (time 1787395295.18 total 219.18 last 48.14) - link 12493 (time 1787395305.18 total 229.19 last 49.16) - link 13022 (time 1787395315.19 total 239.20 last 52.87) - link 13609 (time 1787395325.20 total 249.21 last 58.62) - link 14140 (time 1787395335.21 total 259.22 last 53.05) - link 14675 (time 1787395345.22 total 269.23 last 53.45) - link 15274 (time 1787395355.23 total 279.24 last 59.84) - link 15833 (time 1787395365.24 total 289.25 last 55.85) - link 16403 (time 1787395375.25 total 299.26 last 56.95) - link 16883 (time 1787395385.26 total 309.27 last 47.93) - link 17374 (time 1787395395.28 total 319.28 last 49.03) - link 17915 (time 1787395405.30 total 329.31 last 53.97) - link 18399 (time 1787395415.31 total 339.32 last 48.37) - link 18958 (time 1787395425.33 total 349.34 last 55.78) - link 19447 (time 1787395435.33 total 359.34 last 48.89) - link 19967 (time 1787395445.35 total 369.36 last 51.92) - link 20352 (time 1787395455.37 total 379.38 last 38.41) - link 20740 (time 1787395465.40 total 389.40 last 38.70) - link 21138 (time 1787395475.42 total 399.42 last 39.73) - link 21525 (time 1787395485.45 total 409.46 last 38.55) - link 21922 (time 1787395495.48 total 419.49 last 39.58) - link 22284 (time 1787395505.49 total 429.50 last 36.17) - link 22655 (time 1787395515.50 total 439.51 last 37.05) - link 23038 (time 1787395525.51 total 449.51 last 38.29) - link 23421 (time 1787395535.51 total 459.52 last 38.28) - link 23813 (time 1787395545.53 total 469.53 last 39.15) - link 24190 (time 1787395555.53 total 479.54 last 37.67) - link 24585 (time 1787395565.54 total 489.54 last 39.48) - link 24979 (time 1787395575.54 total 499.55 last 39.40) - link 25353 (time 1787395585.56 total 509.57 last 37.31) - link 25725 (time 1787395595.58 total 519.59 last 37.13) - link 26086 (time 1787395605.58 total 529.59 last 36.09) - link 26431 (time 1787395615.61 total 539.62 last 34.40) - link 26712 (time 1787395625.63 total 549.64 last 28.05) - link 27031 (time 1787395635.66 total 559.67 last 31.80) - link 27400 (time 1787395645.67 total 569.68 last 36.86) - link 27759 (time 1787395655.71 total 579.71 last 35.78) - link 28132 (time 1787395665.72 total 589.73 last 37.24) - link 28451 (time 1787395675.73 total 599.73 last 31.88) - link 28797 (time 1787395685.75 total 609.76 last 34.52) - link 29162 (time 1787395695.76 total 619.77 last 36.45) - link 29531 (time 1787395705.78 total 629.79 last 36.84) - link 29933 (time 1787395715.80 total 639.81 last 40.10) - link 30303 (time 1787395725.81 total 649.82 last 36.97) - link 30663 (time 1787395735.82 total 659.82 last 35.98) - link 31034 (time 1787395745.84 total 669.85 last 37.02) - link 31423 (time 1787395755.86 total 679.87 last 38.82) - link 31776 (time 1787395765.88 total 689.89 last 35.23) - link 32095 (time 1787395775.88 total 699.89 last 31.90) - link 32489 (time 1787395785.88 total 709.89 last 39.39) - link 32856 (time 1787395795.88 total 719.89 last 36.69) - link 33199 (time 1787395805.89 total 729.89 last 34.29) - link 33571 (time 1787395815.91 total 739.92 last 37.10) - link 33929 (time 1787395825.93 total 749.93 last 35.75) - link 34287 (time 1787395835.93 total 759.93 last 35.80) - link 34637 (time 1787395845.98 total 769.99 last 34.82) - link 34996 (time 1787395855.98 total 779.99 last 35.89) - link 35346 (time 1787395866.00 total 790.00 last 34.94) - link 35691 (time 1787395876.02 total 800.02 last 34.43) - link 36047 (time 1787395886.02 total 810.02 last 35.60) - link 36380 (time 1787395896.04 total 820.04 last 33.24) - link 36686 (time 1787395906.06 total 830.06 last 30.54) - link 37076 (time 1787395916.06 total 840.07 last 38.98) - link 37443 (time 1787395926.07 total 850.07 last 36.68) - link 37818 (time 1787395936.07 total 860.08 last 37.48) - link 38186 (time 1787395946.09 total 870.10 last 36.72) - link 38601 (time 1787395956.09 total 880.10 last 41.50) - link 38957 (time 1787395966.10 total 890.11 last 35.56) - link 39320 (time 1787395976.12 total 900.13 last 36.23) - link 39689 (time 1787395986.13 total 910.14 last 36.88) total: 40000 link in 917.72 seconds: 43.59 ops/second Stopping clients: oleg414-client.virtnet /mnt/lustre (opts:) Stopping client oleg414-client.virtnet /mnt/lustre opts: Stopping clients: oleg414-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg414-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg414-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg414-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg414-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg414-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 132 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 149 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 149 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 153 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 155 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 155 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 156 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 156 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 157 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 157 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 158 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 159 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 160 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 161 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 161 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 162 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 162 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 163 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 163 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 164 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 164 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 165 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 165 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 166 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 166 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 167 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 167 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 168 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 169 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 169 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 170 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 170 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 171 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 171 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 172 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 172 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 173 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 173 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 174 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 174 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 175 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 175 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 176 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 176 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 177 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 177 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 178 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 178 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 179 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 179 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 180 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 180 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 181 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 181 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 182 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 182 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 183 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 183 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 184 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 184 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 186 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 187 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 188 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 193 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 194 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 194 badness 1 to 3 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 1596 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1596 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1633 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1633 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1634 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1634 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1635 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1635 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1636 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1636 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1637 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 1638 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1638 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1639 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1639 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1640 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1640 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1641 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1641 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1642 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1642 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1643 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 364k/440k (128k/237k), time: 0.06/ 0.00/ 0.01 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 17.36MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/281 Pass 2: Checking directory structure Pass 2: Memory used: 364k/0k (82k/283k), time: 0.79/ 0.15/ 0.06 Pass 2: I/O read: 25MB, write: 0MB, rate: 31.76MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 364k/0k (83k/282k), time: 0.89/ 0.15/ 0.07 Pass 3: Memory used: 364k/0k (81k/284k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 364k/0k (78k/287k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 3703.70MB/s Pass 5: Checking group summary information Pass 5: Memory used: 504k/0k (77k/428k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 518.67MB/s 276 inodes used (8.85%, out of 3120) 2 non-contiguous files (0.7%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 Extent depth histogram: 203 11403 blocks used (22.81%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 504k/0k (81k/424k), time: 0.90/ 0.15/ 0.07 I/O read: 25MB, write: 0MB, rate: 27.74MB/s Stopping clients: oleg414-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg414-client.virtnet /mnt/lustre2 (opts:-f) oleg414-server: oleg414-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg414-server' oleg414-server: oleg414-server.virtnet: executing load_modules_local oleg414-server: Loading modules from /home/green/git/lustre-release/lustre oleg414-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg414-server: detected 4 online CPUs by sysfs oleg414-server: MODOPTS_LIBCFS= oleg414-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg414-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg414-server: oleg414-server.virtnet: executing set_default_debug -1 all pdsh@oleg414-client: oleg414-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg414-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg414-server: oleg414-server.virtnet: executing set_default_debug -1 all pdsh@oleg414-client: oleg414-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg414-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg414-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg414-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg414-server: oleg414-server.virtnet: executing set_default_debug -1 all pdsh@oleg414-client: oleg414-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg414-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg414-server: oleg414-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg414-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg414-server: oleg414-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg414-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg414-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg414-server stop mds service on oleg414-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg414-server stop mds service on oleg414-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg414-server