== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 09:05:18 (1787144718) oleg336-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg336-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg336-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg336-client: oleg336-server: ssh exited with exit code 2 oleg336-server: oleg336-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg336-server' oleg336-server: oleg336-server.virtnet: executing load_modules_local oleg336-server: Loading modules from /home/green/git/lustre-release/lustre oleg336-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg336-server: detected 4 online CPUs by sysfs oleg336-server: MODOPTS_LIBCFS= oleg336-server: Force libcfs to create 2 CPU partitions oleg336-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg336-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg336-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg336-server' oleg336-server: oleg336-server.virtnet: executing load_modules_local oleg336-server: Loading modules from /home/green/git/lustre-release/lustre oleg336-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg336-server: detected 4 online CPUs by sysfs oleg336-server: MODOPTS_LIBCFS= oleg336-server: Force libcfs to create 2 CPU partitions Permanent disk data: Device: /dev/mapper/mds1_flakey Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg336-server: oleg336-server.virtnet: executing set_default_debug -1 all pdsh@oleg336-client: oleg336-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg336-server: oleg336-server.virtnet: executing set_default_debug -1 all pdsh@oleg336-client: oleg336-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg336-client.virtnet: -o user_xattr,flock 192.168.203.136@tcp:/lustre /mnt/lustre Starting client oleg336-client.virtnet: -o user_xattr,flock 192.168.203.136@tcp:/lustre /mnt/lustre Started clients oleg336-client.virtnet: 192.168.203.136@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg336-client.virtnet: -o user_xattr,flock 192.168.203.136@tcp:/lustre /mnt/lustre2 Starting client oleg336-client.virtnet: -o user_xattr,flock 192.168.203.136@tcp:/lustre /mnt/lustre2 Started clients oleg336-client.virtnet: 192.168.203.136@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 174583 174598 to complete - link 506 (time 1787144838.68 total 10.01 last 50.56) - link 1059 (time 1787144848.70 total 20.02 last 55.23) - link 1650 (time 1787144858.71 total 30.03 last 59.02) - link 2252 (time 1787144868.72 total 40.05 last 60.12) - link 2829 (time 1787144878.73 total 50.05 last 57.67) - link 3414 (time 1787144888.73 total 60.06 last 58.46) - link 3942 (time 1787144898.74 total 70.06 last 52.78) - link 4499 (time 1787144908.75 total 80.07 last 55.62) - link 5018 (time 1787144918.76 total 90.09 last 51.84) - link 5613 (time 1787144928.76 total 100.09 last 59.49) - link 6144 (time 1787144938.76 total 110.09 last 53.10) - link 6586 (time 1787144948.77 total 120.09 last 44.17) - link 7097 (time 1787144958.78 total 130.10 last 51.06) - link 7666 (time 1787144968.82 total 140.15 last 56.65) - link 8170 (time 1787144978.86 total 150.19 last 50.20) - link 8770 (time 1787144988.89 total 160.21 last 59.86) - link 9309 (time 1787144998.91 total 170.23 last 53.78) - link 9787 (time 1787145008.92 total 180.25 last 47.74) - link 10000 (time 1787145013.30 total 184.62 last 48.70) - link 10511 (time 1787145023.30 total 194.62 last 51.08) - link 10960 (time 1787145033.31 total 204.63 last 44.87) - link 11495 (time 1787145043.32 total 214.64 last 53.46) - link 12053 (time 1787145053.32 total 224.65 last 55.76) - link 12624 (time 1787145063.33 total 234.66 last 57.04) - link 13188 (time 1787145073.35 total 244.67 last 56.32) - link 13719 (time 1787145083.35 total 254.68 last 53.07) - link 14282 (time 1787145093.36 total 264.69 last 56.24) - link 14774 (time 1787145103.38 total 274.71 last 49.11) - link 15301 (time 1787145113.39 total 284.71 last 52.66) - link 15820 (time 1787145123.40 total 294.72 last 51.87) - link 16384 (time 1787145133.42 total 304.74 last 56.27) - link 16935 (time 1787145143.43 total 314.76 last 55.02) - link 17524 (time 1787145153.44 total 324.76 last 58.87) - link 18020 (time 1787145163.46 total 334.79 last 49.48) - link 18612 (time 1787145173.47 total 344.79 last 59.16) - link 19160 (time 1787145183.49 total 354.82 last 54.67) - link 19776 (time 1787145193.50 total 364.82 last 61.55) total: 20000 link in 368.34 seconds: 54.30 ops/second - link 505 (time 1787144838.55 total 10.01 last 50.46) - link 1049 (time 1787144848.55 total 20.01 last 54.38) - link 1625 (time 1787144858.55 total 30.01 last 57.58) - link 2231 (time 1787144868.58 total 40.04 last 60.44) - link 2803 (time 1787144878.59 total 50.05 last 57.17) - link 3405 (time 1787144888.60 total 60.05 last 60.15) - link 3957 (time 1787144898.60 total 70.06 last 55.17) - link 4530 (time 1787144908.61 total 80.07 last 57.25) - link 5046 (time 1787144918.63 total 90.09 last 51.49) - link 5653 (time 1787144928.65 total 100.11 last 60.60) - link 6178 (time 1787144938.65 total 110.11 last 52.48) - link 6612 (time 1787144948.66 total 120.11 last 43.38) - link 7112 (time 1787144958.67 total 130.12 last 49.95) - link 7684 (time 1787144968.68 total 140.14 last 57.13) - link 8190 (time 1787144978.69 total 150.15 last 50.55) - link 8771 (time 1787144988.71 total 160.17 last 57.99) - link 9328 (time 1787144998.72 total 170.18 last 55.61) - link 9799 (time 1787145008.73 total 180.18 last 47.09) - link 10000 (time 1787145013.14 total 184.59 last 45.58) - link 10501 (time 1787145023.16 total 194.61 last 50.00) - link 10949 (time 1787145033.16 total 204.62 last 44.78) - link 11485 (time 1787145043.17 total 214.63 last 53.55) - link 12036 (time 1787145053.17 total 224.63 last 55.09) - link 12610 (time 1787145063.17 total 234.63 last 57.40) - link 13162 (time 1787145073.18 total 244.64 last 55.17) - link 13677 (time 1787145083.18 total 254.64 last 51.47) - link 14231 (time 1787145093.19 total 264.65 last 55.35) - link 14704 (time 1787145103.19 total 274.65 last 47.29) - link 15209 (time 1787145113.21 total 284.67 last 50.40) - link 15729 (time 1787145123.23 total 294.69 last 51.93) - link 16303 (time 1787145133.27 total 304.73 last 57.17) - link 16857 (time 1787145143.28 total 314.74 last 55.35) - link 17452 (time 1787145153.29 total 324.75 last 59.42) - link 17944 (time 1787145163.30 total 334.75 last 49.17) - link 18523 (time 1787145173.32 total 344.78 last 57.77) - link 19071 (time 1787145183.33 total 354.79 last 54.74) - link 19696 (time 1787145193.33 total 364.79 last 62.46) - link 20000 (time 1787145198.57 total 370.03 last 58.02) - link 20392 (time 1787145208.59 total 380.05 last 39.15) - link 20774 (time 1787145218.60 total 390.06 last 38.14) - link 21141 (time 1787145228.63 total 400.09 last 36.60) - link 21523 (time 1787145238.64 total 410.10 last 38.16) - link 21917 (time 1787145248.66 total 420.12 last 39.32) - link 22321 (time 1787145258.67 total 430.13 last 40.36) - link 22731 (time 1787145268.67 total 440.13 last 40.99) - link 23136 (time 1787145278.67 total 450.13 last 40.50) - link 23544 (time 1787145288.71 total 460.17 last 40.65) - link 23939 (time 1787145298.72 total 470.18 last 39.47) - link 24336 (time 1787145308.75 total 480.20 last 39.59) - link 24728 (time 1787145318.75 total 490.21 last 39.20) - link 25121 (time 1787145328.77 total 500.23 last 39.22) - link 25499 (time 1787145338.79 total 510.25 last 37.71) - link 25890 (time 1787145348.82 total 520.28 last 38.98) - link 26294 (time 1787145358.83 total 530.29 last 40.36) - link 26700 (time 1787145368.85 total 540.31 last 40.52) - link 27048 (time 1787145378.86 total 550.32 last 34.78) - link 27461 (time 1787145388.86 total 560.32 last 41.29) - link 27880 (time 1787145398.87 total 570.33 last 41.87) - link 28302 (time 1787145408.88 total 580.34 last 42.12) - link 28717 (time 1787145418.89 total 590.35 last 41.49) - link 29082 (time 1787145428.90 total 600.36 last 36.45) - link 29473 (time 1787145438.90 total 610.36 last 39.09) - link 29889 (time 1787145448.91 total 620.37 last 41.55) - link 30000 (time 1787145451.96 total 623.42 last 36.42) - link 30396 (time 1787145461.97 total 633.43 last 39.58) - link 30792 (time 1787145471.97 total 643.43 last 39.59) - link 31236 (time 1787145481.99 total 653.45 last 44.31) - link 31702 (time 1787145492.01 total 663.47 last 46.51) - link 32122 (time 1787145502.02 total 673.48 last 41.96) - link 32526 (time 1787145512.03 total 683.49 last 40.36) - link 32947 (time 1787145522.05 total 693.51 last 42.00) - link 33361 (time 1787145532.06 total 703.52 last 41.36) - link 33717 (time 1787145542.06 total 713.52 last 35.59) - link 34125 (time 1787145552.08 total 723.54 last 40.75) - link 34520 (time 1787145562.10 total 733.56 last 39.41) - link 34902 (time 1787145572.12 total 743.58 last 38.12) - link 35296 (time 1787145582.13 total 753.59 last 39.36) - link 35660 (time 1787145592.16 total 763.62 last 36.28) - link 36057 (time 1787145602.18 total 773.63 last 39.64) - link 36478 (time 1787145612.18 total 783.64 last 42.06) - link 36862 (time 1787145622.19 total 793.65 last 38.38) - link 37247 (time 1787145632.20 total 803.66 last 38.46) - link 37669 (time 1787145642.21 total 813.67 last 42.16) - link 38022 (time 1787145652.23 total 823.69 last 35.24) - link 38408 (time 1787145662.24 total 833.70 last 38.56) - link 38799 (time 1787145672.25 total 843.71 last 39.03) - link 39156 (time 1787145682.27 total 853.73 last 35.65) - link 39521 (time 1787145692.27 total 863.73 last 36.50) - link 39912 (time 1787145702.28 total 873.74 last 39.05) total: 40000 link in 875.87 seconds: 45.67 ops/second Stopping clients: oleg336-client.virtnet /mnt/lustre (opts:) Stopping client oleg336-client.virtnet /mnt/lustre opts: Stopping clients: oleg336-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg336-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg336-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg336-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg336-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg336-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 147 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 149 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 153 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 158 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 159 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 161 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 161 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 162 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 162 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 163 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 163 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 164 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 164 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 165 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 165 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 166 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 166 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 167 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 167 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 168 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 168 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 169 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 169 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 170 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 170 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 171 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 171 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 172 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 172 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 173 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 173 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 174 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 174 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 175 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 175 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 176 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 176 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 177 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 177 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 178 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 179 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 179 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 180 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 180 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 181 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 181 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 182 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 182 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 183 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 183 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 184 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 184 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 185 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 185 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 186 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 186 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 187 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 187 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 188 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 188 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 189 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 189 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 190 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 190 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 191 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 191 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 192 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 192 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 193 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 193 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 194 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 194 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 196 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 197 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 198 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 203 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 203 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 204 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 204 badness 1 to 3 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 1596 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1596 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1633 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 364k/440k (129k/236k), time: 0.02/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 52.67MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/281 Pass 2: Checking directory structure Pass 2: Memory used: 364k/0k (84k/281k), time: 0.70/ 0.16/ 0.05 Pass 2: I/O read: 25MB, write: 0MB, rate: 35.74MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 364k/0k (84k/281k), time: 0.75/ 0.17/ 0.06 Pass 3: Memory used: 364k/0k (83k/282k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 364k/0k (78k/287k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 2857.14MB/s Pass 5: Checking group summary information Pass 5: Memory used: 504k/0k (77k/428k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 293.51MB/s 276 inodes used (8.85%, out of 3120) 2 non-contiguous files (0.7%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 Extent depth histogram: 203 11406 blocks used (22.81%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 504k/0k (81k/424k), time: 0.75/ 0.17/ 0.06 I/O read: 25MB, write: 0MB, rate: 33.19MB/s Stopping clients: oleg336-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg336-client.virtnet /mnt/lustre2 (opts:-f) oleg336-server: oleg336-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg336-server' oleg336-server: oleg336-server.virtnet: executing load_modules_local oleg336-server: Loading modules from /home/green/git/lustre-release/lustre oleg336-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg336-server: detected 4 online CPUs by sysfs oleg336-server: MODOPTS_LIBCFS= oleg336-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg336-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg336-server: oleg336-server.virtnet: executing set_default_debug -1 all pdsh@oleg336-client: oleg336-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg336-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg336-server: oleg336-server.virtnet: executing set_default_debug -1 all pdsh@oleg336-client: oleg336-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg336-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg336-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg336-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg336-server: oleg336-server.virtnet: executing set_default_debug -1 all pdsh@oleg336-client: oleg336-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg336-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg336-server: oleg336-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg336-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg336-server: oleg336-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg336-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg336-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg336-server stop mds service on oleg336-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg336-server stop mds service on oleg336-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg336-server