== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 11:42:36 (1786635756) oleg117-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg117-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg117-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg117-client: oleg117-server: ssh exited with exit code 2 oleg117-server: oleg117-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg117-server' oleg117-server: oleg117-server.virtnet: executing load_modules_local oleg117-server: Loading modules from /home/green/git/lustre-release/lustre oleg117-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg117-server: detected 4 online CPUs by sysfs oleg117-server: MODOPTS_LIBCFS= oleg117-server: Force libcfs to create 2 CPU partitions oleg117-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg117-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg117-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg117-server' oleg117-server: oleg117-server.virtnet: executing load_modules_local oleg117-server: Loading modules from /home/green/git/lustre-release/lustre oleg117-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg117-server: detected 4 online CPUs by sysfs oleg117-server: MODOPTS_LIBCFS= oleg117-server: Force libcfs to create 2 CPU partitions Permanent disk data: Device: /dev/mapper/mds1_flakey Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg117-client.virtnet: -o user_xattr,flock 192.168.201.117@tcp:/lustre /mnt/lustre Starting client oleg117-client.virtnet: -o user_xattr,flock 192.168.201.117@tcp:/lustre /mnt/lustre Started clients oleg117-client.virtnet: 192.168.201.117@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg117-client.virtnet: -o user_xattr,flock 192.168.201.117@tcp:/lustre /mnt/lustre2 Starting client oleg117-client.virtnet: -o user_xattr,flock 192.168.201.117@tcp:/lustre /mnt/lustre2 Started clients oleg117-client.virtnet: 192.168.201.117@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 168504 168519 to complete - link 614 (time 1786635881.70 total 10.01 last 61.36) - link 1158 (time 1786635891.71 total 20.01 last 54.38) - link 1751 (time 1786635901.71 total 30.02 last 59.26) - link 2396 (time 1786635911.72 total 40.03 last 64.44) - link 3058 (time 1786635921.74 total 50.04 last 66.11) - link 3742 (time 1786635931.74 total 60.04 last 68.39) - link 4388 (time 1786635941.74 total 70.04 last 64.58) - link 5049 (time 1786635951.76 total 80.06 last 65.98) - link 5678 (time 1786635961.76 total 90.07 last 62.87) - link 6238 (time 1786635971.77 total 100.08 last 55.94) - link 6844 (time 1786635981.79 total 110.09 last 60.51) - link 7404 (time 1786635991.80 total 120.10 last 55.94) - link 7999 (time 1786636001.82 total 130.12 last 59.39) - link 8616 (time 1786636011.84 total 140.14 last 61.59) - link 9205 (time 1786636021.86 total 150.17 last 58.75) - link 9722 (time 1786636031.87 total 160.17 last 51.66) - link 10000 (time 1786636036.38 total 164.69 last 61.60) - link 10563 (time 1786636046.39 total 174.69 last 56.26) - link 11166 (time 1786636056.40 total 184.70 last 60.23) - link 11710 (time 1786636066.40 total 194.71 last 54.38) - link 12333 (time 1786636076.41 total 204.72 last 62.26) - link 12934 (time 1786636086.41 total 214.72 last 60.08) - link 13442 (time 1786636096.42 total 224.72 last 50.80) - link 14024 (time 1786636106.42 total 234.72 last 58.18) - link 14606 (time 1786636116.42 total 244.73 last 58.17) - link 15226 (time 1786636126.43 total 254.74 last 61.95) - link 15838 (time 1786636136.45 total 264.76 last 61.07) - link 16420 (time 1786636146.46 total 274.76 last 58.18) - link 17099 (time 1786636156.47 total 284.77 last 67.82) - link 17756 (time 1786636166.48 total 294.78 last 65.64) - link 18297 (time 1786636176.49 total 304.79 last 54.05) - link 18942 (time 1786636186.52 total 314.82 last 64.29) - link 19576 (time 1786636196.54 total 324.84 last 63.30) total: 20000 link in 331.49 seconds: 60.33 ops/second - link 614 (time 1786635881.21 total 10.01 last 61.34) - link 1164 (time 1786635891.21 total 20.01 last 54.98) - link 1745 (time 1786635901.22 total 30.02 last 58.08) - link 2402 (time 1786635911.23 total 40.03 last 65.62) - link 3064 (time 1786635921.23 total 50.03 last 66.19) - link 3746 (time 1786635931.24 total 60.04 last 68.12) - link 4418 (time 1786635941.24 total 70.05 last 67.18) - link 5085 (time 1786635951.25 total 80.05 last 66.67) - link 5734 (time 1786635961.25 total 90.05 last 64.90) - link 6281 (time 1786635971.26 total 100.06 last 54.67) - link 6904 (time 1786635981.26 total 110.06 last 62.26) - link 7450 (time 1786635991.26 total 120.06 last 54.59) - link 8025 (time 1786636001.27 total 130.07 last 57.47) - link 8672 (time 1786636011.28 total 140.08 last 64.61) - link 9268 (time 1786636021.30 total 150.10 last 59.50) - link 9776 (time 1786636031.32 total 160.12 last 50.71) - link 10000 (time 1786636034.91 total 163.71 last 62.40) - link 10527 (time 1786636044.93 total 173.73 last 52.60) - link 11147 (time 1786636054.95 total 183.75 last 61.87) - link 11706 (time 1786636064.96 total 193.76 last 55.81) - link 12329 (time 1786636074.96 total 203.76 last 62.30) - link 12945 (time 1786636084.99 total 213.79 last 61.45) - link 13454 (time 1786636095.00 total 223.80 last 50.83) - link 13957 (time 1786636105.00 total 233.81 last 50.29) - link 14614 (time 1786636115.01 total 243.81 last 65.68) - link 15239 (time 1786636125.01 total 253.82 last 62.46) - link 15859 (time 1786636135.04 total 263.84 last 61.85) - link 16455 (time 1786636145.05 total 273.85 last 59.51) - link 17106 (time 1786636155.06 total 283.86 last 65.05) - link 17733 (time 1786636165.06 total 293.86 last 62.68) - link 18324 (time 1786636175.07 total 303.87 last 59.04) - link 18952 (time 1786636185.09 total 313.89 last 62.71) - link 19567 (time 1786636195.11 total 323.91 last 61.38) - link 20000 (time 1786636201.52 total 330.32 last 67.56) - link 20438 (time 1786636211.54 total 340.34 last 43.70) - link 20862 (time 1786636221.56 total 350.36 last 42.31) - link 21338 (time 1786636231.56 total 360.37 last 47.59) - link 21793 (time 1786636241.58 total 370.39 last 45.41) - link 22252 (time 1786636251.59 total 380.39 last 45.87) - link 22675 (time 1786636261.62 total 390.42 last 42.18) - link 23138 (time 1786636271.63 total 400.43 last 46.25) - link 23659 (time 1786636281.67 total 410.47 last 51.88) - link 24078 (time 1786636291.68 total 420.49 last 41.84) - link 24518 (time 1786636301.69 total 430.49 last 43.97) - link 24953 (time 1786636311.70 total 440.50 last 43.47) - link 25402 (time 1786636321.71 total 450.51 last 44.85) - link 25805 (time 1786636331.72 total 460.52 last 40.27) - link 26299 (time 1786636341.74 total 470.54 last 49.29) - link 26574 (time 1786636351.76 total 480.56 last 27.45) - link 26976 (time 1786636361.77 total 490.57 last 40.13) - link 27378 (time 1786636371.78 total 500.58 last 40.16) - link 27822 (time 1786636381.79 total 510.59 last 44.38) - link 28224 (time 1786636391.79 total 520.59 last 40.17) - link 28644 (time 1786636401.82 total 530.62 last 41.88) - link 29023 (time 1786636411.85 total 540.65 last 37.80) - link 29476 (time 1786636421.86 total 550.66 last 45.26) - link 29884 (time 1786636431.88 total 560.68 last 40.71) - link 30000 (time 1786636434.64 total 563.44 last 42.02) - link 30341 (time 1786636444.65 total 573.45 last 34.07) - link 30759 (time 1786636454.67 total 583.47 last 41.72) - link 31211 (time 1786636464.67 total 593.48 last 45.18) - link 31733 (time 1786636474.68 total 603.48 last 52.16) - link 32154 (time 1786636484.70 total 613.50 last 42.02) - link 32550 (time 1786636494.72 total 623.52 last 39.53) - link 32966 (time 1786636504.73 total 633.53 last 41.57) - link 33492 (time 1786636514.75 total 643.55 last 52.47) - link 33962 (time 1786636524.77 total 653.57 last 46.91) - link 34522 (time 1786636534.78 total 663.58 last 55.96) - link 35026 (time 1786636544.78 total 673.58 last 50.38) - link 35520 (time 1786636554.79 total 683.59 last 49.37) - link 36031 (time 1786636564.80 total 693.60 last 51.02) - link 36516 (time 1786636574.82 total 703.62 last 48.42) - link 36937 (time 1786636584.84 total 713.64 last 42.02) - link 37374 (time 1786636594.84 total 723.64 last 43.68) - link 37831 (time 1786636604.86 total 733.66 last 45.62) - link 38308 (time 1786636614.87 total 743.67 last 47.67) - link 38748 (time 1786636624.88 total 753.68 last 43.95) - link 39175 (time 1786636634.89 total 763.70 last 42.62) - link 39620 (time 1786636644.91 total 773.71 last 44.42) total: 40000 link in 781.82 seconds: 51.16 ops/second Stopping clients: oleg117-client.virtnet /mnt/lustre (opts:) Stopping client oleg117-client.virtnet /mnt/lustre opts: Stopping clients: oleg117-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg117-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg117-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg117-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg117-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg117-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 153 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 155 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 155 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 156 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 156 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 157 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 157 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 158 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 159 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 160 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 161 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 161 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 162 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 162 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 163 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 163 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 164 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 164 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 165 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 165 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 166 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 166 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 167 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 167 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 168 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 168 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 169 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 169 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 170 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 171 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 171 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 172 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 172 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 173 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 173 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 174 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 174 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 175 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 175 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 176 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 176 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 177 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 177 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 178 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 178 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 179 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 179 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 180 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 180 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 181 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 181 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 182 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 182 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 183 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 183 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 184 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 184 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 185 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 185 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 186 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 186 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 188 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 189 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 190 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 195 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 195 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 196 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 196 badness 1 to 3 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 1596 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1596 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1633 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1633 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1634 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1634 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1635 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 1636 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1636 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1637 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1637 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1638 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1638 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1639 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1639 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1640 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1640 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1641 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 364k/440k (128k/237k), time: 0.03/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 38.33MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/282 Pass 2: Checking directory structure Pass 2: Memory used: 364k/0k (83k/282k), time: 0.60/ 0.16/ 0.05 Pass 2: I/O read: 25MB, write: 0MB, rate: 41.73MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 364k/0k (83k/282k), time: 0.64/ 0.16/ 0.05 Pass 3: Memory used: 364k/0k (82k/283k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 364k/0k (78k/287k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 3952.57MB/s Pass 5: Checking group summary information Pass 5: Memory used: 504k/0k (77k/428k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 402.58MB/s 276 inodes used (8.85%, out of 3120) 1 non-contiguous file (0.4%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 Extent depth histogram: 203 11405 blocks used (22.81%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 504k/0k (81k/424k), time: 0.65/ 0.17/ 0.05 I/O read: 25MB, write: 0MB, rate: 38.61MB/s Stopping clients: oleg117-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg117-client.virtnet /mnt/lustre2 (opts:-f) oleg117-server: oleg117-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg117-server' oleg117-server: oleg117-server.virtnet: executing load_modules_local oleg117-server: Loading modules from /home/green/git/lustre-release/lustre oleg117-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg117-server: detected 4 online CPUs by sysfs oleg117-server: MODOPTS_LIBCFS= oleg117-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg117-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg117-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg117-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg117-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg117-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg117-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg117-server: oleg117-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg117-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg117-server: oleg117-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg117-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg117-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg117-server stop mds service on oleg117-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg117-server stop mds service on oleg117-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg117-server