== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 15:27:28 (1786044448) oleg143-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg143-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg143-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg143-client: oleg143-server: ssh exited with exit code 2 oleg143-server: oleg143-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg143-server' oleg143-server: oleg143-server.virtnet: executing load_modules_local oleg143-server: Loading modules from /home/green/git/lustre-release/lustre oleg143-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg143-server: detected 4 online CPUs by sysfs oleg143-server: MODOPTS_LIBCFS= oleg143-server: Force libcfs to create 2 CPU partitions oleg143-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg143-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg143-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg143-server' oleg143-server: oleg143-server.virtnet: executing load_modules_local oleg143-server: Loading modules from /home/green/git/lustre-release/lustre oleg143-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg143-server: detected 4 online CPUs by sysfs oleg143-server: MODOPTS_LIBCFS= oleg143-server: Force libcfs to create 2 CPU partitions Permanent disk data: Device: /dev/mapper/mds1_flakey Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg143-server: oleg143-server.virtnet: executing set_default_debug -1 all pdsh@oleg143-client: oleg143-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg143-server: oleg143-server.virtnet: executing set_default_debug -1 all pdsh@oleg143-client: oleg143-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg143-client.virtnet: -o user_xattr,flock 192.168.201.143@tcp:/lustre /mnt/lustre Starting client oleg143-client.virtnet: -o user_xattr,flock 192.168.201.143@tcp:/lustre /mnt/lustre Started clients oleg143-client.virtnet: 192.168.201.143@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg143-client.virtnet: -o user_xattr,flock 192.168.201.143@tcp:/lustre /mnt/lustre2 Starting client oleg143-client.virtnet: -o user_xattr,flock 192.168.201.143@tcp:/lustre /mnt/lustre2 Started clients oleg143-client.virtnet: 192.168.201.143@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 174575 174590 to complete - link 641 (time 1786044571.48 total 10.01 last 64.06) - link 1290 (time 1786044581.48 total 20.01 last 64.85) - link 1909 (time 1786044591.49 total 30.02 last 61.88) - link 2552 (time 1786044601.50 total 40.03 last 64.23) - link 3174 (time 1786044611.52 total 50.04 last 62.09) - link 3658 (time 1786044621.53 total 60.06 last 48.33) - link 4227 (time 1786044631.56 total 70.09 last 56.71) - link 4778 (time 1786044641.58 total 80.11 last 55.00) - link 5334 (time 1786044651.59 total 90.12 last 55.53) - link 5925 (time 1786044661.60 total 100.13 last 59.06) - link 6509 (time 1786044671.61 total 110.14 last 58.36) - link 7132 (time 1786044681.61 total 120.14 last 62.26) - link 7740 (time 1786044691.62 total 130.15 last 60.76) - link 8292 (time 1786044701.64 total 140.17 last 55.08) - link 8837 (time 1786044711.65 total 150.18 last 54.43) - link 9420 (time 1786044721.67 total 160.20 last 58.22) - link 9982 (time 1786044731.69 total 170.22 last 56.08) - link 10630 (time 1786044741.69 total 180.22 last 64.77) - link 11201 (time 1786044751.70 total 190.23 last 57.06) - link 11797 (time 1786044761.72 total 200.25 last 59.47) - link 12347 (time 1786044771.73 total 210.26 last 54.96) - link 12928 (time 1786044781.73 total 220.26 last 58.07) - link 13502 (time 1786044791.74 total 230.26 last 57.39) - link 14053 (time 1786044801.74 total 240.27 last 55.08) - link 14461 (time 1786044811.75 total 250.28 last 40.77) - link 14902 (time 1786044821.75 total 260.28 last 44.09) - link 15475 (time 1786044831.77 total 270.30 last 57.17) - link 16172 (time 1786044841.79 total 280.32 last 69.59) - link 16792 (time 1786044851.80 total 290.33 last 61.94) - link 17374 (time 1786044861.80 total 300.33 last 58.18) - link 18055 (time 1786044871.81 total 310.34 last 68.06) - link 18656 (time 1786044881.83 total 320.36 last 59.95) - link 19263 (time 1786044891.84 total 330.37 last 60.68) - link 19859 (time 1786044901.84 total 340.37 last 59.60) total: 20000 link in 342.68 seconds: 58.36 ops/second - link 659 (time 1786044571.13 total 10.01 last 65.82) - link 1302 (time 1786044581.14 total 20.02 last 64.27) - link 1924 (time 1786044591.14 total 30.02 last 62.19) - link 2572 (time 1786044601.15 total 40.02 last 64.77) - link 3184 (time 1786044611.16 total 50.04 last 61.12) - link 3667 (time 1786044621.17 total 60.05 last 48.23) - link 4242 (time 1786044631.19 total 70.06 last 57.42) - link 4795 (time 1786044641.20 total 80.07 last 55.25) - link 5348 (time 1786044651.21 total 90.08 last 55.24) - link 5921 (time 1786044661.22 total 100.09 last 57.24) - link 6511 (time 1786044671.22 total 110.10 last 58.96) - link 7119 (time 1786044681.23 total 120.11 last 60.76) - link 7747 (time 1786044691.23 total 130.11 last 62.79) - link 8291 (time 1786044701.25 total 140.13 last 54.30) - link 8843 (time 1786044711.26 total 150.14 last 55.15) - link 9397 (time 1786044721.27 total 160.15 last 55.36) - link 9969 (time 1786044731.28 total 170.16 last 57.14) - link 10626 (time 1786044741.29 total 180.16 last 65.65) - link 11192 (time 1786044751.30 total 190.18 last 56.50) - link 11788 (time 1786044761.32 total 200.20 last 59.52) - link 12358 (time 1786044771.33 total 210.20 last 56.95) - link 12931 (time 1786044781.35 total 220.23 last 57.15) - link 13509 (time 1786044791.36 total 230.24 last 57.74) - link 14068 (time 1786044801.37 total 240.25 last 55.85) - link 14489 (time 1786044811.41 total 250.28 last 41.95) - link 14938 (time 1786044821.43 total 260.31 last 44.80) - link 15500 (time 1786044831.43 total 270.31 last 56.17) - link 16187 (time 1786044841.45 total 280.33 last 68.59) - link 16823 (time 1786044851.46 total 290.34 last 63.54) - link 17383 (time 1786044861.46 total 300.34 last 56.00) - link 18066 (time 1786044871.46 total 310.34 last 68.27) - link 18674 (time 1786044881.47 total 320.34 last 60.78) - link 19285 (time 1786044891.47 total 330.35 last 61.07) - link 19880 (time 1786044901.49 total 340.37 last 59.39) - link 20000 (time 1786044903.80 total 342.68 last 52.00) - link 20406 (time 1786044913.81 total 352.69 last 40.56) - link 20811 (time 1786044923.83 total 362.70 last 40.44) - link 21191 (time 1786044933.85 total 372.73 last 37.91) - link 21623 (time 1786044943.85 total 382.73 last 43.19) - link 22094 (time 1786044953.87 total 392.75 last 47.01) - link 22575 (time 1786044963.89 total 402.76 last 48.04) - link 23021 (time 1786044973.91 total 412.79 last 44.49) - link 23459 (time 1786044983.92 total 422.80 last 43.75) - link 23932 (time 1786044993.94 total 432.82 last 47.21) - link 24366 (time 1786045003.95 total 442.82 last 43.38) - link 24742 (time 1786045014.02 total 452.90 last 37.31) - link 25181 (time 1786045024.02 total 462.90 last 43.90) - link 25670 (time 1786045034.05 total 472.93 last 48.77) - link 26071 (time 1786045044.07 total 482.94 last 40.03) - link 26478 (time 1786045054.09 total 492.97 last 40.61) - link 26917 (time 1786045064.10 total 502.97 last 43.87) - link 27398 (time 1786045074.10 total 512.98 last 48.09) - link 27810 (time 1786045084.11 total 522.98 last 41.17) - link 28286 (time 1786045094.11 total 532.98 last 47.59) - link 28744 (time 1786045104.11 total 542.99 last 45.78) - link 29199 (time 1786045114.12 total 553.00 last 45.46) - link 29627 (time 1786045124.14 total 563.01 last 42.74) - link 30000 (time 1786045133.35 total 572.23 last 40.47) - link 30388 (time 1786045143.37 total 582.25 last 38.73) - link 30819 (time 1786045153.37 total 592.25 last 43.08) - link 31229 (time 1786045163.38 total 602.26 last 40.96) - link 31685 (time 1786045173.42 total 612.29 last 45.45) - link 32101 (time 1786045183.44 total 622.31 last 41.52) - link 32490 (time 1786045193.45 total 632.33 last 38.82) - link 32855 (time 1786045203.47 total 642.35 last 36.44) - link 33322 (time 1786045213.48 total 652.36 last 46.64) - link 33715 (time 1786045223.50 total 662.38 last 39.24) - link 34162 (time 1786045233.52 total 672.39 last 44.62) - link 34586 (time 1786045243.52 total 682.40 last 42.37) - link 35030 (time 1786045253.53 total 692.41 last 44.37) - link 35432 (time 1786045263.54 total 702.42 last 40.15) - link 35852 (time 1786045273.55 total 712.43 last 41.96) - link 36308 (time 1786045283.56 total 722.43 last 45.59) - link 36775 (time 1786045293.57 total 732.44 last 46.65) - link 37233 (time 1786045303.59 total 742.46 last 45.71) - link 37695 (time 1786045313.60 total 752.48 last 46.12) - link 38124 (time 1786045323.61 total 762.49 last 42.86) - link 38547 (time 1786045333.62 total 772.50 last 42.27) - link 39028 (time 1786045343.65 total 782.52 last 47.97) - link 39452 (time 1786045353.65 total 792.53 last 42.37) - link 39895 (time 1786045363.67 total 802.54 last 44.24) total: 40000 link in 805.00 seconds: 49.69 ops/second Stopping clients: oleg143-client.virtnet /mnt/lustre (opts:) Stopping client oleg143-client.virtnet /mnt/lustre opts: Stopping clients: oleg143-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg143-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg143-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg143-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg143-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg143-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 155 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 155 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 156 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 156 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 157 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 157 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 158 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 159 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 160 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 161 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 161 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 162 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 162 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 163 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 163 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 164 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 164 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 165 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 165 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 166 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 166 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 167 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 167 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 168 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 168 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 169 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 169 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 170 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 170 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 171 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 172 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 172 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 173 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 173 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 174 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 174 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 175 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 175 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 176 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 176 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 177 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 177 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 178 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 178 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 179 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 179 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 180 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 180 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 181 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 181 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 182 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 182 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 183 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 183 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 184 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 184 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 185 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 185 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 186 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 186 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 187 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 187 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 189 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 190 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 191 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 196 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 196 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 197 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 197 badness 1 to 3 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 1596 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1596 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1633 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1633 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1634 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 1635 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1635 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1636 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1636 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1637 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1637 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1638 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1638 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1639 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1639 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1640 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 364k/440k (128k/237k), time: 0.02/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 45.08MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/282 Pass 2: Checking directory structure Pass 2: Memory used: 364k/0k (83k/282k), time: 0.42/ 0.14/ 0.05 Pass 2: I/O read: 25MB, write: 0MB, rate: 59.17MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 364k/0k (83k/282k), time: 0.48/ 0.14/ 0.06 Pass 3: Memory used: 364k/0k (82k/283k), time: 0.01/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 364k/0k (78k/287k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 1314.06MB/s Pass 5: Checking group summary information Pass 5: Memory used: 504k/0k (77k/428k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 244.98MB/s 276 inodes used (8.85%, out of 3120) 1 non-contiguous file (0.4%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 Extent depth histogram: 203 11393 blocks used (22.79%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 504k/0k (81k/424k), time: 0.49/ 0.14/ 0.06 I/O read: 25MB, write: 0MB, rate: 51.12MB/s Stopping clients: oleg143-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg143-client.virtnet /mnt/lustre2 (opts:-f) oleg143-server: oleg143-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg143-server' oleg143-server: oleg143-server.virtnet: executing load_modules_local oleg143-server: Loading modules from /home/green/git/lustre-release/lustre oleg143-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg143-server: detected 4 online CPUs by sysfs oleg143-server: MODOPTS_LIBCFS= oleg143-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg143-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg143-server: oleg143-server.virtnet: executing set_default_debug -1 all pdsh@oleg143-client: oleg143-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg143-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg143-server: oleg143-server.virtnet: executing set_default_debug -1 all pdsh@oleg143-client: oleg143-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg143-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg143-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg143-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg143-server: oleg143-server.virtnet: executing set_default_debug -1 all pdsh@oleg143-client: oleg143-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg143-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg143-server: oleg143-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg143-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg143-server: oleg143-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg143-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg143-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg143-server stop mds service on oleg143-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg143-server stop mds service on oleg143-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg143-server