== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 05:34:25 (1789119265) oleg648-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg648-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg648-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg648-client: oleg648-server: ssh exited with exit code 2 oleg648-server: oleg648-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1050: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg648-server' oleg648-server: oleg648-server.virtnet: executing load_modules_local oleg648-server: Loading modules from /home/green/git/lustre-release/lustre oleg648-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1050: echo: write error: Device or resource busy oleg648-server: detected 4 online CPUs by sysfs oleg648-server: MODOPTS_LIBCFS= oleg648-server: Force libcfs to create 2 CPU partitions oleg648-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg648-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg648-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1050: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg648-server' oleg648-server: oleg648-server.virtnet: executing load_modules_local oleg648-server: Loading modules from /home/green/git/lustre-release/lustre oleg648-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1050: echo: write error: Device or resource busy oleg648-server: detected 4 online CPUs by sysfs oleg648-server: MODOPTS_LIBCFS= oleg648-server: Force libcfs to create 2 CPU partitions Permanent disk data: Device: /dev/mapper/mds1_flakey Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg648-server: oleg648-server.virtnet: executing set_default_debug -1 all pdsh@oleg648-client: oleg648-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg648-server: oleg648-server.virtnet: executing set_default_debug -1 all pdsh@oleg648-client: oleg648-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg648-client.virtnet: -o user_xattr,flock 192.168.206.148@tcp:/lustre /mnt/lustre Starting client oleg648-client.virtnet: -o user_xattr,flock 192.168.206.148@tcp:/lustre /mnt/lustre Started clients oleg648-client.virtnet: 192.168.206.148@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg648-client.virtnet: -o user_xattr,flock 192.168.206.148@tcp:/lustre /mnt/lustre2 Starting client oleg648-client.virtnet: -o user_xattr,flock 192.168.206.148@tcp:/lustre /mnt/lustre2 Started clients oleg648-client.virtnet: 192.168.206.148@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 172955 172970 to complete - link 649 (time 1789119370.39 total 10.00 last 64.89) - link 1257 (time 1789119380.40 total 20.01 last 60.76) - link 1859 (time 1789119390.43 total 30.04 last 60.01) - link 2491 (time 1789119400.45 total 40.05 last 63.11) - link 3213 (time 1789119410.45 total 50.06 last 72.15) - link 3818 (time 1789119420.46 total 60.07 last 60.45) - link 4421 (time 1789119430.47 total 70.08 last 60.27) - link 5098 (time 1789119440.47 total 80.08 last 67.69) - link 5673 (time 1789119450.48 total 90.08 last 57.46) - link 6270 (time 1789119460.48 total 100.09 last 59.68) - link 6788 (time 1789119470.48 total 110.09 last 51.78) - link 7373 (time 1789119480.49 total 120.10 last 58.45) - link 8013 (time 1789119490.49 total 130.10 last 63.98) - link 8588 (time 1789119500.50 total 140.11 last 57.48) - link 9163 (time 1789119510.50 total 150.11 last 57.49) - link 9701 (time 1789119520.50 total 160.11 last 53.79) - link 10000 (time 1789119525.85 total 165.46 last 55.91) - link 10535 (time 1789119535.86 total 175.47 last 53.41) - link 11142 (time 1789119545.88 total 185.49 last 60.60) - link 11684 (time 1789119555.88 total 195.49 last 54.19) - link 12245 (time 1789119565.90 total 205.51 last 56.02) - link 12894 (time 1789119575.92 total 215.52 last 64.80) - link 13586 (time 1789119585.92 total 225.52 last 69.20) - link 14168 (time 1789119595.92 total 235.53 last 58.16) - link 14631 (time 1789119605.93 total 245.53 last 46.29) - link 15225 (time 1789119615.93 total 255.54 last 59.35) - link 15881 (time 1789119625.94 total 265.55 last 65.55) - link 16486 (time 1789119635.94 total 275.55 last 60.50) - link 17123 (time 1789119645.95 total 285.56 last 63.65) - link 17787 (time 1789119655.95 total 295.56 last 66.39) - link 18446 (time 1789119665.96 total 305.57 last 65.84) - link 19072 (time 1789119675.98 total 315.59 last 62.47) - link 19813 (time 1789119685.99 total 325.60 last 74.06) total: 20000 link in 328.66 seconds: 60.85 ops/second - link 643 (time 1789119370.36 total 10.00 last 64.28) - link 1264 (time 1789119380.37 total 20.01 last 62.08) - link 1873 (time 1789119390.37 total 30.01 last 60.85) - link 2505 (time 1789119400.38 total 40.02 last 63.18) - link 3221 (time 1789119410.38 total 50.02 last 71.58) - link 3820 (time 1789119420.40 total 60.04 last 59.80) - link 4406 (time 1789119430.41 total 70.05 last 58.54) - link 5073 (time 1789119440.42 total 80.06 last 66.63) - link 5639 (time 1789119450.42 total 90.06 last 56.57) - link 6243 (time 1789119460.43 total 100.07 last 60.37) - link 6769 (time 1789119470.43 total 110.07 last 52.59) - link 7353 (time 1789119480.43 total 120.07 last 58.38) - link 7989 (time 1789119490.44 total 130.08 last 63.55) - link 8565 (time 1789119500.47 total 140.11 last 57.42) - link 9139 (time 1789119510.47 total 150.11 last 57.38) - link 9667 (time 1789119520.50 total 160.14 last 52.66) - link 10000 (time 1789119526.68 total 166.32 last 53.92) - link 10560 (time 1789119536.69 total 176.33 last 55.93) - link 11167 (time 1789119546.69 total 186.33 last 60.69) - link 11724 (time 1789119556.69 total 196.33 last 55.68) - link 12294 (time 1789119566.70 total 206.34 last 56.98) - link 12935 (time 1789119576.72 total 216.36 last 63.95) - link 13615 (time 1789119586.75 total 226.39 last 67.79) - link 14196 (time 1789119596.76 total 236.40 last 58.07) - link 14653 (time 1789119606.77 total 246.41 last 45.65) - link 15261 (time 1789119616.78 total 256.42 last 60.71) - link 15920 (time 1789119626.81 total 266.45 last 65.72) - link 16526 (time 1789119636.82 total 276.46 last 60.53) - link 17181 (time 1789119646.83 total 286.47 last 65.45) - link 17824 (time 1789119656.83 total 296.47 last 64.29) - link 18473 (time 1789119666.83 total 306.47 last 64.89) - link 19090 (time 1789119676.84 total 316.48 last 61.66) - link 19808 (time 1789119686.86 total 326.50 last 71.67) - link 20000 (time 1789119690.11 total 329.75 last 58.94) - link 20405 (time 1789119700.14 total 339.78 last 40.38) - link 20799 (time 1789119710.17 total 349.81 last 39.30) - link 21244 (time 1789119720.18 total 359.82 last 44.46) - link 21666 (time 1789119730.19 total 369.83 last 42.14) - link 22071 (time 1789119740.22 total 379.86 last 40.39) - link 22471 (time 1789119750.23 total 389.87 last 39.94) - link 22878 (time 1789119760.26 total 399.90 last 40.60) - link 23308 (time 1789119770.28 total 409.92 last 42.92) - link 23733 (time 1789119780.30 total 419.94 last 42.41) - link 24137 (time 1789119790.30 total 429.94 last 40.40) - link 24543 (time 1789119800.30 total 439.94 last 40.58) - link 24967 (time 1789119810.31 total 449.95 last 42.36) - link 25388 (time 1789119820.33 total 459.97 last 42.04) - link 25793 (time 1789119830.33 total 469.97 last 40.50) - link 26221 (time 1789119840.35 total 479.99 last 42.74) - link 26650 (time 1789119850.35 total 489.99 last 42.87) - link 27036 (time 1789119860.36 total 500.00 last 38.58) - link 27490 (time 1789119870.36 total 510.00 last 45.38) - link 27910 (time 1789119880.38 total 520.02 last 41.91) - link 28320 (time 1789119890.39 total 530.03 last 40.95) - link 28709 (time 1789119900.41 total 540.05 last 38.85) - link 29093 (time 1789119910.43 total 550.07 last 38.32) - link 29522 (time 1789119920.44 total 560.08 last 42.85) - link 29962 (time 1789119930.45 total 570.09 last 43.95) - link 30415 (time 1789119940.46 total 580.10 last 45.27) - link 30841 (time 1789119950.46 total 590.10 last 42.60) - link 31280 (time 1789119960.46 total 600.10 last 43.88) - link 31708 (time 1789119970.47 total 610.11 last 42.78) - link 32133 (time 1789119980.47 total 620.11 last 42.47) - link 32565 (time 1789119990.49 total 630.13 last 43.15) - link 33007 (time 1789120000.49 total 640.13 last 44.20) - link 33393 (time 1789120010.50 total 650.14 last 38.57) - link 33818 (time 1789120020.50 total 660.14 last 42.48) - link 34251 (time 1789120030.52 total 670.16 last 43.21) - link 34704 (time 1789120040.55 total 680.19 last 45.18) - link 35129 (time 1789120050.55 total 690.19 last 42.49) - link 35560 (time 1789120060.56 total 700.20 last 43.07) - link 35984 (time 1789120070.58 total 710.22 last 42.30) - link 36417 (time 1789120080.60 total 720.24 last 43.25) - link 36847 (time 1789120090.60 total 730.24 last 42.96) - link 37317 (time 1789120100.62 total 740.26 last 46.91) - link 37810 (time 1789120110.64 total 750.28 last 49.20) - link 38281 (time 1789120120.66 total 760.30 last 47.00) - link 38708 (time 1789120130.68 total 770.32 last 42.65) - link 39112 (time 1789120140.70 total 780.34 last 40.32) - link 39527 (time 1789120150.70 total 790.34 last 41.49) - link 39982 (time 1789120160.70 total 800.34 last 45.49) total: 40000 link in 800.70 seconds: 49.96 ops/second Stopping clients: oleg648-client.virtnet /mnt/lustre (opts:) Stopping client oleg648-client.virtnet /mnt/lustre opts: Stopping clients: oleg648-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg648-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg648-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg648-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg648-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg648-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 132 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 148 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 148 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 150 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 150 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 153 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 155 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 155 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 156 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 156 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 157 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 157 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 158 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 159 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 160 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 161 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 161 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 162 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 162 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 163 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 163 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 164 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 164 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 165 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 165 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 166 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 166 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 167 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 168 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 168 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 169 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 169 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 170 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 170 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 171 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 171 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 172 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 172 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 173 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 173 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 174 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 174 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 175 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 175 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 176 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 176 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 177 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 177 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 178 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 178 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 179 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 179 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 180 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 180 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 181 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 181 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 182 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 182 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 183 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 183 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 185 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 186 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 187 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 193 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 194 badness 0 to 2 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 1596 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1596 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1633 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1633 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1634 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1634 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1635 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1635 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1636 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1636 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1637 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1637 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1638 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 1639 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1639 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1640 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1640 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1641 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1641 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1642 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1642 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1643 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1643 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1644 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 420k/288k (277k/144k), time: 0.02/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 60.06MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/281 Pass 2: Checking directory structure Pass 2: Memory used: 420k/0k (82k/339k), time: 0.47/ 0.17/ 0.05 Pass 2: I/O read: 25MB, write: 0MB, rate: 53.01MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 420k/0k (83k/338k), time: 0.50/ 0.17/ 0.06 Pass 3: Memory used: 420k/0k (81k/340k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 420k/0k (78k/343k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 5586.59MB/s Pass 5: Checking group summary information Pass 5: Memory used: 560k/0k (77k/484k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 237.53MB/s 276 inodes used (8.85%, out of 3120) 1 non-contiguous file (0.4%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 Extent depth histogram: 203 11391 blocks used (22.78%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 560k/0k (81k/480k), time: 0.51/ 0.17/ 0.06 I/O read: 25MB, write: 0MB, rate: 49.08MB/s Stopping clients: oleg648-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg648-client.virtnet /mnt/lustre2 (opts:-f) oleg648-server: oleg648-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1050: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg648-server' oleg648-server: oleg648-server.virtnet: executing load_modules_local oleg648-server: Loading modules from /home/green/git/lustre-release/lustre oleg648-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1050: echo: write error: Device or resource busy oleg648-server: detected 4 online CPUs by sysfs oleg648-server: MODOPTS_LIBCFS= oleg648-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg648-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg648-server: oleg648-server.virtnet: executing set_default_debug -1 all pdsh@oleg648-client: oleg648-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg648-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg648-server: oleg648-server.virtnet: executing set_default_debug -1 all pdsh@oleg648-client: oleg648-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg648-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg648-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg648-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg648-server: oleg648-server.virtnet: executing set_default_debug -1 all pdsh@oleg648-client: oleg648-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg648-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg648-server: oleg648-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg648-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg648-server: oleg648-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg648-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg648-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg648-server stop mds service on oleg648-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg648-server stop mds service on oleg648-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg648-server