== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 13:10:05 (1785085805) oleg343-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg343-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg343-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg343-client: oleg343-server: ssh exited with exit code 2 oleg343-server: oleg343-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg343-server' oleg343-server: oleg343-server.virtnet: executing load_modules_local oleg343-server: Loading modules from /home/green/git/lustre-release/lustre oleg343-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg343-server: detected 4 online CPUs by sysfs oleg343-server: MODOPTS_LIBCFS= oleg343-server: Force libcfs to create 2 CPU partitions oleg343-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg343-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg343-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg343-server' oleg343-server: oleg343-server.virtnet: executing load_modules_local oleg343-server: Loading modules from /home/green/git/lustre-release/lustre oleg343-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg343-server: detected 4 online CPUs by sysfs oleg343-server: MODOPTS_LIBCFS= oleg343-server: Force libcfs to create 2 CPU partitions Permanent disk data: Device: /dev/mapper/mds1_flakey Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg343-server: oleg343-server.virtnet: executing set_default_debug -1 all pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg343-server: oleg343-server.virtnet: executing set_default_debug -1 all pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg343-client.virtnet: -o user_xattr,flock 192.168.203.143@tcp:/lustre /mnt/lustre Starting client oleg343-client.virtnet: -o user_xattr,flock 192.168.203.143@tcp:/lustre /mnt/lustre Started clients oleg343-client.virtnet: 192.168.203.143@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg343-client.virtnet: -o user_xattr,flock 192.168.203.143@tcp:/lustre /mnt/lustre2 Starting client oleg343-client.virtnet: -o user_xattr,flock 192.168.203.143@tcp:/lustre /mnt/lustre2 Started clients oleg343-client.virtnet: 192.168.203.143@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 174488 174503 to complete - link 508 (time 1785085927.55 total 10.01 last 50.76) - link 1098 (time 1785085937.56 total 20.02 last 58.94) - link 1670 (time 1785085947.57 total 30.03 last 57.13) - link 2259 (time 1785085957.58 total 40.04 last 58.84) - link 2827 (time 1785085967.59 total 50.05 last 56.74) - link 3373 (time 1785085977.62 total 60.07 last 54.47) - link 3928 (time 1785085987.63 total 70.09 last 55.42) - link 4510 (time 1785085997.64 total 80.10 last 58.14) - link 5041 (time 1785086007.66 total 90.11 last 53.04) - link 5647 (time 1785086017.66 total 100.12 last 60.56) - link 6156 (time 1785086027.69 total 110.14 last 50.78) - link 6685 (time 1785086037.69 total 120.15 last 52.88) - link 7260 (time 1785086047.69 total 130.15 last 57.50) - link 7717 (time 1785086057.70 total 140.15 last 45.67) - link 8285 (time 1785086067.70 total 150.16 last 56.78) - link 8882 (time 1785086077.70 total 160.16 last 59.69) - link 9444 (time 1785086087.70 total 170.16 last 56.19) - link 9973 (time 1785086097.71 total 180.16 last 52.89) - link 10448 (time 1785086107.72 total 190.18 last 47.44) - link 10953 (time 1785086117.73 total 200.18 last 50.45) - link 11489 (time 1785086127.74 total 210.20 last 53.54) - link 12040 (time 1785086137.74 total 220.20 last 55.08) - link 12603 (time 1785086147.75 total 230.21 last 56.23) - link 13139 (time 1785086157.76 total 240.22 last 53.54) - link 13736 (time 1785086167.77 total 250.22 last 59.68) - link 14283 (time 1785086177.78 total 260.24 last 54.63) - link 14765 (time 1785086187.80 total 270.25 last 48.12) - link 15344 (time 1785086197.80 total 280.26 last 57.86) - link 15921 (time 1785086207.81 total 290.27 last 57.66) - link 16514 (time 1785086217.82 total 300.27 last 59.26) - link 17116 (time 1785086227.83 total 310.29 last 60.10) - link 17693 (time 1785086237.84 total 320.29 last 57.67) - link 18329 (time 1785086247.84 total 330.29 last 63.60) - link 18949 (time 1785086257.84 total 340.30 last 61.98) - link 19536 (time 1785086267.84 total 350.30 last 58.70) total: 20000 link in 357.68 seconds: 55.92 ops/second - link 490 (time 1785085927.05 total 10.03 last 48.87) - link 1077 (time 1785085937.06 total 20.03 last 58.66) - link 1644 (time 1785085947.07 total 30.05 last 56.63) - link 2235 (time 1785085957.07 total 40.05 last 59.08) - link 2817 (time 1785085967.09 total 50.07 last 58.10) - link 3378 (time 1785085977.10 total 60.08 last 56.05) - link 3932 (time 1785085987.10 total 70.08 last 55.38) - link 4500 (time 1785085997.11 total 80.09 last 56.76) - link 5063 (time 1785086007.11 total 90.09 last 56.28) - link 5649 (time 1785086017.11 total 100.09 last 58.60) - link 6164 (time 1785086027.12 total 110.09 last 51.49) - link 6671 (time 1785086037.12 total 120.10 last 50.66) - link 7235 (time 1785086047.13 total 130.11 last 56.37) - link 7708 (time 1785086057.13 total 140.11 last 47.28) - link 8272 (time 1785086067.15 total 150.13 last 56.32) - link 8895 (time 1785086077.15 total 160.13 last 62.28) - link 9488 (time 1785086087.15 total 170.13 last 59.29) - link 9998 (time 1785086097.16 total 180.13 last 50.97) - link 10486 (time 1785086107.17 total 190.14 last 48.76) - link 10985 (time 1785086117.21 total 200.19 last 49.67) - link 11517 (time 1785086127.23 total 210.20 last 53.14) - link 12087 (time 1785086137.24 total 220.22 last 56.92) - link 12664 (time 1785086147.25 total 230.22 last 57.65) - link 13202 (time 1785086157.27 total 240.24 last 53.69) - link 13788 (time 1785086167.28 total 250.26 last 58.52) - link 14340 (time 1785086177.30 total 260.27 last 55.13) - link 14825 (time 1785086187.31 total 270.28 last 48.45) - link 15372 (time 1785086197.31 total 280.29 last 54.65) - link 15959 (time 1785086207.32 total 290.30 last 58.67) - link 16563 (time 1785086217.34 total 300.31 last 60.30) - link 17168 (time 1785086227.35 total 310.32 last 60.43) - link 17762 (time 1785086237.35 total 320.33 last 59.36) - link 18418 (time 1785086247.35 total 330.33 last 65.59) - link 19033 (time 1785086257.36 total 340.33 last 61.50) - link 19626 (time 1785086267.36 total 350.33 last 59.29) - link 20000 (time 1785086273.31 total 356.29 last 62.78) - link 20382 (time 1785086283.34 total 366.31 last 38.12) - link 20793 (time 1785086293.34 total 376.32 last 41.09) - link 21177 (time 1785086303.36 total 386.33 last 38.32) - link 21587 (time 1785086313.38 total 396.36 last 40.91) - link 21977 (time 1785086323.40 total 406.38 last 38.91) - link 22426 (time 1785086333.42 total 416.40 last 44.83) - link 22862 (time 1785086343.44 total 426.42 last 43.49) - link 23292 (time 1785086353.45 total 436.42 last 42.99) - link 23716 (time 1785086363.46 total 446.43 last 42.36) - link 24079 (time 1785086373.47 total 456.45 last 36.25) - link 24486 (time 1785086383.49 total 466.46 last 40.63) - link 24885 (time 1785086393.50 total 476.48 last 39.85) - link 25309 (time 1785086403.50 total 486.48 last 42.38) - link 25726 (time 1785086413.51 total 496.48 last 41.69) - link 26165 (time 1785086423.52 total 506.50 last 43.82) - link 26617 (time 1785086433.54 total 516.52 last 45.13) - link 27079 (time 1785086443.55 total 526.52 last 46.16) - link 27425 (time 1785086453.56 total 536.54 last 34.55) - link 27791 (time 1785086463.58 total 546.55 last 36.55) - link 28143 (time 1785086473.58 total 556.56 last 35.17) - link 28494 (time 1785086483.59 total 566.57 last 35.07) - link 28928 (time 1785086493.60 total 576.57 last 43.40) - link 29358 (time 1785086503.63 total 586.60 last 42.86) - link 29762 (time 1785086513.66 total 596.64 last 40.27) - link 30000 (time 1785086519.45 total 602.43 last 41.09) - link 30382 (time 1785086529.48 total 612.45 last 38.11) - link 30761 (time 1785086539.48 total 622.46 last 37.88) - link 31144 (time 1785086549.50 total 632.48 last 38.24) - link 31563 (time 1785086559.52 total 642.49 last 41.82) - link 31975 (time 1785086569.52 total 652.49 last 41.20) - link 32375 (time 1785086579.53 total 662.51 last 39.95) - link 32816 (time 1785086589.54 total 672.52 last 44.05) - link 33263 (time 1785086599.55 total 682.53 last 44.66) - link 33726 (time 1785086609.56 total 692.53 last 46.28) - link 34166 (time 1785086619.57 total 702.55 last 43.94) - link 34589 (time 1785086629.58 total 712.55 last 42.27) - link 35046 (time 1785086639.59 total 722.57 last 45.64) - link 35476 (time 1785086649.61 total 732.58 last 42.93) - link 35904 (time 1785086659.62 total 742.60 last 42.74) - link 36355 (time 1785086669.63 total 752.61 last 45.05) - link 36764 (time 1785086679.65 total 762.62 last 40.84) - link 37226 (time 1785086689.66 total 772.63 last 46.16) - link 37636 (time 1785086699.66 total 782.64 last 40.98) - link 37985 (time 1785086709.66 total 792.64 last 34.90) - link 38351 (time 1785086719.69 total 802.67 last 36.50) - link 38746 (time 1785086729.71 total 812.68 last 39.42) - link 39176 (time 1785086739.73 total 822.70 last 42.92) - link 39599 (time 1785086749.74 total 832.72 last 42.24) total: 40000 link in 841.51 seconds: 47.53 ops/second Stopping clients: oleg343-client.virtnet /mnt/lustre (opts:) Stopping client oleg343-client.virtnet /mnt/lustre opts: Stopping clients: oleg343-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg343-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg343-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg343-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg343-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg343-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 120 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 147 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 150 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 153 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 158 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 159 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 161 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 161 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 162 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 162 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 163 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 163 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 164 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 164 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 165 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 165 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 166 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 166 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 167 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 167 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 168 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 168 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 169 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 169 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 170 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 170 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 171 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 171 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 172 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 172 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 173 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 173 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 174 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 174 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 175 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 175 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 176 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 176 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 177 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 177 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 178 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 179 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 179 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 180 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 180 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 181 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 181 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 182 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 182 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 183 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 183 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 184 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 184 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 185 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 185 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 186 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 186 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 187 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 187 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 188 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 188 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 189 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 189 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 190 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 190 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 191 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 191 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 192 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 192 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 193 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 193 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 194 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 194 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 196 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 197 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 198 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 203 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 204 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 204 badness 1 to 3 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 1596 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1596 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1631 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1631 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1632 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1632 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1633 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 364k/440k (128k/237k), time: 0.02/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 45.65MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/282 Pass 2: Checking directory structure Pass 2: Memory used: 364k/0k (83k/282k), time: 0.56/ 0.16/ 0.05 Pass 2: I/O read: 25MB, write: 0MB, rate: 44.88MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 364k/0k (84k/281k), time: 0.59/ 0.16/ 0.05 Pass 3: Memory used: 364k/0k (82k/283k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 364k/0k (78k/287k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 6535.95MB/s Pass 5: Checking group summary information Pass 5: Memory used: 504k/0k (77k/428k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 512.03MB/s 276 inodes used (8.85%, out of 3120) 1 non-contiguous file (0.4%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 Extent depth histogram: 203 11401 blocks used (22.80%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 504k/0k (80k/424k), time: 0.60/ 0.16/ 0.05 I/O read: 25MB, write: 0MB, rate: 41.69MB/s Stopping clients: oleg343-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg343-client.virtnet /mnt/lustre2 (opts:-f) oleg343-server: oleg343-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg343-server' oleg343-server: oleg343-server.virtnet: executing load_modules_local oleg343-server: Loading modules from /home/green/git/lustre-release/lustre oleg343-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg343-server: detected 4 online CPUs by sysfs oleg343-server: MODOPTS_LIBCFS= oleg343-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg343-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg343-server: oleg343-server.virtnet: executing set_default_debug -1 all pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg343-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg343-server: oleg343-server.virtnet: executing set_default_debug -1 all pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg343-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg343-server: oleg343-server.virtnet: executing set_default_debug -1 all pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg343-server: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg343-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg343-server: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg343-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg343-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg343-server stop mds service on oleg343-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg343-server stop mds service on oleg343-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg343-server