== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 13:25:16 (1787851516) oleg312-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg312-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg312-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg312-client: oleg312-server: ssh exited with exit code 2 oleg312-server: oleg312-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1049: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg312-server' oleg312-server: oleg312-server.virtnet: executing load_modules_local oleg312-server: Loading modules from /home/green/git/lustre-release/lustre oleg312-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1049: echo: write error: Device or resource busy oleg312-server: detected 4 online CPUs by sysfs oleg312-server: MODOPTS_LIBCFS= oleg312-server: Force libcfs to create 2 CPU partitions oleg312-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg312-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg312-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1049: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg312-server' oleg312-server: oleg312-server.virtnet: executing load_modules_local oleg312-server: Loading modules from /home/green/git/lustre-release/lustre oleg312-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1049: echo: write error: Device or resource busy oleg312-server: detected 4 online CPUs by sysfs oleg312-server: MODOPTS_LIBCFS= oleg312-server: Force libcfs to create 2 CPU partitions Permanent disk data: Device: /dev/mapper/mds1_flakey Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg312-client.virtnet: -o user_xattr,flock 192.168.203.112@tcp:/lustre /mnt/lustre Starting client oleg312-client.virtnet: -o user_xattr,flock 192.168.203.112@tcp:/lustre /mnt/lustre Started clients oleg312-client.virtnet: 192.168.203.112@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg312-client.virtnet: -o user_xattr,flock 192.168.203.112@tcp:/lustre /mnt/lustre2 Starting client oleg312-client.virtnet: -o user_xattr,flock 192.168.203.112@tcp:/lustre /mnt/lustre2 Started clients oleg312-client.virtnet: 192.168.203.112@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 174525 174540 to complete - link 523 (time 1787851643.12 total 10.02 last 52.19) - link 1002 (time 1787851653.12 total 20.02 last 47.90) - link 1603 (time 1787851663.12 total 30.03 last 60.06) - link 2152 (time 1787851673.15 total 40.05 last 54.78) - link 2622 (time 1787851683.15 total 50.05 last 46.99) - link 3178 (time 1787851693.17 total 60.07 last 55.50) - link 3663 (time 1787851703.18 total 70.08 last 48.46) - link 4171 (time 1787851713.18 total 80.08 last 50.78) - link 4703 (time 1787851723.19 total 90.09 last 53.16) - link 5227 (time 1787851733.21 total 100.11 last 52.28) - link 5726 (time 1787851743.23 total 110.14 last 49.78) - link 6208 (time 1787851753.26 total 120.17 last 48.06) - link 6652 (time 1787851763.29 total 130.19 last 44.31) - link 7124 (time 1787851773.30 total 140.20 last 47.12) - link 7645 (time 1787851783.31 total 150.21 last 52.07) - link 8079 (time 1787851793.32 total 160.22 last 43.36) - link 8473 (time 1787851803.33 total 170.23 last 39.35) - link 8897 (time 1787851813.33 total 180.24 last 42.38) - link 9469 (time 1787851823.34 total 190.25 last 57.14) - link 10000 (time 1787851831.55 total 198.46 last 64.67) - link 10600 (time 1787851841.57 total 208.47 last 59.91) - link 11130 (time 1787851851.59 total 218.49 last 52.89) - link 11792 (time 1787851861.59 total 228.49 last 66.19) - link 12303 (time 1787851871.59 total 238.50 last 51.09) - link 12888 (time 1787851881.60 total 248.50 last 58.48) - link 13430 (time 1787851891.60 total 258.51 last 54.16) - link 13958 (time 1787851901.62 total 268.52 last 52.73) - link 14500 (time 1787851911.65 total 278.55 last 54.03) - link 15002 (time 1787851921.65 total 288.56 last 50.17) - link 15677 (time 1787851931.66 total 298.56 last 67.49) - link 16229 (time 1787851941.68 total 308.58 last 55.06) - link 16808 (time 1787851951.70 total 318.60 last 57.79) - link 17372 (time 1787851961.72 total 328.62 last 56.31) - link 17990 (time 1787851971.73 total 338.63 last 61.73) - link 18553 (time 1787851981.75 total 348.65 last 56.17) - link 19207 (time 1787851991.75 total 358.66 last 65.38) - link 19850 (time 1787852001.76 total 368.67 last 64.25) total: 20000 link in 371.08 seconds: 53.90 ops/second - link 492 (time 1787851642.08 total 10.01 last 49.15) - link 972 (time 1787851652.08 total 20.02 last 47.98) - link 1598 (time 1787851662.11 total 30.04 last 62.43) - link 2152 (time 1787851672.11 total 40.04 last 55.39) - link 2601 (time 1787851682.12 total 50.05 last 44.88) - link 3167 (time 1787851692.12 total 60.06 last 56.57) - link 3656 (time 1787851702.12 total 70.06 last 48.89) - link 4170 (time 1787851712.13 total 80.06 last 51.39) - link 4688 (time 1787851722.14 total 90.07 last 51.74) - link 5213 (time 1787851732.16 total 100.09 last 52.38) - link 5720 (time 1787851742.16 total 110.09 last 50.70) - link 6195 (time 1787851752.17 total 120.10 last 47.47) - link 6642 (time 1787851762.17 total 130.10 last 44.70) - link 7111 (time 1787851772.18 total 140.11 last 46.86) - link 7623 (time 1787851782.18 total 150.11 last 51.19) - link 8073 (time 1787851792.18 total 160.11 last 44.99) - link 8490 (time 1787851802.19 total 170.12 last 41.66) - link 8920 (time 1787851812.21 total 180.14 last 42.91) - link 9484 (time 1787851822.22 total 190.15 last 56.38) - link 10000 (time 1787851830.20 total 198.13 last 64.65) - link 10639 (time 1787851840.21 total 208.14 last 63.81) - link 11166 (time 1787851850.22 total 218.15 last 52.63) - link 11798 (time 1787851860.23 total 228.16 last 63.16) - link 12324 (time 1787851870.24 total 238.17 last 52.54) - link 12883 (time 1787851880.26 total 248.19 last 55.79) - link 13442 (time 1787851890.27 total 258.20 last 55.83) - link 13968 (time 1787851900.28 total 268.22 last 52.53) - link 14510 (time 1787851910.29 total 278.22 last 54.18) - link 15008 (time 1787851920.29 total 288.22 last 49.78) - link 15707 (time 1787851930.30 total 298.23 last 69.85) - link 16241 (time 1787851940.31 total 308.24 last 53.36) - link 16837 (time 1787851950.32 total 318.25 last 59.53) - link 17439 (time 1787851960.34 total 328.27 last 60.10) - link 18073 (time 1787851970.34 total 338.27 last 63.38) - link 18639 (time 1787851980.35 total 348.29 last 56.51) - link 19257 (time 1787851990.37 total 358.30 last 61.73) - link 19926 (time 1787852000.39 total 368.32 last 66.75) - link 20428 (time 1787852010.41 total 378.34 last 50.09) - link 20817 (time 1787852020.41 total 388.34 last 38.90) - link 21220 (time 1787852030.44 total 398.38 last 40.16) - link 21595 (time 1787852040.45 total 408.38 last 37.50) - link 22017 (time 1787852050.46 total 418.39 last 42.14) - link 22391 (time 1787852060.47 total 428.41 last 37.35) - link 22822 (time 1787852070.48 total 438.41 last 43.06) - link 23184 (time 1787852080.49 total 448.42 last 36.17) - link 23548 (time 1787852090.50 total 458.43 last 36.38) - link 23915 (time 1787852100.51 total 468.44 last 36.66) - link 24327 (time 1787852110.52 total 478.45 last 41.14) - link 24677 (time 1787852120.55 total 488.48 last 34.91) - link 25066 (time 1787852130.57 total 498.50 last 38.81) - link 25378 (time 1787852140.60 total 508.54 last 31.10) - link 25650 (time 1787852150.61 total 518.54 last 27.18) - link 25939 (time 1787852160.65 total 528.58 last 28.80) - link 26282 (time 1787852170.65 total 538.59 last 34.27) - link 26636 (time 1787852180.66 total 548.59 last 35.37) - link 27056 (time 1787852190.67 total 558.60 last 41.98) - link 27435 (time 1787852200.69 total 568.62 last 37.83) - link 27806 (time 1787852210.69 total 578.62 last 37.10) - link 28133 (time 1787852220.69 total 588.62 last 32.70) - link 28435 (time 1787852230.69 total 598.62 last 30.19) - link 28797 (time 1787852240.69 total 608.63 last 36.19) - link 29209 (time 1787852250.71 total 618.64 last 41.13) - link 29609 (time 1787852260.72 total 628.65 last 39.96) - link 29996 (time 1787852270.73 total 638.66 last 38.67) - link 30342 (time 1787852280.75 total 648.68 last 34.54) - link 30714 (time 1787852290.77 total 658.70 last 37.11) - link 31007 (time 1787852300.80 total 668.73 last 29.23) - link 31431 (time 1787852310.80 total 678.73 last 42.37) - link 31792 (time 1787852320.82 total 688.75 last 36.04) - link 32138 (time 1787852330.84 total 698.77 last 34.52) - link 32490 (time 1787852340.86 total 708.80 last 35.11) - link 32840 (time 1787852350.90 total 718.83 last 34.89) - link 33216 (time 1787852360.91 total 728.84 last 37.56) - link 33633 (time 1787852370.91 total 738.84 last 41.69) - link 34027 (time 1787852380.92 total 748.85 last 39.36) - link 34426 (time 1787852390.92 total 758.86 last 39.89) - link 34809 (time 1787852400.97 total 768.91 last 38.10) - link 35209 (time 1787852410.99 total 778.92 last 39.93) - link 35599 (time 1787852421.00 total 788.93 last 38.97) - link 35994 (time 1787852431.02 total 798.95 last 39.43) - link 36278 (time 1787852441.04 total 808.97 last 28.34) - link 36545 (time 1787852451.06 total 818.99 last 26.63) - link 36836 (time 1787852461.10 total 829.04 last 28.98) - link 37179 (time 1787852471.12 total 839.05 last 34.26) - link 37447 (time 1787852481.13 total 849.07 last 26.75) - link 37871 (time 1787852491.16 total 859.09 last 42.28) - link 38246 (time 1787852501.22 total 869.15 last 37.29) - link 38562 (time 1787852511.22 total 879.15 last 31.59) - link 38886 (time 1787852521.24 total 889.17 last 32.34) - link 39227 (time 1787852531.25 total 899.19 last 34.05) - link 39627 (time 1787852541.26 total 909.19 last 39.99) total: 40000 link in 918.12 seconds: 43.57 ops/second Stopping clients: oleg312-client.virtnet /mnt/lustre (opts:) Stopping client oleg312-client.virtnet /mnt/lustre opts: Stopping clients: oleg312-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg312-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg312-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg312-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg312-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg312-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 93 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 93 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 98 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 98 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 99 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 99 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 100 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 100 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 101 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 101 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 102 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 102 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 103 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 103 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 104 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 104 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 105 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 105 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 106 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 106 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 108 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 108 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 109 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 109 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 110 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 110 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 111 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 111 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 112 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 112 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 113 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 113 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 114 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 115 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 115 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 116 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 116 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 117 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 117 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 119 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 120 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 122 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 146 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 147 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 148 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 148 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 149 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 149 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 150 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 150 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 155 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 155 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 156 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 156 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 157 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 157 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 158 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 159 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 160 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 161 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 161 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 162 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 162 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 163 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 163 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 164 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 164 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 165 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 165 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 166 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 166 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 167 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 167 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 168 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 168 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 169 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 169 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 171 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 172 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 173 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 178 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 178 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 180 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 180 badness 1 to 3 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 1596 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1596 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1658 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 364k/440k (129k/236k), time: 0.03/ 0.01/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 34.27MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/281 Pass 2: Checking directory structure Pass 2: Memory used: 364k/0k (84k/281k), time: 0.57/ 0.15/ 0.05 Pass 2: I/O read: 25MB, write: 0MB, rate: 43.94MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 364k/0k (84k/281k), time: 0.61/ 0.16/ 0.06 Pass 3: Memory used: 364k/0k (82k/283k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 364k/0k (78k/287k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 3048.78MB/s Pass 5: Checking group summary information Pass 5: Memory used: 504k/0k (77k/428k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 605.69MB/s 276 inodes used (8.85%, out of 3120) 1 non-contiguous file (0.4%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 Extent depth histogram: 203 11415 blocks used (22.83%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 504k/0k (81k/424k), time: 0.62/ 0.16/ 0.06 I/O read: 25MB, write: 0MB, rate: 40.26MB/s Stopping clients: oleg312-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg312-client.virtnet /mnt/lustre2 (opts:-f) oleg312-server: oleg312-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1049: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg312-server' oleg312-server: oleg312-server.virtnet: executing load_modules_local oleg312-server: Loading modules from /home/green/git/lustre-release/lustre oleg312-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1049: echo: write error: Device or resource busy oleg312-server: detected 4 online CPUs by sysfs oleg312-server: MODOPTS_LIBCFS= oleg312-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg312-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg312-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg312-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg312-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg312-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg312-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg312-server: oleg312-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg312-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg312-server: oleg312-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg312-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg312-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg312-server stop mds service on oleg312-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg312-server stop mds service on oleg312-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg312-server