== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 08:33:25 (1787402005) oleg142-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg142-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg142-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg142-client: oleg142-server: ssh exited with exit code 2 oleg142-server: oleg142-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg142-server' oleg142-server: oleg142-server.virtnet: executing load_modules_local oleg142-server: Loading modules from /home/green/git/lustre-release/lustre oleg142-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg142-server: detected 4 online CPUs by sysfs oleg142-server: MODOPTS_LIBCFS= oleg142-server: Force libcfs to create 2 CPU partitions oleg142-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg142-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg142-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg142-server' oleg142-server: oleg142-server.virtnet: executing load_modules_local oleg142-server: Loading modules from /home/green/git/lustre-release/lustre oleg142-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg142-server: detected 4 online CPUs by sysfs oleg142-server: MODOPTS_LIBCFS= oleg142-server: Force libcfs to create 2 CPU partitions Permanent disk data: Device: /dev/mapper/mds1_flakey Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg142-server: oleg142-server.virtnet: executing set_default_debug -1 all pdsh@oleg142-client: oleg142-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg142-server: oleg142-server.virtnet: executing set_default_debug -1 all pdsh@oleg142-client: oleg142-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg142-client.virtnet: -o user_xattr,flock 192.168.201.142@tcp:/lustre /mnt/lustre Starting client oleg142-client.virtnet: -o user_xattr,flock 192.168.201.142@tcp:/lustre /mnt/lustre Started clients oleg142-client.virtnet: 192.168.201.142@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg142-client.virtnet: -o user_xattr,flock 192.168.201.142@tcp:/lustre /mnt/lustre2 Starting client oleg142-client.virtnet: -o user_xattr,flock 192.168.201.142@tcp:/lustre /mnt/lustre2 Started clients oleg142-client.virtnet: 192.168.201.142@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 173973 173988 to complete - link 529 (time 1787402140.53 total 10.01 last 52.85) - link 1075 (time 1787402150.53 total 20.01 last 54.57) - link 1628 (time 1787402160.55 total 30.03 last 55.22) - link 2058 (time 1787402170.57 total 40.05 last 42.92) - link 2508 (time 1787402180.57 total 50.05 last 44.99) - link 2877 (time 1787402190.59 total 60.07 last 36.82) - link 3292 (time 1787402200.59 total 70.08 last 41.48) - link 3806 (time 1787402210.61 total 80.09 last 51.32) - link 4278 (time 1787402220.63 total 90.11 last 47.12) - link 4717 (time 1787402230.65 total 100.13 last 43.80) - link 5161 (time 1787402240.65 total 110.13 last 44.40) - link 5661 (time 1787402250.66 total 120.14 last 49.98) - link 6162 (time 1787402260.67 total 130.15 last 50.04) - link 6683 (time 1787402270.68 total 140.16 last 52.05) - link 7218 (time 1787402280.72 total 150.20 last 53.30) - link 7631 (time 1787402290.74 total 160.22 last 41.22) - link 8087 (time 1787402300.75 total 170.23 last 45.54) - link 8587 (time 1787402310.76 total 180.24 last 49.96) - link 9043 (time 1787402320.78 total 190.26 last 45.51) - link 9561 (time 1787402330.78 total 200.26 last 51.76) - link 10000 (time 1787402338.25 total 207.73 last 58.83) - link 10497 (time 1787402348.25 total 217.73 last 49.69) - link 10915 (time 1787402358.25 total 227.73 last 41.78) - link 11415 (time 1787402368.26 total 237.74 last 49.94) - link 11868 (time 1787402378.28 total 247.76 last 45.24) - link 12338 (time 1787402388.29 total 257.77 last 46.93) - link 12873 (time 1787402398.29 total 267.77 last 53.50) - link 13424 (time 1787402408.29 total 277.77 last 55.09) - link 13959 (time 1787402418.31 total 287.79 last 53.43) - link 14496 (time 1787402428.31 total 297.79 last 53.68) - link 15022 (time 1787402438.31 total 307.79 last 52.59) - link 15597 (time 1787402448.34 total 317.82 last 57.38) - link 16147 (time 1787402458.36 total 327.84 last 54.89) - link 16555 (time 1787402468.36 total 337.85 last 40.76) - link 17019 (time 1787402478.39 total 347.87 last 46.30) - link 17431 (time 1787402488.39 total 357.87 last 41.19) - link 17911 (time 1787402498.40 total 367.88 last 47.97) - link 18437 (time 1787402508.40 total 377.89 last 52.56) - link 18993 (time 1787402518.42 total 387.90 last 55.54) - link 19570 (time 1787402528.42 total 397.90 last 57.68) total: 20000 link in 405.16 seconds: 49.36 ops/second - link 533 (time 1787402140.17 total 10.01 last 53.22) - link 1081 (time 1787402150.18 total 20.02 last 54.76) - link 1638 (time 1787402160.22 total 30.06 last 55.50) - link 2086 (time 1787402170.25 total 40.09 last 44.65) - link 2537 (time 1787402180.26 total 50.10 last 45.07) - link 2906 (time 1787402190.27 total 60.11 last 36.87) - link 3322 (time 1787402200.29 total 70.13 last 41.52) - link 3839 (time 1787402210.29 total 80.13 last 51.67) - link 4334 (time 1787402220.29 total 90.13 last 49.50) - link 4774 (time 1787402230.31 total 100.15 last 43.93) - link 5214 (time 1787402240.32 total 110.16 last 43.98) - link 5708 (time 1787402250.33 total 120.17 last 49.35) - link 6198 (time 1787402260.36 total 130.20 last 48.85) - link 6729 (time 1787402270.36 total 140.20 last 53.10) - link 7265 (time 1787402280.36 total 150.20 last 53.57) - link 7690 (time 1787402290.37 total 160.21 last 42.47) - link 8133 (time 1787402300.38 total 170.22 last 44.28) - link 8633 (time 1787402310.41 total 180.25 last 49.83) - link 9103 (time 1787402320.43 total 190.27 last 46.90) - link 9595 (time 1787402330.44 total 200.28 last 49.16) - link 10000 (time 1787402337.46 total 207.30 last 57.72) - link 10535 (time 1787402347.48 total 217.31 last 53.40) - link 10953 (time 1787402357.48 total 227.32 last 41.77) - link 11438 (time 1787402367.50 total 237.34 last 48.41) - link 11896 (time 1787402377.50 total 247.34 last 45.80) - link 12367 (time 1787402387.52 total 257.36 last 47.04) - link 12890 (time 1787402397.52 total 267.36 last 52.27) - link 13426 (time 1787402407.53 total 277.37 last 53.57) - link 13968 (time 1787402417.54 total 287.38 last 54.16) - link 14508 (time 1787402427.56 total 297.39 last 53.90) - link 15028 (time 1787402437.57 total 307.41 last 51.92) - link 15615 (time 1787402447.58 total 317.42 last 58.62) - link 16178 (time 1787402457.60 total 327.44 last 56.19) - link 16594 (time 1787402467.62 total 337.46 last 41.54) - link 17061 (time 1787402477.62 total 347.46 last 46.69) - link 17464 (time 1787402487.65 total 357.49 last 40.17) - link 17928 (time 1787402497.67 total 367.51 last 46.32) - link 18466 (time 1787402507.68 total 377.52 last 53.74) - link 19015 (time 1787402517.70 total 387.54 last 54.80) - link 19563 (time 1787402527.70 total 397.54 last 54.77) - link 20000 (time 1787402534.71 total 404.55 last 62.33) - link 20402 (time 1787402544.72 total 414.56 last 40.18) - link 20778 (time 1787402554.74 total 424.58 last 37.50) - link 21101 (time 1787402564.75 total 434.59 last 32.27) - link 21524 (time 1787402574.76 total 444.60 last 42.29) - link 21904 (time 1787402584.79 total 454.63 last 37.89) - link 22283 (time 1787402594.79 total 464.63 last 37.90) - link 22658 (time 1787402604.79 total 474.63 last 37.49) - link 23016 (time 1787402614.80 total 484.64 last 35.75) - link 23378 (time 1787402624.81 total 494.65 last 36.17) - link 23747 (time 1787402634.82 total 504.66 last 36.85) - link 24108 (time 1787402644.83 total 514.67 last 36.09) - link 24458 (time 1787402654.83 total 524.67 last 34.99) - link 24786 (time 1787402664.88 total 534.72 last 32.63) - link 25190 (time 1787402674.90 total 544.74 last 40.35) - link 25532 (time 1787402684.92 total 554.76 last 34.11) - link 25866 (time 1787402694.93 total 564.77 last 33.37) - link 26272 (time 1787402704.95 total 574.79 last 40.53) - link 26620 (time 1787402714.95 total 584.79 last 34.78) - link 26968 (time 1787402724.98 total 594.82 last 34.71) - link 27308 (time 1787402735.02 total 604.86 last 33.87) - link 27621 (time 1787402745.04 total 614.88 last 31.23) - link 27974 (time 1787402755.06 total 624.90 last 35.21) - link 28304 (time 1787402765.06 total 634.90 last 32.99) - link 28695 (time 1787402775.08 total 644.92 last 39.04) - link 29053 (time 1787402785.10 total 654.94 last 35.74) - link 29405 (time 1787402795.11 total 664.95 last 35.15) - link 29761 (time 1787402805.14 total 674.98 last 35.47) - link 30000 (time 1787402812.86 total 682.70 last 30.97) - link 30329 (time 1787402822.86 total 692.70 last 32.89) - link 30669 (time 1787402832.88 total 702.72 last 33.93) - link 31064 (time 1787402842.92 total 712.76 last 39.36) - link 31516 (time 1787402852.93 total 722.77 last 45.15) - link 31919 (time 1787402862.95 total 732.79 last 40.24) - link 32305 (time 1787402872.96 total 742.80 last 38.54) - link 32704 (time 1787402883.01 total 752.84 last 39.73) - link 33055 (time 1787402893.03 total 762.87 last 35.01) - link 33446 (time 1787402903.03 total 772.87 last 39.10) - link 33832 (time 1787402913.03 total 782.87 last 38.59) - link 34207 (time 1787402923.05 total 792.89 last 37.43) - link 34539 (time 1787402933.06 total 802.90 last 33.16) - link 34936 (time 1787402943.07 total 812.91 last 39.68) - link 35303 (time 1787402953.09 total 822.93 last 36.61) - link 35649 (time 1787402963.12 total 832.96 last 34.52) - link 36085 (time 1787402973.13 total 842.97 last 43.54) - link 36480 (time 1787402983.15 total 852.99 last 39.41) - link 36846 (time 1787402993.19 total 863.03 last 36.47) - link 37228 (time 1787403003.20 total 873.04 last 38.16) - link 37635 (time 1787403013.21 total 883.05 last 40.66) - link 37992 (time 1787403023.22 total 893.06 last 35.65) - link 38390 (time 1787403033.23 total 903.07 last 39.75) - link 38738 (time 1787403043.24 total 913.07 last 34.80) - link 39129 (time 1787403053.25 total 923.09 last 39.03) - link 39508 (time 1787403063.27 total 933.11 last 37.84) - link 39861 (time 1787403073.29 total 943.13 last 35.21) total: 40000 link in 947.60 seconds: 42.21 ops/second Stopping clients: oleg142-client.virtnet /mnt/lustre (opts:) Stopping client oleg142-client.virtnet /mnt/lustre opts: Stopping clients: oleg142-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg142-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg142-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg142-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg142-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg142-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 147 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 150 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 153 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 157 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 157 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 159 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 160 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 161 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 161 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 162 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 162 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 163 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 163 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 164 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 164 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 165 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 165 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 166 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 166 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 167 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 167 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 168 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 168 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 169 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 169 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 170 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 170 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 171 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 171 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 172 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 172 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 173 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 173 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 174 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 174 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 175 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 175 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 176 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 177 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 177 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 178 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 178 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 179 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 179 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 180 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 180 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 181 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 181 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 182 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 182 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 183 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 183 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 184 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 184 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 185 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 185 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 186 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 186 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 187 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 187 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 188 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 188 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 189 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 189 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 190 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 190 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 191 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 191 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 192 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 192 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 194 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 195 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 196 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 201 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 202 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 202 badness 1 to 3 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 1596 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1596 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1633 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1633 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1634 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1634 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1635 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 364k/440k (128k/237k), time: 0.03/ 0.00/ 0.01 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 38.88MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/282 Pass 2: Checking directory structure Pass 2: Memory used: 364k/0k (83k/282k), time: 0.56/ 0.16/ 0.05 Pass 2: I/O read: 25MB, write: 0MB, rate: 44.64MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 364k/0k (84k/281k), time: 0.61/ 0.16/ 0.05 Pass 3: Memory used: 364k/0k (82k/283k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 364k/0k (78k/287k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 5434.78MB/s Pass 5: Checking group summary information Pass 5: Memory used: 504k/0k (77k/428k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 678.89MB/s 276 inodes used (8.85%, out of 3120) 2 non-contiguous files (0.7%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 Extent depth histogram: 203 11404 blocks used (22.81%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 504k/0k (81k/424k), time: 0.61/ 0.16/ 0.05 I/O read: 25MB, write: 0MB, rate: 40.96MB/s Stopping clients: oleg142-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg142-client.virtnet /mnt/lustre2 (opts:-f) oleg142-server: oleg142-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg142-server' oleg142-server: oleg142-server.virtnet: executing load_modules_local oleg142-server: Loading modules from /home/green/git/lustre-release/lustre oleg142-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg142-server: detected 4 online CPUs by sysfs oleg142-server: MODOPTS_LIBCFS= oleg142-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg142-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg142-server: oleg142-server.virtnet: executing set_default_debug -1 all pdsh@oleg142-client: oleg142-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg142-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg142-server: oleg142-server.virtnet: executing set_default_debug -1 all pdsh@oleg142-client: oleg142-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg142-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg142-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg142-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg142-server: oleg142-server.virtnet: executing set_default_debug -1 all pdsh@oleg142-client: oleg142-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg142-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg142-server: oleg142-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg142-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg142-server: oleg142-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg142-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg142-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg142-server stop mds service on oleg142-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg142-server stop mds service on oleg142-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg142-server