== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 02:33:39 (1781246019) oleg210-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg210-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg210-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg210-client: oleg210-server: ssh exited with exit code 2 oleg210-server: oleg210-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg210-server' oleg210-server: oleg210-server.virtnet: executing load_modules_local oleg210-server: Loading modules from /home/green/git/lustre-release/lustre oleg210-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg210-server: detected 4 online CPUs by sysfs oleg210-server: MODOPTS_LIBCFS= oleg210-server: Force libcfs to create 2 CPU partitions oleg210-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg210-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg210-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg210-server' oleg210-server: oleg210-server.virtnet: executing load_modules_local oleg210-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg210-server: Loading modules from /home/green/git/lustre-release/lustre oleg210-server: detected 4 online CPUs by sysfs oleg210-server: MODOPTS_LIBCFS= oleg210-server: Force libcfs to create 2 CPU partitions Permanent disk data: Device: /dev/mapper/mds1_flakey Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg210-server: oleg210-server.virtnet: executing set_default_debug -1 all pdsh@oleg210-client: oleg210-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg210-server: oleg210-server.virtnet: executing set_default_debug -1 all pdsh@oleg210-client: oleg210-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg210-client.virtnet: -o user_xattr,flock 192.168.202.110@tcp:/lustre /mnt/lustre Starting client oleg210-client.virtnet: -o user_xattr,flock 192.168.202.110@tcp:/lustre /mnt/lustre Started clients oleg210-client.virtnet: 192.168.202.110@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg210-client.virtnet: -o user_xattr,flock 192.168.202.110@tcp:/lustre /mnt/lustre2 Starting client oleg210-client.virtnet: -o user_xattr,flock 192.168.202.110@tcp:/lustre /mnt/lustre2 Started clients oleg210-client.virtnet: 192.168.202.110@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 171213 171228 to complete - link 495 (time 1781246181.69 total 10.00 last 49.48) - link 951 (time 1781246191.73 total 20.04 last 45.44) - link 1483 (time 1781246201.74 total 30.05 last 53.13) - link 2039 (time 1781246211.75 total 40.06 last 55.55) - link 2566 (time 1781246221.75 total 50.06 last 52.69) - link 3126 (time 1781246231.76 total 60.07 last 55.95) - link 3773 (time 1781246241.76 total 70.07 last 64.69) - link 4370 (time 1781246251.77 total 80.08 last 59.68) - link 4955 (time 1781246261.78 total 90.09 last 58.44) - link 5460 (time 1781246271.78 total 100.09 last 50.47) - link 5974 (time 1781246281.80 total 110.11 last 51.32) - link 6537 (time 1781246291.80 total 120.12 last 56.27) - link 7045 (time 1781246301.82 total 130.13 last 50.74) - link 7533 (time 1781246311.82 total 140.13 last 48.77) - link 8034 (time 1781246321.86 total 150.17 last 49.93) - link 8655 (time 1781246331.87 total 160.18 last 62.02) - link 9224 (time 1781246341.87 total 170.19 last 56.88) - link 9898 (time 1781246351.89 total 180.20 last 67.27) - link 10497 (time 1781246361.90 total 190.21 last 59.88) - link 11142 (time 1781246371.92 total 200.23 last 64.36) - link 11740 (time 1781246381.92 total 210.23 last 59.77) - link 12269 (time 1781246391.92 total 220.24 last 52.90) - link 12851 (time 1781246401.95 total 230.26 last 58.04) - link 13407 (time 1781246411.96 total 240.27 last 55.56) - link 13927 (time 1781246421.96 total 250.27 last 51.99) - link 14305 (time 1781246431.96 total 260.27 last 37.79) - link 14750 (time 1781246441.97 total 270.28 last 44.47) - link 15271 (time 1781246451.98 total 280.30 last 52.03) - link 15858 (time 1781246462.00 total 290.31 last 58.63) - link 16426 (time 1781246472.01 total 300.32 last 56.74) - link 17078 (time 1781246482.01 total 310.32 last 65.19) - link 17684 (time 1781246492.02 total 320.33 last 60.55) - link 18247 (time 1781246502.05 total 330.36 last 56.12) - link 18847 (time 1781246512.05 total 340.36 last 59.97) - link 19427 (time 1781246522.05 total 350.37 last 57.99) - link 19963 (time 1781246532.07 total 360.38 last 53.53) total: 20000 link in 361.29 seconds: 55.36 ops/second - link 497 (time 1781246181.67 total 10.00 last 49.69) - link 954 (time 1781246191.67 total 20.00 last 45.70) - link 1474 (time 1781246201.69 total 30.02 last 51.90) - link 2021 (time 1781246211.69 total 40.02 last 54.69) - link 2526 (time 1781246221.69 total 50.03 last 50.49) - link 3091 (time 1781246231.70 total 60.03 last 56.45) - link 3747 (time 1781246241.71 total 70.04 last 65.56) - link 4332 (time 1781246251.72 total 80.05 last 58.46) - link 4911 (time 1781246261.74 total 90.07 last 57.77) - link 5422 (time 1781246271.75 total 100.08 last 51.02) - link 5935 (time 1781246281.76 total 110.09 last 51.28) - link 6489 (time 1781246291.78 total 120.11 last 55.30) - link 7017 (time 1781246301.78 total 130.11 last 52.77) - link 7511 (time 1781246311.81 total 140.15 last 49.23) - link 8004 (time 1781246321.83 total 150.16 last 49.23) - link 8636 (time 1781246331.84 total 160.17 last 63.15) - link 9211 (time 1781246341.85 total 170.18 last 57.42) - link 9883 (time 1781246351.86 total 180.19 last 67.16) - link 10485 (time 1781246361.87 total 190.20 last 60.13) - link 11158 (time 1781246371.89 total 200.23 last 67.13) - link 11744 (time 1781246381.90 total 210.23 last 58.58) - link 12293 (time 1781246391.91 total 220.24 last 54.86) - link 12900 (time 1781246401.91 total 230.24 last 60.66) - link 13459 (time 1781246411.92 total 240.25 last 55.87) - link 13973 (time 1781246421.92 total 250.25 last 51.38) - link 14356 (time 1781246431.93 total 260.26 last 38.28) - link 14787 (time 1781246441.94 total 270.27 last 43.06) - link 15302 (time 1781246451.95 total 280.28 last 51.44) - link 15870 (time 1781246461.95 total 290.29 last 56.77) - link 16439 (time 1781246471.96 total 300.29 last 56.86) - link 17102 (time 1781246481.97 total 310.30 last 66.23) - link 17708 (time 1781246491.98 total 320.31 last 60.56) - link 18265 (time 1781246501.99 total 330.32 last 55.63) - link 18843 (time 1781246512.03 total 340.36 last 57.57) - link 19446 (time 1781246522.03 total 350.37 last 60.28) - link 19979 (time 1781246532.04 total 360.37 last 53.29) - link 20251 (time 1781246542.05 total 370.38 last 27.17) - link 20525 (time 1781246552.08 total 380.41 last 27.32) - link 20828 (time 1781246562.08 total 390.41 last 30.29) - link 21265 (time 1781246572.10 total 400.43 last 43.62) - link 21683 (time 1781246582.10 total 410.44 last 41.78) - link 21966 (time 1781246592.12 total 420.45 last 28.25) - link 22315 (time 1781246602.13 total 430.46 last 34.86) - link 22659 (time 1781246612.15 total 440.48 last 34.34) - link 22934 (time 1781246622.17 total 450.50 last 27.45) - link 23299 (time 1781246632.19 total 460.52 last 36.41) - link 23690 (time 1781246642.23 total 470.57 last 38.93) - link 24109 (time 1781246652.24 total 480.57 last 41.87) - link 24525 (time 1781246662.26 total 490.59 last 41.53) - link 24992 (time 1781246672.26 total 500.60 last 46.67) - link 25438 (time 1781246682.26 total 510.60 last 44.60) - link 25889 (time 1781246692.29 total 520.62 last 45.00) - link 26293 (time 1781246702.30 total 530.63 last 40.33) - link 26701 (time 1781246712.30 total 540.63 last 40.80) - link 27059 (time 1781246722.31 total 550.64 last 35.78) - link 27335 (time 1781246732.32 total 560.65 last 27.58) - link 27680 (time 1781246742.34 total 570.67 last 34.43) - link 28100 (time 1781246752.35 total 580.68 last 41.95) - link 28519 (time 1781246762.37 total 590.70 last 41.81) - link 28908 (time 1781246772.38 total 600.72 last 38.85) - link 29277 (time 1781246782.39 total 610.73 last 36.86) - link 29637 (time 1781246792.43 total 620.76 last 35.87) - link 29975 (time 1781246802.45 total 630.78 last 33.72) - link 30353 (time 1781246812.47 total 640.80 last 37.75) - link 30729 (time 1781246822.49 total 650.82 last 37.50) - link 31029 (time 1781246832.50 total 660.83 last 29.97) - link 31401 (time 1781246842.53 total 670.86 last 37.10) - link 31769 (time 1781246852.60 total 680.94 last 36.52) - link 32114 (time 1781246862.62 total 690.95 last 34.45) - link 32497 (time 1781246872.62 total 700.95 last 38.29) - link 32933 (time 1781246882.63 total 710.96 last 43.56) - link 33321 (time 1781246892.65 total 720.98 last 38.72) - link 33538 (time 1781246902.70 total 731.03 last 21.60) - link 33848 (time 1781246912.74 total 741.07 last 30.86) - link 34194 (time 1781246922.75 total 751.08 last 34.56) - link 34537 (time 1781246932.76 total 761.10 last 34.26) - link 34913 (time 1781246942.76 total 771.10 last 37.60) - link 35333 (time 1781246952.78 total 781.11 last 41.95) - link 35782 (time 1781246962.79 total 791.12 last 44.83) - link 36130 (time 1781246972.80 total 801.14 last 34.76) - link 36459 (time 1781246982.83 total 811.16 last 32.82) - link 36852 (time 1781246992.84 total 821.17 last 39.26) - link 37263 (time 1781247002.87 total 831.20 last 40.97) - link 37552 (time 1781247012.90 total 841.23 last 28.82) - link 37840 (time 1781247022.91 total 851.25 last 28.75) - link 38169 (time 1781247032.92 total 861.25 last 32.89) - link 38479 (time 1781247042.94 total 871.27 last 30.93) - link 38739 (time 1781247052.95 total 881.28 last 25.98) - link 39040 (time 1781247062.96 total 891.29 last 30.05) - link 39361 (time 1781247072.96 total 901.30 last 32.09) - link 39689 (time 1781247082.96 total 911.30 last 32.80) total: 40000 link in 918.65 seconds: 43.54 ops/second Stopping clients: oleg210-client.virtnet /mnt/lustre (opts:) Stopping client oleg210-client.virtnet /mnt/lustre opts: Stopping clients: oleg210-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg210-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg210-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg210-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg210-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg210-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 155 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 155 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 156 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 156 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 157 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 157 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 158 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 159 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 160 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 161 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 161 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 162 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 162 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 163 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 163 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 164 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 164 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 165 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 165 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 166 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 166 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 167 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 167 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 168 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 168 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 169 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 169 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 170 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 170 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 171 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 172 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 172 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 173 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 173 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 174 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 174 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 175 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 175 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 176 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 176 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 177 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 177 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 178 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 178 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 179 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 179 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 180 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 180 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 181 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 181 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 182 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 182 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 183 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 183 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 184 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 184 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 185 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 185 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 186 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 186 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 187 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 187 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 189 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 190 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 191 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 196 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 196 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 198 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 198 badness 1 to 3 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 1596 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1596 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1633 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1633 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1634 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 1635 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1635 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1636 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1636 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1637 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1637 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1638 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1638 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1639 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1639 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1640 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 364k/440k (128k/237k), time: 0.04/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 22.97MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/282 Pass 2: Checking directory structure Pass 2: Memory used: 364k/0k (83k/282k), time: 0.82/ 0.15/ 0.06 Pass 2: I/O read: 25MB, write: 0MB, rate: 30.46MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 364k/0k (83k/282k), time: 0.89/ 0.15/ 0.06 Pass 3: Memory used: 364k/0k (82k/283k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 364k/0k (78k/287k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 5847.95MB/s Pass 5: Checking group summary information Pass 5: Memory used: 504k/0k (77k/428k), time: 0.01/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 150.51MB/s 276 inodes used (8.85%, out of 3120) 2 non-contiguous files (0.7%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 Extent depth histogram: 203 11434 blocks used (22.87%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 504k/0k (81k/424k), time: 0.90/ 0.15/ 0.06 I/O read: 25MB, write: 0MB, rate: 27.89MB/s Stopping clients: oleg210-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg210-client.virtnet /mnt/lustre2 (opts:-f) oleg210-server: oleg210-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg210-server' oleg210-server: oleg210-server.virtnet: executing load_modules_local oleg210-server: Loading modules from /home/green/git/lustre-release/lustre oleg210-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg210-server: detected 4 online CPUs by sysfs oleg210-server: MODOPTS_LIBCFS= oleg210-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg210-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg210-server: oleg210-server.virtnet: executing set_default_debug -1 all pdsh@oleg210-client: oleg210-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg210-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg210-server: oleg210-server.virtnet: executing set_default_debug -1 all pdsh@oleg210-client: oleg210-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg210-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg210-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg210-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg210-server: oleg210-server.virtnet: executing set_default_debug -1 all pdsh@oleg210-client: oleg210-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg210-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg210-server: oleg210-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg210-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg210-server: oleg210-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg210-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg210-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg210-server stop mds service on oleg210-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg210-server stop mds service on oleg210-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg210-server