== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 14:34:13 (1758738853) oleg255-server: debugfs 1.47.1-wc2 (08-Nov-2024) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg255-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg255-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg255-client: oleg255-server: ssh exited with exit code 2 oleg255-server: oleg255-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg255-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg255-server: detected 4 online CPUs by sysfs oleg255-server: MODOPTS_LIBCFS= oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg255-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg255-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: MODOPTS_LIBCFS= oleg255-server: Force libcfs to create 2 CPU partitions Permanent disk data: Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,^extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,^extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Writing CONFIGS/mountdata Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg255-client.virtnet: -o user_xattr,flock 192.168.202.155@tcp:/lustre /mnt/lustre Starting client oleg255-client.virtnet: -o user_xattr,flock 192.168.202.155@tcp:/lustre /mnt/lustre Started clients oleg255-client.virtnet: 192.168.202.155@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg255-client.virtnet: -o user_xattr,flock 192.168.202.155@tcp:/lustre /mnt/lustre2 Starting client oleg255-client.virtnet: -o user_xattr,flock 192.168.202.155@tcp:/lustre /mnt/lustre2 Started clients oleg255-client.virtnet: 192.168.202.155@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 170352 170367 to complete - link 706 (time 1758738958.33 total 10.00 last 70.60) - link 1405 (time 1758738968.34 total 20.01 last 69.83) - link 2073 (time 1758738978.34 total 30.01 last 66.78) - link 2781 (time 1758738988.35 total 40.02 last 70.77) - link 3469 (time 1758738998.36 total 50.03 last 68.72) - link 4123 (time 1758739008.36 total 60.04 last 65.36) - link 4788 (time 1758739018.37 total 70.04 last 66.45) - link 5443 (time 1758739028.38 total 80.05 last 65.42) - link 6038 (time 1758739038.40 total 90.07 last 59.39) - link 6693 (time 1758739048.41 total 100.08 last 65.45) - link 7418 (time 1758739058.41 total 110.08 last 72.48) - link 8143 (time 1758739068.42 total 120.09 last 72.46) - link 8839 (time 1758739078.42 total 130.09 last 69.56) - link 9496 (time 1758739088.43 total 140.10 last 65.67) - link 10000 (time 1758739096.00 total 147.67 last 66.59) - link 10699 (time 1758739106.01 total 157.68 last 69.81) - link 11411 (time 1758739116.02 total 167.69 last 71.14) - link 12078 (time 1758739126.03 total 177.70 last 66.60) - link 12731 (time 1758739136.04 total 187.71 last 65.24) - link 13394 (time 1758739146.05 total 197.72 last 66.23) - link 14080 (time 1758739156.06 total 207.73 last 68.53) - link 14726 (time 1758739166.08 total 217.75 last 64.52) - link 15352 (time 1758739176.08 total 227.75 last 62.58) - link 15967 (time 1758739186.09 total 237.76 last 61.43) - link 16634 (time 1758739196.10 total 247.77 last 66.66) - link 17278 (time 1758739206.10 total 257.77 last 64.39) - link 17943 (time 1758739216.10 total 267.77 last 66.46) - link 18585 (time 1758739226.11 total 277.78 last 64.18) - link 19275 (time 1758739236.11 total 287.79 last 68.95) - link 19947 (time 1758739246.13 total 297.80 last 67.09) total: 20000 link in 298.57 seconds: 66.99 ops/second - link 709 (time 1758738958.35 total 10.00 last 70.90) - link 1410 (time 1758738968.36 total 20.01 last 70.06) - link 2083 (time 1758738978.38 total 30.02 last 67.20) - link 2783 (time 1758738988.38 total 40.02 last 70.00) - link 3470 (time 1758738998.39 total 50.04 last 68.59) - link 4121 (time 1758739008.40 total 60.04 last 65.06) - link 4776 (time 1758739018.40 total 70.04 last 65.49) - link 5445 (time 1758739028.43 total 80.08 last 66.68) - link 6029 (time 1758739038.45 total 90.09 last 58.32) - link 6682 (time 1758739048.45 total 100.10 last 65.24) - link 7405 (time 1758739058.47 total 110.11 last 72.22) - link 8136 (time 1758739068.47 total 120.12 last 73.06) - link 8838 (time 1758739078.48 total 130.12 last 70.17) - link 9493 (time 1758739088.49 total 140.14 last 65.38) - link 10000 (time 1758739096.00 total 147.64 last 67.55) - link 10708 (time 1758739106.00 total 157.65 last 70.79) - link 11419 (time 1758739116.01 total 167.65 last 71.07) - link 12078 (time 1758739126.01 total 177.66 last 65.87) - link 12734 (time 1758739136.02 total 187.67 last 65.52) - link 13399 (time 1758739146.02 total 197.67 last 66.48) - link 14068 (time 1758739156.03 total 207.67 last 66.89) - link 14715 (time 1758739166.03 total 217.68 last 64.67) - link 15347 (time 1758739176.04 total 227.68 last 63.15) - link 15966 (time 1758739186.05 total 237.70 last 61.81) - link 16626 (time 1758739196.06 total 247.70 last 65.98) - link 17253 (time 1758739206.07 total 257.71 last 62.64) - link 17919 (time 1758739216.07 total 267.71 last 66.59) - link 18564 (time 1758739226.08 total 277.72 last 64.43) - link 19249 (time 1758739236.09 total 287.73 last 68.44) - link 19912 (time 1758739246.10 total 297.74 last 66.23) - link 20377 (time 1758739256.11 total 307.75 last 46.45) - link 20821 (time 1758739266.11 total 317.76 last 44.38) - link 21302 (time 1758739276.13 total 327.77 last 48.05) - link 21773 (time 1758739286.13 total 337.78 last 47.07) - link 22242 (time 1758739296.15 total 347.79 last 46.84) - link 22711 (time 1758739306.15 total 357.79 last 46.90) - link 23146 (time 1758739316.16 total 367.81 last 43.44) - link 23584 (time 1758739326.16 total 377.81 last 43.79) - link 24018 (time 1758739336.17 total 387.82 last 43.35) - link 24487 (time 1758739346.18 total 397.83 last 46.86) - link 25006 (time 1758739356.19 total 407.83 last 51.87) - link 25485 (time 1758739366.19 total 417.84 last 47.89) - link 25933 (time 1758739376.20 total 427.85 last 44.74) - link 26356 (time 1758739386.21 total 437.85 last 42.28) - link 26778 (time 1758739396.22 total 447.87 last 42.15) - link 27237 (time 1758739406.24 total 457.89 last 45.81) - link 27698 (time 1758739416.27 total 467.91 last 45.99) - link 28179 (time 1758739426.29 total 477.93 last 48.00) - link 28625 (time 1758739436.29 total 487.94 last 44.57) - link 29035 (time 1758739446.31 total 497.95 last 40.94) - link 29452 (time 1758739456.34 total 507.99 last 41.56) - link 29875 (time 1758739466.35 total 517.99 last 42.28) - link 30000 (time 1758739469.44 total 521.09 last 40.39) - link 30470 (time 1758739479.44 total 531.09 last 47.00) - link 30917 (time 1758739489.46 total 541.10 last 44.63) - link 31348 (time 1758739499.47 total 551.11 last 43.07) - link 31790 (time 1758739509.48 total 561.13 last 44.13) - link 32263 (time 1758739519.49 total 571.13 last 47.28) - link 32694 (time 1758739529.49 total 581.13 last 43.10) - link 33141 (time 1758739539.50 total 591.14 last 44.65) - link 33570 (time 1758739549.52 total 601.16 last 42.82) - link 34026 (time 1758739559.53 total 611.18 last 45.53) - link 34444 (time 1758739569.54 total 621.18 last 41.77) - link 34903 (time 1758739579.57 total 631.21 last 45.78) - link 35344 (time 1758739589.58 total 641.23 last 44.03) - link 35751 (time 1758739599.60 total 651.25 last 40.62) - link 36129 (time 1758739609.60 total 661.25 last 37.79) - link 36557 (time 1758739619.61 total 671.25 last 42.78) - link 36995 (time 1758739629.63 total 681.28 last 43.70) - link 37418 (time 1758739639.64 total 691.28 last 42.28) - link 37847 (time 1758739649.65 total 701.29 last 42.86) - link 38307 (time 1758739659.65 total 711.29 last 45.98) - link 38755 (time 1758739669.66 total 721.31 last 44.73) - link 39205 (time 1758739679.71 total 731.35 last 44.81) - link 39580 (time 1758739689.71 total 741.36 last 37.46) total: 40000 link in 750.89 seconds: 53.27 ops/second Stopping clients: oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre opts: Stopping clients: oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg255-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg255-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg255-server: e2fsck 1.47.1-wc2 (08-Nov-2024) oleg255-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2675: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 151 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 152 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 156 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 157 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 160 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 161 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 162 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 163 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 164 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 165 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 166 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 167 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 168 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 169 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 170 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 171 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 172 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 173 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 174 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 175 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 176 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 177 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 178 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 179 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 180 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 181 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 182 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 183 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 184 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 186 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 187 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 188 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 193 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2655: increase inode 194 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 194 badness 1 to 3 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2675: increase inode 1596 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 1633 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 1634 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 1635 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 1636 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 1638 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 1639 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 1640 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 1641 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2675: increase inode 1642 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 352k/440k (126k/227k), time: 0.02/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 64.80MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/281 Pass 2: Checking directory structure Pass 2: Memory used: 352k/0k (82k/271k), time: 0.36/ 0.16/ 0.04 Pass 2: I/O read: 25MB, write: 0MB, rate: 69.41MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 352k/0k (83k/270k), time: 0.41/ 0.17/ 0.05 Pass 3: Memory used: 352k/0k (81k/272k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 352k/0k (78k/275k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 6134.97MB/s Pass 5: Checking group summary information Pass 5: Memory used: 492k/0k (77k/416k), time: 0.01/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 178.19MB/s 276 inodes used (8.85%, out of 3120) 3 non-contiguous files (1.1%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 11412 blocks used (22.82%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 492k/0k (80k/413k), time: 0.42/ 0.17/ 0.05 I/O read: 25MB, write: 0MB, rate: 59.51MB/s Stopping clients: oleg255-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg255-client.virtnet /mnt/lustre2 (opts:-f) oleg255-server: oleg255-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg255-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg255-server: detected 4 online CPUs by sysfs oleg255-server: MODOPTS_LIBCFS= oleg255-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg255-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg255-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg255-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg255-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg255-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg255-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg255-server: oleg255-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg255-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg255-server: oleg255-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg255-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg255-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg255-server stop mds service on oleg255-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg255-server stop mds service on oleg255-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg255-server