== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 01:58:49 (1781243929) oleg308-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg308-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg308-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg308-client: oleg308-server: ssh exited with exit code 2 oleg308-server: oleg308-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg308-server' oleg308-server: oleg308-server.virtnet: executing load_modules_local oleg308-server: Loading modules from /home/green/git/lustre-release/lustre oleg308-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg308-server: detected 4 online CPUs by sysfs oleg308-server: MODOPTS_LIBCFS= oleg308-server: Force libcfs to create 2 CPU partitions oleg308-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg308-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg308-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg308-server' oleg308-server: oleg308-server.virtnet: executing load_modules_local oleg308-server: Loading modules from /home/green/git/lustre-release/lustre oleg308-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg308-server: detected 4 online CPUs by sysfs oleg308-server: MODOPTS_LIBCFS= oleg308-server: Force libcfs to create 2 CPU partitions Permanent disk data: Device: /dev/mapper/mds1_flakey Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg308-server: oleg308-server.virtnet: executing set_default_debug -1 all pdsh@oleg308-client: oleg308-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg308-server: oleg308-server.virtnet: executing set_default_debug -1 all pdsh@oleg308-client: oleg308-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg308-client.virtnet: -o user_xattr,flock 192.168.203.108@tcp:/lustre /mnt/lustre Starting client oleg308-client.virtnet: -o user_xattr,flock 192.168.203.108@tcp:/lustre /mnt/lustre Started clients oleg308-client.virtnet: 192.168.203.108@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg308-client.virtnet: -o user_xattr,flock 192.168.203.108@tcp:/lustre /mnt/lustre2 Starting client oleg308-client.virtnet: -o user_xattr,flock 192.168.203.108@tcp:/lustre /mnt/lustre2 Started clients oleg308-client.virtnet: 192.168.203.108@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 171262 171277 to complete - link 497 (time 1781244049.99 total 10.00 last 49.69) - link 1028 (time 1781244060.00 total 20.01 last 53.04) - link 1526 (time 1781244070.02 total 30.03 last 49.73) - link 1991 (time 1781244080.02 total 40.03 last 46.47) - link 2463 (time 1781244090.03 total 50.04 last 47.17) - link 2952 (time 1781244100.04 total 60.05 last 48.86) - link 3382 (time 1781244110.06 total 70.07 last 42.92) - link 3823 (time 1781244120.06 total 80.07 last 44.10) - link 4355 (time 1781244130.06 total 90.07 last 53.17) - link 4878 (time 1781244140.06 total 100.08 last 52.29) - link 5384 (time 1781244150.07 total 110.08 last 50.56) - link 5847 (time 1781244160.08 total 120.10 last 46.24) - link 6335 (time 1781244170.09 total 130.10 last 48.77) - link 6918 (time 1781244180.10 total 140.11 last 58.25) - link 7482 (time 1781244190.11 total 150.12 last 56.35) - link 8039 (time 1781244200.11 total 160.12 last 55.68) - link 8562 (time 1781244210.11 total 170.12 last 52.30) - link 9114 (time 1781244220.13 total 180.14 last 55.09) - link 9676 (time 1781244230.15 total 190.16 last 56.10) - link 10000 (time 1781244236.19 total 196.20 last 53.68) - link 10518 (time 1781244246.20 total 206.21 last 51.75) - link 11029 (time 1781244256.20 total 216.21 last 51.07) - link 11526 (time 1781244266.23 total 226.24 last 49.58) - link 12059 (time 1781244276.25 total 236.26 last 53.19) - link 12582 (time 1781244286.26 total 246.28 last 52.21) - link 13108 (time 1781244296.27 total 256.28 last 52.56) - link 13617 (time 1781244306.28 total 266.29 last 50.87) - link 14140 (time 1781244316.30 total 276.31 last 52.21) - link 14531 (time 1781244326.30 total 286.31 last 39.08) - link 14954 (time 1781244336.31 total 296.32 last 42.28) - link 15395 (time 1781244346.33 total 306.34 last 44.00) - link 15908 (time 1781244356.34 total 316.35 last 51.25) - link 16424 (time 1781244366.36 total 326.37 last 51.49) - link 16925 (time 1781244376.38 total 336.39 last 50.02) - link 17418 (time 1781244386.38 total 346.39 last 49.29) - link 17904 (time 1781244396.39 total 356.41 last 48.53) - link 18349 (time 1781244406.40 total 366.41 last 44.47) - link 18848 (time 1781244416.42 total 376.43 last 49.81) - link 19363 (time 1781244426.44 total 386.45 last 51.41) - link 19881 (time 1781244436.46 total 396.47 last 51.66) total: 20000 link in 398.69 seconds: 50.16 ops/second - link 493 (time 1781244049.93 total 10.01 last 49.23) - link 1025 (time 1781244059.95 total 20.03 last 53.13) - link 1512 (time 1781244069.96 total 30.04 last 48.66) - link 1976 (time 1781244079.96 total 40.04 last 46.37) - link 2433 (time 1781244089.98 total 50.06 last 45.60) - link 2923 (time 1781244099.99 total 60.07 last 48.99) - link 3353 (time 1781244110.00 total 70.08 last 42.96) - link 3805 (time 1781244120.00 total 80.08 last 45.17) - link 4324 (time 1781244130.00 total 90.08 last 51.89) - link 4836 (time 1781244140.01 total 100.09 last 51.17) - link 5342 (time 1781244150.03 total 110.11 last 50.51) - link 5817 (time 1781244160.04 total 120.12 last 47.42) - link 6300 (time 1781244170.06 total 130.14 last 48.21) - link 6869 (time 1781244180.08 total 140.16 last 56.82) - link 7433 (time 1781244190.08 total 150.16 last 56.37) - link 7981 (time 1781244200.09 total 160.17 last 54.79) - link 8489 (time 1781244210.10 total 170.18 last 50.73) - link 9047 (time 1781244220.10 total 180.18 last 55.79) - link 9620 (time 1781244230.11 total 190.19 last 57.26) - link 10000 (time 1781244237.09 total 197.17 last 54.41) - link 10534 (time 1781244247.10 total 207.18 last 53.34) - link 11036 (time 1781244257.12 total 217.20 last 50.14) - link 11539 (time 1781244267.12 total 227.20 last 50.27) - link 12070 (time 1781244277.13 total 237.21 last 53.06) - link 12569 (time 1781244287.14 total 247.22 last 49.83) - link 13096 (time 1781244297.16 total 257.24 last 52.62) - link 13613 (time 1781244307.16 total 267.24 last 51.69) - link 14131 (time 1781244317.17 total 277.25 last 51.72) - link 14550 (time 1781244327.22 total 287.30 last 41.71) - link 14982 (time 1781244337.23 total 297.31 last 43.14) - link 15449 (time 1781244347.24 total 307.32 last 46.70) - link 15949 (time 1781244357.25 total 317.33 last 49.91) - link 16466 (time 1781244367.28 total 327.36 last 51.57) - link 16957 (time 1781244377.30 total 337.38 last 48.99) - link 17451 (time 1781244387.33 total 347.41 last 49.27) - link 17925 (time 1781244397.36 total 357.44 last 47.25) - link 18391 (time 1781244407.36 total 367.44 last 46.60) - link 18899 (time 1781244417.37 total 377.45 last 50.75) - link 19407 (time 1781244427.38 total 387.46 last 50.75) - link 19917 (time 1781244437.39 total 397.47 last 50.98) - link 20321 (time 1781244447.41 total 407.49 last 40.31) - link 20697 (time 1781244457.41 total 417.49 last 37.60) - link 21085 (time 1781244467.47 total 427.55 last 38.56) - link 21471 (time 1781244477.49 total 437.57 last 38.55) - link 21840 (time 1781244487.50 total 447.58 last 36.83) - link 22201 (time 1781244497.56 total 457.64 last 35.90) - link 22533 (time 1781244507.59 total 467.67 last 33.12) - link 22906 (time 1781244517.60 total 477.68 last 37.25) - link 23240 (time 1781244527.63 total 487.71 last 33.29) - link 23602 (time 1781244537.68 total 497.76 last 36.01) - link 24001 (time 1781244547.70 total 507.78 last 39.82) - link 24361 (time 1781244557.72 total 517.80 last 35.96) - link 24723 (time 1781244567.72 total 527.80 last 36.18) - link 25019 (time 1781244577.73 total 537.81 last 29.58) - link 25326 (time 1781244587.76 total 547.84 last 30.60) - link 25625 (time 1781244597.78 total 557.86 last 29.85) - link 25983 (time 1781244607.79 total 567.87 last 35.74) - link 26380 (time 1781244617.81 total 577.89 last 39.62) - link 26767 (time 1781244627.83 total 587.91 last 38.64) - link 27173 (time 1781244637.85 total 597.93 last 40.51) - link 27564 (time 1781244647.88 total 607.96 last 38.99) - link 27943 (time 1781244657.89 total 617.96 last 37.88) - link 28306 (time 1781244667.89 total 627.97 last 36.29) - link 28692 (time 1781244677.90 total 637.98 last 38.55) - link 29083 (time 1781244687.91 total 647.99 last 39.08) - link 29447 (time 1781244697.92 total 658.00 last 36.36) - link 29828 (time 1781244707.96 total 668.04 last 37.94) - link 30000 (time 1781244712.53 total 672.61 last 37.64) - link 30380 (time 1781244722.53 total 682.61 last 37.99) - link 30761 (time 1781244732.55 total 692.63 last 38.01) - link 31150 (time 1781244742.57 total 702.65 last 38.82) - link 31489 (time 1781244752.58 total 712.66 last 33.88) - link 31836 (time 1781244762.60 total 722.68 last 34.64) - link 32170 (time 1781244772.60 total 732.68 last 33.39) - link 32519 (time 1781244782.61 total 742.69 last 34.87) - link 32903 (time 1781244792.64 total 752.72 last 38.29) - link 33293 (time 1781244802.67 total 762.75 last 38.89) - link 33650 (time 1781244812.69 total 772.77 last 35.62) - link 34011 (time 1781244822.70 total 782.78 last 36.04) - link 34382 (time 1781244832.73 total 792.81 last 37.02) - link 34717 (time 1781244842.75 total 802.83 last 33.42) - link 35115 (time 1781244852.77 total 812.85 last 39.73) - link 35507 (time 1781244862.79 total 822.87 last 39.11) - link 35885 (time 1781244872.79 total 832.87 last 37.78) - link 36266 (time 1781244882.82 total 842.89 last 38.02) - link 36651 (time 1781244892.85 total 852.92 last 38.38) - link 37051 (time 1781244902.86 total 862.94 last 39.93) - link 37436 (time 1781244912.88 total 872.96 last 38.45) - link 37810 (time 1781244922.89 total 882.97 last 37.33) - link 38180 (time 1781244932.90 total 892.98 last 36.99) - link 38582 (time 1781244942.91 total 902.99 last 40.17) - link 38977 (time 1781244952.91 total 912.99 last 39.48) - link 39350 (time 1781244962.93 total 923.01 last 37.23) - link 39713 (time 1781244972.94 total 933.02 last 36.25) total: 40000 link in 940.02 seconds: 42.55 ops/second Stopping clients: oleg308-client.virtnet /mnt/lustre (opts:) Stopping client oleg308-client.virtnet /mnt/lustre opts: Stopping clients: oleg308-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg308-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg308-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg308-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg308-server: e2fsck 1.47.3-wc2 (11-Nov-2025) oleg308-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 93 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 93 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 98 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 98 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 99 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 99 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 100 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 100 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 101 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 101 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 102 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 102 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 103 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 103 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 104 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 104 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 105 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 105 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 106 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 106 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 108 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 108 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 109 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 109 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 110 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 110 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 111 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 111 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 112 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 112 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 113 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 113 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 114 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 115 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 115 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 116 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 116 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 117 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 117 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 119 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 120 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 122 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 146 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 147 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 148 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 148 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 149 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 149 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 150 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 150 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 151 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 151 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 155 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 155 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 156 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 156 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 157 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 157 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 158 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 159 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 160 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 161 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 161 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 162 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 162 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 163 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 163 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 164 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 164 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 165 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 165 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 166 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 166 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 167 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 167 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 168 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 168 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 169 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 169 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 171 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 172 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 173 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 178 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 178 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 179 badness 0 to 2 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 1596 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1596 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1658 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 364k/440k (129k/236k), time: 0.02/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 41.64MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/282 Pass 2: Checking directory structure Pass 2: Memory used: 364k/0k (83k/282k), time: 0.65/ 0.17/ 0.04 Pass 2: I/O read: 25MB, write: 0MB, rate: 38.23MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 364k/0k (84k/281k), time: 0.69/ 0.17/ 0.04 Pass 3: Memory used: 364k/0k (82k/283k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 364k/0k (78k/287k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 6172.84MB/s Pass 5: Checking group summary information Pass 5: Memory used: 504k/0k (77k/428k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 270.71MB/s 276 inodes used (8.85%, out of 3120) 1 non-contiguous file (0.4%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 Extent depth histogram: 203 11390 blocks used (22.78%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 504k/0k (81k/424k), time: 0.70/ 0.17/ 0.04 I/O read: 25MB, write: 0MB, rate: 35.47MB/s Stopping clients: oleg308-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg308-client.virtnet /mnt/lustre2 (opts:-f) oleg308-server: oleg308-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg308-server' oleg308-server: oleg308-server.virtnet: executing load_modules_local oleg308-server: Loading modules from /home/green/git/lustre-release/lustre oleg308-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg308-server: detected 4 online CPUs by sysfs oleg308-server: MODOPTS_LIBCFS= oleg308-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg308-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg308-server: oleg308-server.virtnet: executing set_default_debug -1 all pdsh@oleg308-client: oleg308-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg308-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg308-server: oleg308-server.virtnet: executing set_default_debug -1 all pdsh@oleg308-client: oleg308-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg308-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg308-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg308-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg308-server: oleg308-server.virtnet: executing set_default_debug -1 all pdsh@oleg308-client: oleg308-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg308-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg308-server: oleg308-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg308-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg308-server: oleg308-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg308-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg308-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg308-server stop mds service on oleg308-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg308-server stop mds service on oleg308-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg308-server