== conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 19:35:27 (1763339727) oleg158-server: debugfs 1.47.3-wc1 (8-Aug-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg158-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg158-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg158-client: oleg158-server: ssh exited with exit code 2 oleg158-server: oleg158-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg158-server' oleg158-server: oleg158-server.virtnet: executing load_modules_local oleg158-server: Loading modules from /home/green/git/lustre-release/lustre oleg158-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg158-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg158-server: detected 4 online CPUs by sysfs oleg158-server: MODOPTS_LIBCFS= oleg158-server: Force libcfs to create 2 CPU partitions oleg158-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg158-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-b 1024 -i 65536 -O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg158-server' oleg158-server: oleg158-server.virtnet: executing load_modules_local oleg158-server: Loading modules from /home/green/git/lustre-release/lustre oleg158-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg158-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg158-server: detected 4 online CPUs by sysfs oleg158-server: MODOPTS_LIBCFS= oleg158-server: Force libcfs to create 2 CPU partitions Permanent disk data: Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 200000 options -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 1024 -L lustre:MDT0000 -b 1024 -i 65536 -b 4096 -I 1024 -q -O large_dir,uninit_bg,extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 200000k Writing CONFIGS/mountdata Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg158-server: oleg158-server.virtnet: executing set_default_debug -1 all pdsh@oleg158-client: oleg158-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg158-server: oleg158-server.virtnet: executing set_default_debug -1 all pdsh@oleg158-client: oleg158-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg158-client.virtnet: -o user_xattr,flock 192.168.201.158@tcp:/lustre /mnt/lustre Starting client oleg158-client.virtnet: -o user_xattr,flock 192.168.201.158@tcp:/lustre /mnt/lustre Started clients oleg158-client.virtnet: 192.168.201.158@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mount lustre on /mnt/lustre2..... Starting client: oleg158-client.virtnet: -o user_xattr,flock 192.168.201.158@tcp:/lustre /mnt/lustre2 Starting client oleg158-client.virtnet: -o user_xattr,flock 192.168.201.158@tcp:/lustre /mnt/lustre2 Started clients oleg158-client.virtnet: 192.168.201.158@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) mkdir: created directory '/mnt/lustre/d110.conf-sanity' creating 60000 in total creating 40000 hard links to /mnt/lustre/d110.conf-sanity/f110.conf-sanity-0 creating 20000 hard links to /mnt/lustre2/d110.conf-sanity/f110.conf-sanity-1 waiting for PIDs 170900 170916 to complete - link 649 (time 1763339841.44 total 10.02 last 64.77) - link 1294 (time 1763339851.45 total 20.03 last 64.46) - link 1983 (time 1763339861.47 total 30.05 last 68.75) - link 2705 (time 1763339871.48 total 40.06 last 72.14) - link 3432 (time 1763339881.49 total 50.06 last 72.64) - link 4048 (time 1763339891.49 total 60.07 last 61.59) - link 4696 (time 1763339901.50 total 70.08 last 64.71) - link 5317 (time 1763339911.52 total 80.09 last 62.01) - link 6065 (time 1763339921.53 total 90.10 last 74.73) - link 6773 (time 1763339931.53 total 100.11 last 70.76) - link 7525 (time 1763339941.54 total 110.12 last 75.14) - link 8340 (time 1763339951.54 total 120.12 last 81.46) - link 8999 (time 1763339961.56 total 130.13 last 65.81) - link 9672 (time 1763339971.57 total 140.14 last 67.24) - link 10000 (time 1763339976.67 total 145.24 last 64.32) - link 10684 (time 1763339986.68 total 155.25 last 68.33) - link 11433 (time 1763339996.69 total 165.27 last 74.78) - link 12146 (time 1763340006.71 total 175.28 last 71.19) - link 12861 (time 1763340016.72 total 185.29 last 71.43) - link 13655 (time 1763340026.72 total 195.30 last 79.36) - link 14431 (time 1763340036.75 total 205.32 last 77.41) - link 15175 (time 1763340046.75 total 215.33 last 74.38) - link 15886 (time 1763340056.76 total 225.33 last 71.06) - link 16597 (time 1763340066.76 total 235.34 last 71.05) - link 17339 (time 1763340076.78 total 245.36 last 74.05) - link 18050 (time 1763340086.79 total 255.37 last 71.03) - link 18850 (time 1763340096.80 total 265.37 last 79.98) - link 19610 (time 1763340106.81 total 275.39 last 75.89) total: 20000 link in 280.90 seconds: 71.20 ops/second - link 648 (time 1763339841.34 total 10.00 last 64.78) - link 1288 (time 1763339851.34 total 20.01 last 63.97) - link 1976 (time 1763339861.35 total 30.01 last 68.77) - link 2700 (time 1763339871.36 total 40.03 last 72.29) - link 3426 (time 1763339881.38 total 50.05 last 72.45) - link 4025 (time 1763339891.39 total 60.05 last 59.86) - link 4694 (time 1763339901.40 total 70.06 last 66.84) - link 5308 (time 1763339911.41 total 80.07 last 61.35) - link 6040 (time 1763339921.42 total 90.08 last 73.14) - link 6744 (time 1763339931.42 total 100.08 last 70.38) - link 7511 (time 1763339941.43 total 110.09 last 76.64) - link 8326 (time 1763339951.44 total 120.11 last 81.40) - link 8992 (time 1763339961.44 total 130.11 last 66.57) - link 9661 (time 1763339971.45 total 140.12 last 66.84) - link 10000 (time 1763339976.68 total 145.35 last 64.84) - link 10686 (time 1763339986.69 total 155.36 last 68.55) - link 11427 (time 1763339996.70 total 165.36 last 74.05) - link 12143 (time 1763340006.71 total 175.38 last 71.48) - link 12864 (time 1763340016.72 total 185.39 last 72.03) - link 13663 (time 1763340026.75 total 195.41 last 79.72) - link 14442 (time 1763340036.75 total 205.42 last 77.86) - link 15192 (time 1763340046.76 total 215.42 last 74.95) - link 15894 (time 1763340056.77 total 225.43 last 70.15) - link 16593 (time 1763340066.78 total 235.44 last 69.81) - link 17351 (time 1763340076.79 total 245.45 last 75.74) - link 18050 (time 1763340086.79 total 255.46 last 69.87) - link 18850 (time 1763340096.80 total 265.47 last 79.91) - link 19610 (time 1763340106.81 total 275.48 last 75.94) - link 20000 (time 1763340112.40 total 281.07 last 69.73) - link 20439 (time 1763340122.41 total 291.07 last 43.87) - link 20921 (time 1763340132.41 total 301.08 last 48.18) - link 21351 (time 1763340142.43 total 311.09 last 42.94) - link 21827 (time 1763340152.44 total 321.11 last 47.53) - link 22312 (time 1763340162.46 total 331.12 last 48.43) - link 22785 (time 1763340172.48 total 341.14 last 47.19) - link 23316 (time 1763340182.48 total 351.15 last 53.09) - link 23761 (time 1763340192.49 total 361.16 last 44.44) - link 24204 (time 1763340202.51 total 371.18 last 44.21) - link 24677 (time 1763340212.53 total 381.20 last 47.20) - link 25136 (time 1763340222.54 total 391.21 last 45.87) - link 25575 (time 1763340232.55 total 401.21 last 43.88) - link 26044 (time 1763340242.55 total 411.22 last 46.86) - link 26551 (time 1763340252.56 total 421.23 last 50.67) - link 27054 (time 1763340262.57 total 431.24 last 50.24) - link 27571 (time 1763340272.59 total 441.25 last 51.64) - link 28091 (time 1763340282.59 total 451.26 last 51.97) - link 28637 (time 1763340292.59 total 461.26 last 54.59) - link 29114 (time 1763340302.60 total 471.27 last 47.67) - link 29569 (time 1763340312.60 total 481.27 last 45.48) - link 30000 (time 1763340321.67 total 490.34 last 47.53) - link 30473 (time 1763340331.67 total 500.34 last 47.28) - link 30956 (time 1763340341.69 total 510.35 last 48.24) - link 31460 (time 1763340351.69 total 520.36 last 50.39) - link 31996 (time 1763340361.69 total 530.36 last 53.58) - link 32545 (time 1763340371.70 total 540.37 last 54.84) - link 33085 (time 1763340381.72 total 550.38 last 53.93) - link 33611 (time 1763340391.72 total 560.38 last 52.59) - link 34131 (time 1763340401.72 total 570.39 last 51.97) - link 34633 (time 1763340411.74 total 580.40 last 50.13) - link 35165 (time 1763340421.75 total 590.41 last 53.16) - link 35742 (time 1763340431.76 total 600.42 last 57.64) - link 36235 (time 1763340441.77 total 610.44 last 49.21) - link 36662 (time 1763340451.79 total 620.46 last 42.63) - link 37137 (time 1763340461.80 total 630.46 last 47.47) - link 37679 (time 1763340471.80 total 640.47 last 54.17) - link 38189 (time 1763340481.82 total 650.48 last 50.94) - link 38789 (time 1763340491.82 total 660.49 last 59.96) - link 39392 (time 1763340501.84 total 670.50 last 60.22) - link 39982 (time 1763340511.84 total 680.51 last 58.95) total: 40000 link in 680.81 seconds: 58.75 ops/second Stopping clients: oleg158-client.virtnet /mnt/lustre (opts:) Stopping client oleg158-client.virtnet /mnt/lustre opts: Stopping clients: oleg158-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg158-client.virtnet /mnt/lustre2 opts: Stopping /mnt/lustre-mds1 (opts:-f) on oleg158-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg158-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg158-server: e2fsck 1.47.3-wc1 (8-Aug-2025) oleg158-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 1], used inodes 276/3120 [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2316: increase inode 7 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 82 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 82 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 118 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 118 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 123 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 123 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 124 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 124 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 125 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 125 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 126 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 126 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 127 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 127 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 128 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 128 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 129 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 129 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 130 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 130 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 131 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 131 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 133 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 133 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 134 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 134 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 135 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 135 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 136 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 136 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 137 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 137 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 138 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 138 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 139 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 139 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 140 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 140 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 141 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 141 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 142 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 142 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 143 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 143 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 144 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 144 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 145 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 145 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 152 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 152 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 154 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 154 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 155 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 155 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 156 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 156 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 157 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 157 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 158 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 158 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 159 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 159 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 160 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 160 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 161 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 161 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 162 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 162 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 163 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 163 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 164 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 164 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 165 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 165 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 166 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 166 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 167 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 167 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 168 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 168 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 169 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 169 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 170 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 170 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 171 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 172 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 172 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 173 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 173 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 174 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 174 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 175 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 175 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 176 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 176 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 177 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 177 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 178 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 178 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 179 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 179 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 180 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 180 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 181 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 181 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 182 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 182 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 183 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 183 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 184 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 184 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 185 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 185 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 186 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 186 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 187 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 187 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 189 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 190 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 191 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 197 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 197 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2660: increase inode 198 badness 0 to 1 for 10084 [Thread 0] e2fsck_pass1_run:2680: increase inode 198 badness 1 to 3 for 10084 [Thread 0] group 0 finished [Thread 0] e2fsck_pass1_run:2316: increase inode 1596 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1596 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1633 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1633 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1634 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2316: increase inode 1635 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1635 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1636 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1636 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1637 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1637 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1638 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1638 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1639 badness 0 to 1 for 1005c [Thread 0] e2fsck_pass1_run:2680: increase inode 1639 badness 1 to 3 for 10084 [Thread 0] e2fsck_pass1_run:2316: increase inode 1640 badness 0 to 1 for 1005c [Thread 0] group 1 finished [Thread 0] Pass 1: Memory used: 364k/440k (128k/237k), time: 0.01/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 88.62MB/s [Thread 0] Scanned group range [0, 1], used inodes 276/281 Pass 2: Checking directory structure Pass 2: Memory used: 364k/0k (83k/282k), time: 0.35/ 0.12/ 0.04 Pass 2: I/O read: 25MB, write: 0MB, rate: 71.32MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 364k/0k (83k/282k), time: 0.37/ 0.12/ 0.04 Pass 3: Memory used: 364k/0k (82k/283k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 364k/0k (78k/287k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 6578.95MB/s Pass 5: Checking group summary information Pass 5: Memory used: 504k/0k (77k/428k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 735.29MB/s 276 inodes used (8.85%, out of 3120) 2 non-contiguous files (0.7%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 Extent depth histogram: 203 11396 blocks used (22.79%, out of 50000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 60000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 60264 files Memory used: 504k/0k (81k/424k), time: 0.38/ 0.13/ 0.04 I/O read: 25MB, write: 0MB, rate: 66.13MB/s Stopping clients: oleg158-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg158-client.virtnet /mnt/lustre2 (opts:-f) oleg158-server: oleg158-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg158-server' oleg158-server: oleg158-server.virtnet: executing load_modules_local oleg158-server: Loading modules from /home/green/git/lustre-release/lustre oleg158-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg158-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg158-server: detected 4 online CPUs by sysfs oleg158-server: MODOPTS_LIBCFS= oleg158-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg158-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg158-server: oleg158-server.virtnet: executing set_default_debug -1 all pdsh@oleg158-client: oleg158-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg158-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg158-server: oleg158-server.virtnet: executing set_default_debug -1 all pdsh@oleg158-client: oleg158-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg158-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg158-server: oleg158-server.virtnet: executing set_default_debug -1 all pdsh@oleg158-client: oleg158-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg158-server: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg158-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg158-server: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg158-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg158-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg158-server stop mds service on oleg158-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg158-server stop mds service on oleg158-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg158-server