== conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 01:35:40 (1734676540) oleg145-server: debugfs 1.46.2.wc5 (26-Mar-2022) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity oleg145-server: debugfs 1.46.2.wc5 (26-Mar-2022) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity umount lustre on /mnt/lustre..... stop ost1 service on oleg145-server stop mds service on oleg145-server stop mds service on oleg145-server LNET unconfigure error 22: Invalid argument unloading modules via unload_modules_local on: 'oleg145-server' oleg145-server: oleg145-server.virtnet: executing unload_modules_local oleg145-server: LNET unconfigure error 22: Invalid argument modules unloaded. MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=2400000 --mkfsoptions=\"-O large_dir -i 1048576 -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg145-server' oleg145-server: oleg145-server.virtnet: executing load_modules_local oleg145-server: Loading modules from /home/green/git/lustre-release/lustre oleg145-server: detected 4 online CPUs by sysfs oleg145-server: MODOPTS_LIBCFS= oleg145-server: Force libcfs to create 2 CPU partitions oleg145-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg145-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg145-server: quota/lquota options: 'hash_lqs_cur_bits=3' Permanent disk data: Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 2400000 options -i 1048576 -b 4096 -J size=93 -I 1024 -q -O large_dir,uninit_bg,^extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:MDT0000 -i 1048576 -b 4096 -J size=93 -I 1024 -q -O large_dir,uninit_bg,^extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 2400000k Writing CONFIGS/mountdata Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg145-server: oleg145-server.virtnet: executing set_default_debug -1 all pdsh@oleg145-client: oleg145-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 OST params: --mgsnode=192.168.201.145@tcp --fsname=lustre --ost --index=0 --param=sys.timeout=20 --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/ost1_flakey Permanent disk data: Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: ,errors=remount-ro Parameters: mgsnode=192.168.201.145@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O large_dir,uninit_bg,extents,dir_nlink,quota,project,huge_file,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O large_dir,uninit_bg,extents,dir_nlink,quota,project,huge_file,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k Writing CONFIGS/mountdata Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg145-server: oleg145-server.virtnet: executing set_default_debug -1 all pdsh@oleg145-client: oleg145-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg145-client.virtnet: -o user_xattr,flock 192.168.201.145@tcp:/lustre /mnt/lustre Starting client oleg145-client.virtnet: -o user_xattr,flock 192.168.201.145@tcp:/lustre /mnt/lustre Started clients oleg145-client.virtnet: 192.168.201.145@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) mount lustre on /mnt/lustre2..... Starting client: oleg145-client.virtnet: -o user_xattr,flock 192.168.201.145@tcp:/lustre /mnt/lustre2 Starting client oleg145-client.virtnet: -o user_xattr,flock 192.168.201.145@tcp:/lustre /mnt/lustre2 Started clients oleg145-client.virtnet: 192.168.201.145@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2280828 1696 2159132 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 142216 1388 126828 2% /mnt/lustre[OST:0] filesystem_summary: 142216 1388 126828 2% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 2280 272 2008 12% /mnt/lustre[MDT:0] lustre-OST0000_UUID 50000 302 49698 1% /mnt/lustre[OST:0] filesystem_summary: 2280 272 2008 12% /mnt/lustre creating 60000 hardlinks to oleg145-client.virtnet-0 creating 60000 hardlinks to oleg145-client.virtnet-1 waiting for PIDs 27470 27484 to complete - link 750 (time 1734676593.32 total 10.00 last 75.00) - link 1525 (time 1734676603.33 total 20.01 last 77.43) - link 2282 (time 1734676613.34 total 30.02 last 75.61) - link 2926 (time 1734676623.34 total 40.02 last 64.38) - link 3621 (time 1734676633.35 total 50.03 last 69.42) - link 4260 (time 1734676643.36 total 60.04 last 63.88) - link 4910 (time 1734676653.36 total 70.04 last 64.99) - link 5606 (time 1734676663.37 total 80.05 last 69.51) - link 6450 (time 1734676673.37 total 90.05 last 84.40) - link 7118 (time 1734676683.38 total 100.06 last 66.71) - link 7744 (time 1734676693.39 total 110.07 last 62.54) - link 8400 (time 1734676703.40 total 120.08 last 65.53) - link 9070 (time 1734676713.40 total 130.09 last 66.99) - link 9894 (time 1734676723.41 total 140.09 last 82.38) - link 10716 (time 1734676733.41 total 150.09 last 82.15) - link 11575 (time 1734676743.42 total 160.10 last 85.85) - link 12460 (time 1734676753.43 total 170.11 last 88.42) - link 13374 (time 1734676763.43 total 180.11 last 91.39) - link 14234 (time 1734676773.43 total 190.11 last 86.00) - link 15015 (time 1734676783.43 total 200.12 last 78.05) - link 15788 (time 1734676793.44 total 210.13 last 77.23) - link 16609 (time 1734676803.46 total 220.14 last 81.98) - link 17457 (time 1734676813.47 total 230.15 last 84.74) - link 18336 (time 1734676823.48 total 240.16 last 87.81) - link 19163 (time 1734676833.48 total 250.17 last 82.63) - link 20000 (time 1734676843.33 total 260.01 last 85.01) - link 20830 (time 1734676853.34 total 270.02 last 82.92) - link 21505 (time 1734676863.35 total 280.03 last 67.43) - link 22222 (time 1734676873.35 total 290.03 last 71.69) - link 22905 (time 1734676883.36 total 300.04 last 68.24) - link 23722 (time 1734676893.36 total 310.05 last 81.68) - link 24562 (time 1734676903.37 total 320.05 last 83.94) - link 25446 (time 1734676913.38 total 330.06 last 88.34) - link 26180 (time 1734676923.38 total 340.06 last 73.38) - link 26889 (time 1734676933.39 total 350.07 last 70.84) - link 27617 (time 1734676943.40 total 360.08 last 72.75) - link 28435 (time 1734676953.40 total 370.08 last 81.75) - link 29242 (time 1734676963.41 total 380.10 last 80.59) - link 30000 (time 1734676973.06 total 389.74 last 78.57) - link 30717 (time 1734676983.07 total 399.75 last 71.68) - link 31515 (time 1734676993.08 total 409.76 last 79.67) - link 32185 (time 1734677003.09 total 419.77 last 66.94) - link 32878 (time 1734677013.10 total 429.78 last 69.24) - link 33575 (time 1734677023.11 total 439.80 last 69.60) - link 34290 (time 1734677033.12 total 449.80 last 71.48) - link 35047 (time 1734677043.12 total 459.80 last 75.67) - link 35779 (time 1734677053.13 total 469.82 last 73.10) - link 36546 (time 1734677063.14 total 479.82 last 76.68) - link 37300 (time 1734677073.16 total 489.84 last 75.25) - link 37897 (time 1734677083.17 total 499.85 last 59.63) - link 38538 (time 1734677093.18 total 509.86 last 64.04) - link 39251 (time 1734677103.18 total 519.87 last 71.26) - link 39995 (time 1734677113.18 total 529.87 last 74.40) - link 40672 (time 1734677123.19 total 539.87 last 67.64) - link 41508 (time 1734677133.21 total 549.89 last 83.48) - link 42116 (time 1734677143.21 total 559.89 last 60.76) - link 42720 (time 1734677153.22 total 569.91 last 60.33) - link 43363 (time 1734677163.23 total 579.92 last 64.23) - link 43938 (time 1734677173.24 total 589.93 last 57.44) - link 44521 (time 1734677183.26 total 599.95 last 58.19) - link 45231 (time 1734677193.28 total 609.96 last 70.92) - link 46013 (time 1734677203.28 total 619.96 last 78.18) - link 46623 (time 1734677213.29 total 629.98 last 60.91) - link 47401 (time 1734677223.31 total 639.99 last 77.70) - link 48250 (time 1734677233.31 total 649.99 last 84.86) - link 49012 (time 1734677243.32 total 660.00 last 76.11) - link 49729 (time 1734677253.33 total 670.02 last 71.63) - link 50000 (time 1734677256.85 total 673.53 last 77.13) - link 51001 (time 1734677266.85 total 683.54 last 100.04) - link 51807 (time 1734677276.85 total 693.54 last 80.59) - link 52431 (time 1734677286.86 total 703.54 last 62.38) - link 53101 (time 1734677296.87 total 713.55 last 66.94) - link 53926 (time 1734677306.87 total 723.56 last 82.44) - link 54770 (time 1734677316.88 total 733.56 last 84.34) - link 55532 (time 1734677326.89 total 743.57 last 76.14) - link 56149 (time 1734677336.90 total 753.58 last 61.63) - link 56773 (time 1734677346.92 total 763.60 last 62.28) - link 57486 (time 1734677356.92 total 773.60 last 71.28) - link 58241 (time 1734677366.92 total 783.61 last 75.48) - link 59021 (time 1734677376.93 total 793.61 last 77.95) - link 59813 (time 1734677386.93 total 803.61 last 79.19) total: 60000 link in 805.93 seconds: 74.45 ops/second - link 748 (time 1734676593.18 total 10.01 last 74.76) - link 1525 (time 1734676603.19 total 20.01 last 77.67) - link 2288 (time 1734676613.20 total 30.02 last 76.20) - link 2927 (time 1734676623.21 total 40.03 last 63.86) - link 3618 (time 1734676633.21 total 50.03 last 69.08) - link 4250 (time 1734676643.22 total 60.05 last 63.11) - link 4911 (time 1734676653.24 total 70.06 last 66.01) - link 5594 (time 1734676663.24 total 80.06 last 68.29) - link 6436 (time 1734676673.25 total 90.07 last 84.15) - link 7121 (time 1734676683.26 total 100.08 last 68.41) - link 7739 (time 1734676693.28 total 110.10 last 61.69) - link 8407 (time 1734676703.29 total 120.11 last 66.69) - link 9072 (time 1734676713.30 total 130.12 last 66.45) - link 9894 (time 1734676723.31 total 140.14 last 82.08) - link 10705 (time 1734676733.32 total 150.14 last 81.09) - link 11549 (time 1734676743.32 total 160.14 last 84.37) - link 12424 (time 1734676753.33 total 170.15 last 87.42) - link 13343 (time 1734676763.33 total 180.16 last 91.84) - link 14205 (time 1734676773.35 total 190.17 last 86.09) - link 14983 (time 1734676783.35 total 200.17 last 77.79) - link 15737 (time 1734676793.35 total 210.17 last 75.40) - link 16546 (time 1734676803.35 total 220.17 last 80.86) - link 17395 (time 1734676813.35 total 230.18 last 84.89) - link 18269 (time 1734676823.36 total 240.18 last 87.39) - link 19096 (time 1734676833.36 total 250.18 last 82.70) - link 19939 (time 1734676843.36 total 260.18 last 84.26) - link 20778 (time 1734676853.37 total 270.19 last 83.84) - link 21465 (time 1734676863.39 total 280.21 last 68.57) - link 22177 (time 1734676873.39 total 290.21 last 71.17) - link 22879 (time 1734676883.40 total 300.22 last 70.14) - link 23702 (time 1734676893.40 total 310.22 last 82.28) - link 24537 (time 1734676903.41 total 320.23 last 83.47) - link 25417 (time 1734676913.41 total 330.23 last 87.93) - link 26145 (time 1734676923.42 total 340.24 last 72.73) - link 26856 (time 1734676933.44 total 350.26 last 70.99) - link 27586 (time 1734676943.44 total 360.27 last 72.96) - link 28406 (time 1734676953.46 total 370.28 last 81.90) - link 29215 (time 1734676963.46 total 380.28 last 80.86) - link 29994 (time 1734676973.47 total 390.29 last 77.86) - link 30715 (time 1734676983.48 total 400.30 last 72.02) - link 31501 (time 1734676993.49 total 410.31 last 78.52) - link 32170 (time 1734677003.49 total 420.31 last 66.89) - link 32843 (time 1734677013.50 total 430.32 last 67.23) - link 33539 (time 1734677023.51 total 440.33 last 69.51) - link 34256 (time 1734677033.52 total 450.34 last 71.63) - link 35004 (time 1734677043.53 total 460.35 last 74.77) - link 35736 (time 1734677053.53 total 470.35 last 73.19) - link 36490 (time 1734677063.53 total 480.35 last 75.39) - link 37230 (time 1734677073.54 total 490.36 last 73.93) - link 37818 (time 1734677083.55 total 500.37 last 58.73) - link 38464 (time 1734677093.56 total 510.38 last 64.51) - link 39179 (time 1734677103.57 total 520.39 last 71.46) - link 39930 (time 1734677113.57 total 530.39 last 75.07) - link 40597 (time 1734677123.58 total 540.40 last 66.63) - link 41433 (time 1734677133.59 total 550.41 last 83.53) - link 42037 (time 1734677143.59 total 560.41 last 60.39) - link 42649 (time 1734677153.59 total 570.41 last 61.20) - link 43286 (time 1734677163.60 total 580.42 last 63.62) - link 43856 (time 1734677173.62 total 590.44 last 56.91) - link 44424 (time 1734677183.63 total 600.45 last 56.74) - link 45139 (time 1734677193.63 total 610.46 last 71.46) - link 45923 (time 1734677203.64 total 620.46 last 78.37) - link 46536 (time 1734677213.66 total 630.48 last 61.19) - link 47320 (time 1734677223.66 total 640.48 last 78.38) - link 48192 (time 1734677233.66 total 650.48 last 87.18) - link 48937 (time 1734677243.67 total 660.49 last 74.44) - link 49649 (time 1734677253.68 total 670.50 last 71.12) - link 50000 (time 1734677258.03 total 674.86 last 80.60) - link 51046 (time 1734677268.04 total 684.86 last 104.60) - link 51779 (time 1734677278.05 total 694.87 last 73.21) - link 52425 (time 1734677288.05 total 704.87 last 64.59) - link 53117 (time 1734677298.06 total 714.88 last 69.14) - link 53951 (time 1734677308.06 total 724.88 last 83.37) - link 54795 (time 1734677318.07 total 734.90 last 84.28) - link 55545 (time 1734677328.08 total 744.90 last 74.98) - link 56148 (time 1734677338.08 total 754.90 last 60.29) - link 56776 (time 1734677348.08 total 764.90 last 62.80) - link 57507 (time 1734677358.09 total 774.91 last 73.01) - link 58260 (time 1734677368.11 total 784.93 last 75.15) - link 59024 (time 1734677378.11 total 794.93 last 76.39) - link 59829 (time 1734677388.12 total 804.94 last 80.48) total: 60000 link in 806.82 seconds: 74.37 ops/second estimate 34012s left after 120000 files / 808s umount lustre on /mnt/lustre2..... Stopping client oleg145-client.virtnet /mnt/lustre2 (opts:-f) umount lustre on /mnt/lustre..... Stopping client oleg145-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg145-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg145-server stop mds service on oleg145-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg145-server unloading modules via unload_modules_local on: 'oleg145-server' oleg145-server: oleg145-server.virtnet: executing unload_modules_local modules unloaded. ETA 34012s after 120000 files / 808s is too long e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg145-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg145-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 19) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 151 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 152 badness 0 to 2 foroleg145-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (51478528, 266) != expected (51486720, 266) oleg145-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (51478528, 266) != expected (51486720, 266) oleg145-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (51478528, 266) != expected (51486720, 266) 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 156 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 157 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 160 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 161 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 162 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 163 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 164 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 165 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 166 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 167 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 168 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 169 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 170 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 171 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 172 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 173 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 174 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 175 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 176 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 177 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 178 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 180 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 181 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 182 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 188 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 189 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] group 17 finished [Thread 0] group 18 finished [Thread 0] group 19 finished [Thread 0] Pass 1: Memory used: 380k/908k (124k/257k), time: 0.05/ 0.01/ 0.01 [Thread 0] Pass 1: I/O read: 2MB, write: 0MB, rate: 41.26MB/s [Thread 0] Scanned group range [0, 19), inodes 281 Pass 2: Checking directory structure Pass 2: Memory used: 380k/0k (85k/296k), time: 0.59/ 0.34/ 0.07 Pass 2: I/O read: 49MB, write: 0MB, rate: 83.53MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 380k/0k (85k/296k), time: 0.67/ 0.35/ 0.08 Pass 3: Memory used: 380k/0k (83k/298k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 380k/0k (69k/312k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 6097.56MB/s Pass 5: Checking group summary information Pass 5: Memory used: 380k/0k (68k/313k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 232.56MB/s Update quota info for quota type 0? no Update quota info for quota type 1? no Update quota info for quota type 2? no lustre-MDT0000: ********** WARNING: Filesystem still has errors ********** 276 inodes used (12.11%, out of 2280) 4 non-contiguous fpdsh@oleg145-client: oleg145-server: ssh exited with exit code 4 iles (1.4%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 37906 blocks used (6.32%, out of 600000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 120000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 120264 files Memory used: 380k/0k (67k/314k), time: 0.68/ 0.35/ 0.08 I/O read: 49MB, write: 0MB, rate: 72.54MB/s pdsh@oleg145-client: oleg145-client: ssh exited with exit code 2 pdsh@oleg145-client: oleg145-server: ssh exited with exit code 2 pdsh@oleg145-client: oleg145-client: ssh exited with exit code 2 pdsh@oleg145-client: oleg145-server: ssh exited with exit code 2 Stopping clients: oleg145-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg145-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg145-client: oleg145-server: ssh exited with exit code 2 oleg145-server: oleg145-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg145-server' oleg145-server: oleg145-server.virtnet: executing load_modules_local oleg145-server: Loading modules from /home/green/git/lustre-release/lustre oleg145-server: detected 4 online CPUs by sysfs oleg145-server: MODOPTS_LIBCFS= oleg145-server: Force libcfs to create 2 CPU partitions oleg145-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg145-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg145-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey