== conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 01:56:56 (1734677816) oleg444-server: debugfs 1.46.2.wc5 (26-Mar-2022) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity oleg444-server: debugfs 1.46.2.wc5 (26-Mar-2022) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity umount lustre on /mnt/lustre..... stop ost1 service on oleg444-server stop mds service on oleg444-server stop mds service on oleg444-server LNET unconfigure error 22: Invalid argument unloading modules via unload_modules_local on: 'oleg444-server' oleg444-server: oleg444-server.virtnet: executing unload_modules_local oleg444-server: LNET unconfigure error 22: Invalid argument modules unloaded. MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=2400000 --mkfsoptions=\"-O large_dir -i 1048576 -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg444-server' oleg444-server: oleg444-server.virtnet: executing load_modules_local oleg444-server: Loading modules from /home/green/git/lustre-release/lustre oleg444-server: detected 4 online CPUs by sysfs oleg444-server: MODOPTS_LIBCFS= oleg444-server: Force libcfs to create 2 CPU partitions oleg444-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg444-server: quota/lquota options: 'hash_lqs_cur_bits=3' Permanent disk data: Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 2400000 options -i 1048576 -b 4096 -J size=93 -I 1024 -q -O large_dir,uninit_bg,^extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:MDT0000 -i 1048576 -b 4096 -J size=93 -I 1024 -q -O large_dir,uninit_bg,^extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 2400000k Writing CONFIGS/mountdata Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg444-server: oleg444-server.virtnet: executing set_default_debug -1 all pdsh@oleg444-client: oleg444-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 OST params: --mgsnode=192.168.204.144@tcp --fsname=lustre --ost --index=0 --param=sys.timeout=20 --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/ost1_flakey Permanent disk data: Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: ,errors=remount-ro Parameters: mgsnode=192.168.204.144@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O large_dir,uninit_bg,extents,dir_nlink,quota,project,huge_file,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O large_dir,uninit_bg,extents,dir_nlink,quota,project,huge_file,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k Writing CONFIGS/mountdata Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg444-server: oleg444-server.virtnet: executing set_default_debug -1 all pdsh@oleg444-client: oleg444-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg444-client.virtnet: -o user_xattr,flock 192.168.204.144@tcp:/lustre /mnt/lustre Starting client oleg444-client.virtnet: -o user_xattr,flock 192.168.204.144@tcp:/lustre /mnt/lustre Started clients oleg444-client.virtnet: 192.168.204.144@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) mount lustre on /mnt/lustre2..... Starting client: oleg444-client.virtnet: -o user_xattr,flock 192.168.204.144@tcp:/lustre /mnt/lustre2 Starting client oleg444-client.virtnet: -o user_xattr,flock 192.168.204.144@tcp:/lustre /mnt/lustre2 Started clients oleg444-client.virtnet: 192.168.204.144@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2280828 1696 2159132 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 142216 1388 126828 2% /mnt/lustre[OST:0] filesystem_summary: 142216 1388 126828 2% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 2280 272 2008 12% /mnt/lustre[MDT:0] lustre-OST0000_UUID 50000 302 49698 1% /mnt/lustre[OST:0] filesystem_summary: 2280 272 2008 12% /mnt/lustre creating 60000 hardlinks to oleg444-client.virtnet-0 creating 60000 hardlinks to oleg444-client.virtnet-1 waiting for PIDs 27244 27258 to complete - link 627 (time 1734677866.35 total 10.01 last 62.63) - link 1271 (time 1734677876.35 total 20.02 last 64.37) - link 2193 (time 1734677886.36 total 30.02 last 92.19) - link 2931 (time 1734677896.36 total 40.02 last 73.78) - link 3647 (time 1734677906.37 total 50.03 last 71.55) - link 4477 (time 1734677916.37 total 60.03 last 82.99) - link 5252 (time 1734677926.37 total 70.03 last 77.48) - link 6109 (time 1734677936.37 total 80.03 last 85.69) - link 6912 (time 1734677946.38 total 90.04 last 80.24) - link 7649 (time 1734677956.38 total 100.04 last 73.69) - link 8280 (time 1734677966.41 total 110.07 last 62.94) - link 8900 (time 1734677976.42 total 120.08 last 61.91) - link 9590 (time 1734677986.42 total 130.09 last 68.98) - link 10000 (time 1734677991.81 total 135.47 last 76.09) - link 10682 (time 1734678001.83 total 145.49 last 68.08) - link 11359 (time 1734678011.84 total 155.50 last 67.65) - link 12086 (time 1734678021.84 total 165.51 last 72.65) - link 12702 (time 1734678031.85 total 175.52 last 61.54) - link 13364 (time 1734678041.86 total 185.52 last 66.18) - link 14152 (time 1734678051.87 total 195.53 last 78.72) - link 14884 (time 1734678061.87 total 205.53 last 73.15) - link 15801 (time 1734678071.88 total 215.54 last 91.68) - link 16561 (time 1734678081.88 total 225.55 last 75.93) - link 17350 (time 1734678091.89 total 235.55 last 78.85) - link 18082 (time 1734678101.90 total 245.56 last 73.17) - link 18735 (time 1734678111.90 total 255.56 last 65.29) - link 19579 (time 1734678121.90 total 265.56 last 84.38) - link 20000 (time 1734678127.99 total 271.65 last 69.12) - link 20749 (time 1734678137.99 total 281.66 last 74.87) - link 21559 (time 1734678148.00 total 291.66 last 80.93) - link 22201 (time 1734678158.01 total 301.67 last 64.17) - link 22781 (time 1734678168.01 total 311.67 last 57.98) - link 23550 (time 1734678178.01 total 321.67 last 76.90) - link 24293 (time 1734678188.01 total 331.67 last 74.28) - link 25165 (time 1734678198.02 total 341.68 last 87.11) - link 26026 (time 1734678208.02 total 351.69 last 86.10) - link 26869 (time 1734678218.04 total 361.70 last 84.15) - link 27671 (time 1734678228.05 total 371.71 last 80.17) - link 28774 (time 1734678238.05 total 381.71 last 110.24) - link 29752 (time 1734678248.06 total 391.72 last 97.72) - link 30000 (time 1734678250.65 total 394.31 last 95.86) - link 31023 (time 1734678260.66 total 404.32 last 102.22) - link 31916 (time 1734678270.66 total 414.32 last 89.27) - link 33003 (time 1734678280.66 total 424.32 last 108.65) - link 33974 (time 1734678290.67 total 434.33 last 97.05) - link 34844 (time 1734678300.68 total 444.34 last 86.87) - link 35658 (time 1734678310.69 total 454.35 last 81.35) - link 36510 (time 1734678320.69 total 464.35 last 85.19) - link 37519 (time 1734678330.69 total 474.35 last 100.86) - link 38472 (time 1734678340.70 total 484.36 last 95.21) - link 39302 (time 1734678350.70 total 494.37 last 82.98) - link 40000 (time 1734678357.78 total 501.44 last 98.67) - link 40868 (time 1734678367.78 total 511.44 last 86.76) - link 41783 (time 1734678377.79 total 521.45 last 91.43) - link 42466 (time 1734678387.79 total 531.45 last 68.28) - link 43063 (time 1734678397.80 total 541.46 last 59.65) - link 43701 (time 1734678407.80 total 551.46 last 63.80) - link 44450 (time 1734678417.80 total 561.47 last 74.89) - link 45174 (time 1734678427.81 total 571.47 last 72.34) - link 46110 (time 1734678437.81 total 581.47 last 93.60) - link 47131 (time 1734678447.81 total 591.48 last 102.08) - link 47937 (time 1734678457.82 total 601.48 last 80.58) - link 48668 (time 1734678467.82 total 611.48 last 73.09) - link 49470 (time 1734678477.82 total 621.49 last 80.17) - link 50000 (time 1734678486.09 total 629.75 last 64.10) - link 50669 (time 1734678496.10 total 639.76 last 66.87) - link 51510 (time 1734678506.11 total 649.78 last 83.95) - link 52548 (time 1734678516.12 total 659.78 last 103.72) - link 53444 (time 1734678526.13 total 669.79 last 89.56) - link 54271 (time 1734678536.14 total 679.80 last 82.60) - link 55133 (time 1734678546.15 total 689.81 last 86.13) - link 55902 (time 1734678556.16 total 699.82 last 76.84) - link 56758 (time 1734678566.16 total 709.82 last 85.59) - link 57489 (time 1734678576.17 total 719.83 last 73.03) - link 58362 (time 1734678586.17 total 729.83 last 87.29) - link 59294 (time 1734678596.18 total 739.84 last 93.13) total: 60000 link in 746.99 seconds: 80.32 ops/second - link 631 (time 1734677866.73 total 10.02 last 62.95) - link 1287 (time 1734677876.73 total 20.03 last 65.58) - link 2207 (time 1734677886.74 total 30.03 last 91.95) - link 2950 (time 1734677896.74 total 40.04 last 74.27) - link 3666 (time 1734677906.74 total 50.04 last 71.57) - link 4495 (time 1734677916.76 total 60.05 last 82.81) - link 5274 (time 1734677926.76 total 70.05 last 77.88) - link 6137 (time 1734677936.76 total 80.05 last 86.30) - link 6942 (time 1734677946.76 total 90.06 last 80.47) - link 7666 (time 1734677956.77 total 100.06 last 72.37) - link 8297 (time 1734677966.78 total 110.08 last 63.01) - link 8928 (time 1734677976.79 total 120.09 last 63.04) - link 9620 (time 1734677986.79 total 130.09 last 69.20) - link 10000 (time 1734677991.69 total 134.99 last 77.53) - link 10687 (time 1734678001.70 total 144.99 last 68.67) - link 11356 (time 1734678011.70 total 154.99 last 66.88) - link 12088 (time 1734678021.73 total 165.02 last 73.00) - link 12704 (time 1734678031.74 total 175.04 last 61.51) - link 13359 (time 1734678041.75 total 185.04 last 65.47) - link 14147 (time 1734678051.76 total 195.05 last 78.72) - link 14878 (time 1734678061.77 total 205.06 last 73.04) - link 15787 (time 1734678071.77 total 215.07 last 90.84) - link 16542 (time 1734678081.78 total 225.07 last 75.46) - link 17330 (time 1734678091.78 total 235.08 last 78.77) - link 18063 (time 1734678101.80 total 245.10 last 73.17) - link 18712 (time 1734678111.81 total 255.10 last 64.86) - link 19558 (time 1734678121.82 total 265.11 last 84.53) - link 20000 (time 1734678128.27 total 271.56 last 68.49) - link 20759 (time 1734678138.28 total 281.58 last 75.82) - link 21555 (time 1734678148.29 total 291.59 last 79.51) - link 22201 (time 1734678158.30 total 301.59 last 64.55) - link 22786 (time 1734678168.31 total 311.61 last 58.42) - link 23551 (time 1734678178.32 total 321.61 last 76.48) - link 24284 (time 1734678188.32 total 331.61 last 73.29) - link 25164 (time 1734678198.32 total 341.62 last 87.95) - link 26016 (time 1734678208.33 total 351.63 last 85.10) - link 26862 (time 1734678218.34 total 361.64 last 84.53) - link 27675 (time 1734678228.35 total 371.64 last 81.27) - link 28766 (time 1734678238.35 total 381.64 last 109.08) - link 29742 (time 1734678248.35 total 391.65 last 97.54) - link 30000 (time 1734678251.01 total 394.31 last 97.01) - link 31019 (time 1734678261.01 total 404.31 last 101.90) - link 31917 (time 1734678271.02 total 414.31 last 89.75) - link 33009 (time 1734678281.02 total 424.32 last 109.14) - link 33991 (time 1734678291.03 total 434.32 last 98.19) - link 34854 (time 1734678301.03 total 444.33 last 86.25) - link 35666 (time 1734678311.03 total 454.33 last 81.19) - link 36523 (time 1734678321.04 total 464.33 last 85.68) - link 37522 (time 1734678331.04 total 474.34 last 99.85) - link 38464 (time 1734678341.05 total 484.34 last 94.11) - link 39288 (time 1734678351.05 total 494.35 last 82.36) - link 40000 (time 1734678358.24 total 501.53 last 99.10) - link 40858 (time 1734678368.24 total 511.53 last 85.80) - link 41785 (time 1734678378.25 total 521.55 last 92.60) - link 42449 (time 1734678388.26 total 531.55 last 66.36) - link 43054 (time 1734678398.27 total 541.56 last 60.43) - link 43714 (time 1734678408.27 total 551.57 last 65.96) - link 44464 (time 1734678418.28 total 561.57 last 74.96) - link 45192 (time 1734678428.28 total 571.58 last 72.77) - link 46153 (time 1734678438.29 total 581.58 last 96.07) - link 47158 (time 1734678448.29 total 591.59 last 100.41) - link 47951 (time 1734678458.30 total 601.59 last 79.27) - link 48680 (time 1734678468.30 total 611.60 last 72.86) - link 49480 (time 1734678478.33 total 621.63 last 79.79) - link 50000 (time 1734678486.56 total 629.86 last 63.17) - link 50676 (time 1734678496.57 total 639.87 last 67.53) - link 51507 (time 1734678506.59 total 649.88 last 82.99) - link 52572 (time 1734678516.60 total 659.89 last 106.39) - link 53470 (time 1734678526.61 total 669.90 last 89.70) - link 54280 (time 1734678536.61 total 679.90 last 81.00) - link 55140 (time 1734678546.62 total 689.92 last 85.88) - link 55898 (time 1734678556.63 total 699.92 last 75.73) - link 56756 (time 1734678566.64 total 709.93 last 85.74) - link 57495 (time 1734678576.65 total 719.94 last 73.84) - link 58384 (time 1734678586.65 total 729.94 last 88.87) - link 59315 (time 1734678596.66 total 739.95 last 93.01) total: 60000 link in 746.89 seconds: 80.33 ops/second estimate 31334s left after 120000 files / 747s umount lustre on /mnt/lustre2..... Stopping client oleg444-client.virtnet /mnt/lustre2 (opts:-f) umount lustre on /mnt/lustre..... Stopping client oleg444-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg444-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg444-server stop mds service on oleg444-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg444-server unloading modules via unload_modules_local on: 'oleg444-server' oleg444-server: oleg444-server.virtnet: executing unload_modules_local modules unloaded. ETA 31334s after 120000 files / 747s is too long e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg444-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg444-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 19) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 151 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 152 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 154 badness 0 to 2 foroleg444-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (51650560, 266) != expected (51658752, 266) oleg444-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (51650560, 266) != expected (51658752, 266) 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 156 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 157 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 160 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 161 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 162 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 163 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 164 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 165 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 166 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 167 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 168 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 169 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 170 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 171 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 172 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 173 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 174 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 175 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 176 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 177 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 178 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 179 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 180 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 182 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 183 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 184 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 190 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 191 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] group 17 finished [Thread 0] group 18 finished [Thread 0] group 19 finished [Thread 0] Pass 1: Memory used: 380k/912k (124k/257k), time: 0.02/ 0.01/ 0.00 [Thread 0] Pass 1: I/O read: 2MB, write: 0MB, rate: 90.36MB/s [Thread 0] Scanned group range [0, 19), inodes 281 Pass 2: Checking directory structure Pass 2: Memory used: 380k/0k (84k/297k), time: 0.50/ 0.33/ 0.07 Pass 2: I/O read: 49MB, write: 0MB, rate: 98.95MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 380k/0k (85k/296k), time: 0.53/ 0.35/ 0.08 Pass 3: Memory used: 380k/0k (83k/298k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 380k/0k (69k/312k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 5555.56MB/s Pass 5: Checking group summary information Pass 5: Memory used: 380k/0k (68k/313k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 385.36MB/s Update quota info for quota type 0? no Update quota info for quota type 1? no Update quota info for quota type 2? no lustre-MDT0000: ********** WARNING: Filesystem still has errors ********** 276 inodes used (12.11%, out of 2280) 3 non-contiguous foleg444-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (51650560, 266) != expected (51658752, 266) pdsh@oleg444-client: oleg444-server: ssh exited with exit code 4 iles (1.1%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 37948 blocks used (6.32%, out of 600000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 120000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 120264 files Memory used: 380k/0k (67k/314k), time: 0.54/ 0.35/ 0.08 I/O read: 49MB, write: 0MB, rate: 91.45MB/s pdsh@oleg444-client: oleg444-client: ssh exited with exit code 2 pdsh@oleg444-client: oleg444-server: ssh exited with exit code 2 pdsh@oleg444-client: oleg444-client: ssh exited with exit code 2 pdsh@oleg444-client: oleg444-server: ssh exited with exit code 2 Stopping clients: oleg444-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg444-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg444-client: oleg444-server: ssh exited with exit code 2 oleg444-server: oleg444-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg444-server' oleg444-server: oleg444-server.virtnet: executing load_modules_local oleg444-server: Loading modules from /home/green/git/lustre-release/lustre oleg444-server: detected 4 online CPUs by sysfs oleg444-server: MODOPTS_LIBCFS= oleg444-server: Force libcfs to create 2 CPU partitions oleg444-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg444-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg444-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey