== conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 15:58:49 (1710100729) oleg131-server: debugfs 1.46.2.wc5 (26-Mar-2022) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity oleg131-server: debugfs 1.46.2.wc5 (26-Mar-2022) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity umount lustre on /mnt/lustre..... stop ost1 service on oleg131-server stop mds service on oleg131-server stop mds service on oleg131-server unloading modules on: 'oleg131-server' oleg131-server: oleg131-server.virtnet: executing unload_modules_local modules unloaded. MDT params: --mgs --fsname=lustre --mdt --index=0 --param=sys.timeout=20 --param=mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity --backfstype=ldiskfs --device-size=2400000 --mkfsoptions=\"-O large_dir -i 1048576 -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/mds1_flakey Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg131-server' oleg131-server: oleg131-server.virtnet: executing load_modules_local oleg131-server: Loading modules from /home/green/git/lustre-release/lustre oleg131-server: detected 4 online CPUs by sysfs oleg131-server: Force libcfs to create 2 CPU partitions oleg131-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg131-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg131-server: quota/lquota options: 'hash_lqs_cur_bits=3' Permanent disk data: Target: lustre:MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: sys.timeout=20 mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity device size = 2500MB formatting backing filesystem ldiskfs on /dev/mapper/mds1_flakey target name lustre:MDT0000 kilobytes 2400000 options -i 1048576 -b 4096 -J size=93 -I 1024 -q -O large_dir,uninit_bg,^extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:MDT0000 -i 1048576 -b 4096 -J size=93 -I 1024 -q -O large_dir,uninit_bg,^extents,dirdata,dir_nlink,quota,project,huge_file,ea_inode,^fast_commit,flex_bg -E lazy_itable_init,lazy_journal_init,packed_meta_blocks -F /dev/mapper/mds1_flakey 2400000k Writing CONFIGS/mountdata Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg131-server: oleg131-server.virtnet: executing set_default_debug -1 all pdsh@oleg131-client: oleg131-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 OST params: --mgsnode=oleg131-server@tcp --fsname=lustre --ost --index=0 --param=sys.timeout=20 --backfstype=ldiskfs --device-size=200000 --mkfsoptions=\"-O large_dir -b 4096 -E lazy_itable_init\" --reformat /dev/mapper/ost1_flakey Permanent disk data: Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: ,errors=remount-ro Parameters: mgsnode=192.168.201.131@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O large_dir,uninit_bg,extents,dir_nlink,quota,project,huge_file,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O large_dir,uninit_bg,extents,dir_nlink,quota,project,huge_file,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k Writing CONFIGS/mountdata Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg131-server: oleg131-server.virtnet: executing set_default_debug -1 all pdsh@oleg131-client: oleg131-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 mount lustre on /mnt/lustre..... Starting client: oleg131-client.virtnet: -o user_xattr,flock oleg131-server@tcp:/lustre /mnt/lustre Starting client oleg131-client.virtnet: -o user_xattr,flock oleg131-server@tcp:/lustre /mnt/lustre Started clients oleg131-client.virtnet: 192.168.201.131@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) mount lustre on /mnt/lustre2..... Starting client: oleg131-client.virtnet: -o user_xattr,flock oleg131-server@tcp:/lustre /mnt/lustre2 Starting client oleg131-client.virtnet: -o user_xattr,flock oleg131-server@tcp:/lustre /mnt/lustre2 Started clients oleg131-client.virtnet: 192.168.201.131@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2280828 1696 2159132 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 142216 1388 126828 2% /mnt/lustre[OST:0] filesystem_summary: 142216 1388 126828 2% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 2280 272 2008 12% /mnt/lustre[MDT:0] lustre-OST0000_UUID 50000 302 49698 1% /mnt/lustre[OST:0] filesystem_summary: 2280 272 2008 12% /mnt/lustre creating 60000 hardlinks to oleg131-client.virtnet-0 creating 60000 hardlinks to oleg131-client.virtnet-1 waiting for PIDs 26993 27007 to complete - link 1214 (time 1710100776.87 total 10.00 last 121.37) - link 2990 (time 1710100786.87 total 20.01 last 177.51) - link 4849 (time 1710100796.88 total 30.01 last 185.87) - link 6439 (time 1710100806.88 total 40.01 last 158.98) - link 7579 (time 1710100816.88 total 50.02 last 113.93) - link 8542 (time 1710100826.89 total 60.02 last 96.25) - link 9447 (time 1710100836.89 total 70.02 last 90.49) - link 10000 (time 1710100842.49 total 75.62 last 98.76) - link 10899 (time 1710100852.50 total 85.63 last 89.83) - link 11797 (time 1710100862.50 total 95.64 last 89.72) - link 12484 (time 1710100872.51 total 105.64 last 68.67) - link 13213 (time 1710100882.52 total 115.66 last 72.80) - link 13994 (time 1710100892.53 total 125.66 last 78.04) - link 14718 (time 1710100902.55 total 135.68 last 72.28) - link 15448 (time 1710100912.55 total 145.68 last 73.00) - link 16164 (time 1710100922.56 total 155.69 last 71.54) - link 16923 (time 1710100932.56 total 165.70 last 75.85) - link 17740 (time 1710100942.57 total 175.71 last 81.61) - link 18630 (time 1710100952.58 total 185.71 last 88.95) - link 19457 (time 1710100962.63 total 195.77 last 82.26) - link 20000 (time 1710100969.63 total 202.76 last 77.61) - link 20795 (time 1710100979.64 total 212.77 last 79.42) - link 21472 (time 1710100989.65 total 222.78 last 67.64) - link 22184 (time 1710100999.66 total 232.79 last 71.14) - link 22925 (time 1710101009.66 total 242.79 last 74.07) - link 23756 (time 1710101019.67 total 252.80 last 83.03) - link 24507 (time 1710101029.68 total 262.82 last 75.00) - link 25301 (time 1710101039.69 total 272.82 last 79.35) - link 26017 (time 1710101049.69 total 282.83 last 71.57) - link 26797 (time 1710101059.69 total 292.83 last 78.00) - link 27648 (time 1710101069.70 total 302.83 last 85.04) - link 28405 (time 1710101079.72 total 312.85 last 75.56) - link 29144 (time 1710101089.72 total 322.85 last 73.89) - link 29991 (time 1710101099.73 total 332.86 last 84.64) - link 30726 (time 1710101109.73 total 342.87 last 73.44) - link 31452 (time 1710101119.75 total 352.88 last 72.51) - link 32000 (time 1710101129.75 total 362.89 last 54.77) - link 32522 (time 1710101139.75 total 372.89 last 52.20) - link 33155 (time 1710101149.75 total 382.89 last 63.30) - link 33834 (time 1710101159.77 total 392.90 last 67.81) - link 34462 (time 1710101169.79 total 402.92 last 62.67) - link 35045 (time 1710101179.79 total 412.93 last 58.25) - link 35672 (time 1710101189.80 total 422.93 last 62.65) - link 36282 (time 1710101199.80 total 432.93 last 61.00) - link 36849 (time 1710101209.80 total 442.94 last 56.70) - link 37444 (time 1710101219.83 total 452.96 last 59.36) - link 37981 (time 1710101229.83 total 462.96 last 53.68) - link 38556 (time 1710101239.84 total 472.97 last 57.46) - link 39088 (time 1710101249.84 total 482.98 last 53.16) - link 39640 (time 1710101259.86 total 492.99 last 55.13) - link 40000 (time 1710101266.85 total 499.98 last 51.49) - link 40555 (time 1710101276.86 total 509.99 last 55.47) - link 41189 (time 1710101286.86 total 520.00 last 63.35) - link 41836 (time 1710101296.88 total 530.01 last 64.63) - link 42354 (time 1710101306.89 total 540.02 last 51.74) - link 42872 (time 1710101316.89 total 550.03 last 51.77) - link 43402 (time 1710101326.90 total 560.04 last 52.94) - link 43996 (time 1710101336.90 total 570.04 last 59.39) - link 44498 (time 1710101346.91 total 580.04 last 50.17) - link 44976 (time 1710101367.12 total 600.25 last 23.65) - link 45514 (time 1710101377.12 total 610.26 last 53.78) - link 46098 (time 1710101387.13 total 620.26 last 58.37) - link 46663 (time 1710101397.14 total 630.27 last 56.45) - link 47052 (time 1710101416.00 total 649.13 last 20.62) - link 47561 (time 1710101426.02 total 659.16 last 50.79) - link 47800 (time 1710101441.04 total 674.17 last 15.92) - link 48438 (time 1710101451.05 total 684.19 last 63.70) - link 49005 (time 1710101461.08 total 694.22 last 56.53) - link 49544 (time 1710101471.13 total 704.26 last 53.67) - link 50000 (time 1710101479.94 total 713.07 last 51.74) - link 50523 (time 1710101489.95 total 723.08 last 52.24) - link 51054 (time 1710101500.01 total 733.14 last 52.81) - link 51605 (time 1710101510.01 total 743.15 last 55.06) - link 52249 (time 1710101520.02 total 753.15 last 64.37) - link 52849 (time 1710101530.04 total 763.17 last 59.89) - link 53373 (time 1710101540.04 total 773.17 last 52.38) - link 53972 (time 1710101550.08 total 783.21 last 59.68) - link 54525 (time 1710101560.10 total 793.23 last 55.20) - link 55194 (time 1710101570.10 total 803.24 last 66.85) - link 55735 (time 1710101580.12 total 813.25 last 54.03) - link 56250 (time 1710101590.12 total 823.25 last 51.49) - link 56797 (time 1710101600.13 total 833.26 last 54.63) - link 57355 (time 1710101610.15 total 843.28 last 55.69) - link 57919 (time 1710101620.16 total 853.29 last 56.36) - link 58472 (time 1710101630.16 total 863.29 last 55.30) - link 59041 (time 1710101640.17 total 873.30 last 56.82) - link 59574 (time 1710101650.19 total 883.32 last 53.22) total: 60000 link in 890.90 seconds: 67.35 ops/second - link 1240 (time 1710100777.10 total 10.01 last 123.93) - link 3017 (time 1710100787.10 total 20.01 last 177.65) - link 4884 (time 1710100797.10 total 30.01 last 186.67) - link 6467 (time 1710100807.10 total 40.01 last 158.29) - link 7592 (time 1710100817.11 total 50.02 last 112.40) - link 8549 (time 1710100827.11 total 60.02 last 95.66) - link 9459 (time 1710100837.12 total 70.03 last 90.97) - link 10000 (time 1710100842.63 total 75.54 last 98.11) - link 10903 (time 1710100852.65 total 85.56 last 90.16) - link 11800 (time 1710100862.65 total 95.56 last 89.65) - link 12491 (time 1710100872.66 total 105.57 last 69.04) - link 12667 (time 1710100886.36 total 119.27 last 12.85) - link 13470 (time 1710100896.38 total 129.29 last 80.15) - link 14144 (time 1710100906.40 total 139.31 last 67.27) - link 14773 (time 1710100926.19 total 159.10 last 31.78) - link 15534 (time 1710100936.21 total 169.12 last 75.92) - link 16356 (time 1710100946.22 total 179.12 last 82.17) - link 17296 (time 1710100956.22 total 189.13 last 93.91) - link 18057 (time 1710100966.23 total 199.14 last 76.06) - link 18862 (time 1710100976.24 total 209.15 last 80.42) - link 19573 (time 1710100986.25 total 219.16 last 71.02) - link 20000 (time 1710100992.48 total 225.39 last 68.53) - link 20702 (time 1710101002.49 total 235.39 last 70.17) - link 21495 (time 1710101012.49 total 245.40 last 79.25) - link 22307 (time 1710101022.49 total 255.40 last 81.18) - link 23036 (time 1710101032.50 total 265.41 last 72.84) - link 23865 (time 1710101042.51 total 275.42 last 82.81) - link 24198 (time 1710101058.15 total 291.05 last 21.30) - link 25049 (time 1710101068.15 total 301.06 last 85.06) - link 25855 (time 1710101078.16 total 311.07 last 80.55) - link 26584 (time 1710101088.17 total 321.08 last 72.82) - link 27414 (time 1710101098.18 total 331.09 last 82.91) - link 28162 (time 1710101108.18 total 341.09 last 74.79) - link 28896 (time 1710101118.19 total 351.09 last 73.37) - link 29486 (time 1710101128.19 total 361.10 last 58.97) - link 30000 (time 1710101137.88 total 370.79 last 53.03) - link 30592 (time 1710101147.89 total 380.80 last 59.15) - link 31271 (time 1710101157.89 total 390.80 last 67.88) - link 31923 (time 1710101167.90 total 400.81 last 65.14) - link 32510 (time 1710101177.91 total 410.82 last 58.65) - link 33135 (time 1710101187.92 total 420.83 last 62.46) - link 33769 (time 1710101197.94 total 430.84 last 63.28) - link 34327 (time 1710101207.95 total 440.86 last 55.70) - link 34931 (time 1710101217.97 total 450.88 last 60.29) - link 35486 (time 1710101227.98 total 460.89 last 55.43) - link 36034 (time 1710101237.98 total 470.89 last 54.80) - link 36559 (time 1710101247.99 total 480.90 last 52.47) - link 37128 (time 1710101258.03 total 490.94 last 56.66) - link 37646 (time 1710101268.04 total 500.95 last 51.73) - link 37672 (time 1710101279.76 total 512.67 last 2.22) - link 38325 (time 1710101289.77 total 522.67 last 65.26) - link 38922 (time 1710101299.77 total 532.68 last 59.68) - link 39418 (time 1710101309.78 total 542.69 last 49.57) - link 39939 (time 1710101319.78 total 552.69 last 52.08) - link 40476 (time 1710101329.78 total 562.69 last 53.70) - link 41057 (time 1710101339.78 total 572.69 last 58.10) - link 41542 (time 1710101349.79 total 582.70 last 48.46) - link 42087 (time 1710101359.80 total 592.71 last 54.44) - link 42669 (time 1710101369.81 total 602.72 last 58.15) - link 43237 (time 1710101379.81 total 612.72 last 56.78) - link 43802 (time 1710101389.82 total 622.73 last 56.44) - link 44387 (time 1710101399.84 total 632.74 last 58.42) - link 44897 (time 1710101409.86 total 642.77 last 50.89) - link 45470 (time 1710101419.87 total 652.78 last 57.21) - link 46025 (time 1710101429.88 total 662.79 last 55.44) - link 46606 (time 1710101439.89 total 672.80 last 58.05) - link 47232 (time 1710101449.90 total 682.81 last 62.54) - link 47813 (time 1710101459.91 total 692.81 last 58.08) - link 48353 (time 1710101469.91 total 702.82 last 53.97) - link 48860 (time 1710101479.92 total 712.83 last 50.67) - link 49372 (time 1710101489.94 total 722.85 last 51.06) - link 49892 (time 1710101499.97 total 732.87 last 51.88) - link 50000 (time 1710101501.99 total 734.90 last 53.40) - link 50556 (time 1710101512.00 total 744.91 last 55.52) - link 51205 (time 1710101522.02 total 754.93 last 64.77) - link 51784 (time 1710101532.04 total 764.95 last 57.81) - link 52326 (time 1710101542.05 total 774.96 last 54.14) - link 52932 (time 1710101552.06 total 784.97 last 60.54) - link 53485 (time 1710101562.07 total 794.98 last 55.25) - link 54135 (time 1710101572.07 total 804.98 last 64.95) - link 54665 (time 1710101582.08 total 814.99 last 52.97) - link 55199 (time 1710101592.09 total 825.00 last 53.37) - link 55727 (time 1710101602.09 total 835.00 last 52.78) - link 56307 (time 1710101612.10 total 845.01 last 57.96) - link 56859 (time 1710101622.10 total 855.01 last 55.16) - link 57405 (time 1710101632.11 total 865.02 last 54.55) - link 57988 (time 1710101642.12 total 875.03 last 58.27) - link 58496 (time 1710101652.13 total 885.04 last 50.73) - link 59048 (time 1710101662.14 total 895.05 last 55.14) - link 59641 (time 1710101672.15 total 905.06 last 59.27) total: 60000 link in 911.17 seconds: 65.85 ops/second estimate 38348s left after 120000 files / 912s umount lustre on /mnt/lustre2..... Stopping client oleg131-client.virtnet /mnt/lustre2 (opts:-f) umount lustre on /mnt/lustre..... Stopping client oleg131-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg131-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg131-server stop mds service on oleg131-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg131-server unloading modules on: 'oleg131-server' oleg131-server: oleg131-server.virtnet: executing unload_modules_local modules unloaded. ETA 38348s after 120000 files / 912s is too long e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg131-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg131-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 19) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 151 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 152 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 156 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 157 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 160 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 161 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 162 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 163 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 164 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 165 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 166 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 167 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 168 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 169 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 170 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 171 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 172 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 173 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 174 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 175 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 176 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 177 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 178 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 179 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 180 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 181 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 182 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 183 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 184 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 185 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 190 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 191 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] group 17 finished [Thread 0] group 18 finished [Thread 0] group 19 finished [Thread 0] Pass 1: Memory used: 380k/908k (124k/257k), time: 0.05/ 0.01/ 0.00 [Thread 0] Pass 1: I/O read: 2MB, write: 0MB, rate: 39.20MB/s [Thread 0] Scanned group range [0, 19), inodes 285 Pass 2: Checking directory structure Pass 2: Memory used: 380k/0k (84k/297k), time: 0.95/ 0.40/ 0.10 Pass 2: I/O read: 49MB, write: 0MB, rate: 51.41MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 380k/0k (85k/296k), time: 1.03/ 0.42/ 0.10 Paoleg131-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (51531776, 266) != expected (51539968, 266) oleg131-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (51531776, 266) != expected (51539968, 266) oleg131-server: [QUOTA WARNING] Usage inconsistent for ID 0:actual (51531776, 266) != expected (51539968, 266) pdsh@oleg131-client: oleg131-server: ssh exited with exit code 4 ss 3: Memory used: 380k/0k (83k/298k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 380k/0k (69k/312k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 1MB, write: 0MB, rate: 6451.61MB/s Pass 5: Checking group summary information Pass 5: Memory used: 380k/0k (68k/313k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 680.74MB/s Update quota info for quota type 0? no Update quota info for quota type 1? no Update quota info for quota type 2? no lustre-MDT0000: ********** WARNING: Filesystem still has errors ********** 276 inodes used (12.11%, out of 2280) 3 non-contiguous files (1.1%) 1 non-contiguous directory (0.4%) # of inodes with ind/dind/tind blocks: 1/1/0 37919 blocks used (6.32%, out of 600000) 0 bad blocks 1 large file 148 regular files 118 directories 0 character device files 0 block device files 0 fifos 120000 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 120264 files Memory used: 380k/0k (67k/314k), time: 1.03/ 0.42/ 0.10 I/O read: 49MB, write: 0MB, rate: 47.45MB/s pdsh@oleg131-client: oleg131-server: ssh exited with exit code 2 pdsh@oleg131-client: oleg131-client: ssh exited with exit code 2 pdsh@oleg131-client: oleg131-client: ssh exited with exit code 2 pdsh@oleg131-client: oleg131-server: ssh exited with exit code 2 Stopping clients: oleg131-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg131-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg131-client: oleg131-server: ssh exited with exit code 2 oleg131-server: oleg131-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg131-server' oleg131-server: oleg131-server.virtnet: executing load_modules_local oleg131-server: Loading modules from /home/green/git/lustre-release/lustre oleg131-server: detected 4 online CPUs by sysfs oleg131-server: Force libcfs to create 2 CPU partitions oleg131-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg131-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg131-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey