-----============= acceptance-small: sanity-benchmark ============----- Thu May 1 23:28:47 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg413-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanity-benchmark.*ex: No such file or directory excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 23:28:56 (1746156536) === oleg413-client.virtnet: executing check_config_client /mnt/lustre oleg413-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg413-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800af24f800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800af24f800.idle_timeout=debug disable quota as required oleg413-server: oleg413-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 23:29:11 (1746156551) === == sanity-benchmark test dbench: dbench ================== 23:29:11 (1746156551) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7670] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg413-client.virtnet] [20] [-t] [120] bash: rundbench: Permission denied debug=0x33f0484 PASS dbench (3s) == sanity-benchmark test bonnie: bonnie++ ================ 23:29:14 (1746156554) min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7670] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [bonnie++] [-f] [-r] [0] [-s5281] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg413-clien 5281M 97808 70 76750 57 193427 35 1143 172 Latency 22511us 89106us 110ms 45064us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg413-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 132 15 3146 15 231 12 138 15 377 11 194 11 Latency 42856us 50813us 51144us 45252us 14657us 66460us 1.97,1.97,oleg413-client.virtnet,1,1746145315,5281M,,,,97808,70,76750,57,,,193427,35,1143,172,10,,,,,132,15,3146,15,231,12,138,15,377,11,194,11,,22511us,89106us,,110ms,45064us,42856us,50813us,51144us,45252us,14657us,66460us debug=0x33f0484 PASS bonnie (448s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 23:36:43 (1746157003) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 2671 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 2671 skipping zero length punch hole skipping zero size read truncating to largest ever: 0x14b19d fallocating to largest ever: 0x21c110 fallocating to largest ever: 0x3dcb47 fallocating to largest ever: 0x4ce022 fallocating to largest ever: 0x4e7deb fallocating to largest ever: 0x51a46a fallocating to largest ever: 0x5258bd 001000 1746157011.847596 trunc from 0x4c77f5 to 0x393c93 (0x133b61 bytes) fallocating to largest ever: 0x5285e2 002000 1746157018.395712 punch from 0x320107 to 0x32ee55 (0xed4f bytes) 003000 1746157024.395745 trunc from 0x4360b8 to 0x43f8b3 (0x97fc bytes) 004000 1746157030.190440 write 0x49fe04 thru 0x4a8b3d (0x8d3a bytes) 005000 1746157035.721162 read 0x012408 thru 0x01deb0 (0xbaa9 bytes) 006000 1746157041.978680 trunc from 0x1d8531 to 0x1e3c6d (0xb73d bytes) 007000 1746157048.239466 write 0x470415 thru 0x47aea1 (0xaa8d bytes) 008000 1746157055.492012 trunc from 0x3899f9 to 0x38c2ad (0x28b5 bytes) 009000 1746157061.671926 read 0x4ad0da thru 0x4b4259 (0x7180 bytes) 010000 1746157067.650248 mapwrite 0x258725 thru 0x2635f3 (0xaecf bytes) 011000 1746157074.642281 fallocate 0x2aa6ba thru 0x2b9d7c (0xf6c3 bytes) 012000 1746157081.372435 trunc from 0x22baa5 to 0x238e00 (0xd35c bytes) 014000 1746157093.293599 write 0x2c62ca thru 0x2d4955 (0xe68c bytes) 015000 1746157098.584747 trunc from 0x4b7677 to 0x4c3be9 (0xc573 bytes) 016000 1746157104.508456 trunc from 0x378154 to 0x3783fd (0x2aa bytes) 017000 1746157109.438549 trunc from 0x3c4c45 to 0x473b59 (0xaef15 bytes) 018000 1746157115.584878 trunc from 0x195bf9 to 0x19cb28 (0x6f30 bytes) 019000 1746157121.196803 write 0x0df6e5 thru 0x0e8388 (0x8ca4 bytes) 020000 1746157127.178701 mapwrite 0x0ed86c thru 0x0fb3ba (0xdb4f bytes) 022000 1746157139.400007 write 0x118f92 thru 0x11e7c2 (0x5831 bytes) 024000 1746157150.175948 mapread 0x29a61c thru 0x29ac5e (0x643 bytes) 025000 1746157155.698970 mapread 0x32c75f thru 0x338be6 (0xc488 bytes) skipping zero size write 028000 1746157172.045862 mapread 0x10dd97 thru 0x1188e2 (0xab4c bytes) 029000 1746157177.948144 mapwrite 0x4593c8 thru 0x468f06 (0xfb3f bytes) 030000 1746157183.961294 trunc from 0x332a4f to 0x33e70e (0xbcc0 bytes) 032000 1746157195.092913 fallocate 0x3d1c80 thru 0x3df0ce (0xd44f bytes) 033000 1746157201.450784 trunc from 0x41972f to 0x08cf8d (0x38c7a1 bytes) 035000 1746157213.845713 mapwrite 0x47bd33 thru 0x480c35 (0x4f03 bytes) 036000 1746157219.385774 fallocate 0x074dbe thru 0x079c7f (0x4ec2 bytes) 037000 1746157226.339328 trunc from 0x26359e to 0x26f7a7 (0xc20a bytes) 038000 1746157232.350703 fallocate 0x2d5b95 thru 0x2d7b67 (0x1fd3 bytes) 039000 1746157238.200743 trunc from 0x4d1166 to 0x4a72e7 (0x29e7e bytes) 040000 1746157244.789092 read 0x057782 thru 0x05d855 (0x60d4 bytes) 041000 1746157250.276071 read 0x136b9e thru 0x13ce8e (0x62f1 bytes) 042000 1746157256.639763 trunc from 0x011d52 to 0x013d7b (0x202a bytes) 043000 1746157262.320738 mapwrite 0x3f0951 thru 0x3f7deb (0x749b bytes) 044000 1746157268.225319 write 0x0bc92c thru 0x0befaf (0x2684 bytes) 046000 1746157279.896979 mapread 0x005418 thru 0x00b1fe (0x5de7 bytes) 047000 1746157286.278377 fallocate 0x239191 thru 0x23f159 (0x5fc9 bytes) 048000 1746157292.153693 trunc from 0x2afa92 to 0x3c2b26 (0x113095 bytes) 049000 1746157298.021486 write 0x48bdad thru 0x494c22 (0x8e76 bytes) 050000 1746157304.463042 mapread 0x1a7435 thru 0x1b08c0 (0x948c bytes) 051000 1746157311.071146 read 0x204b9f thru 0x20b493 (0x68f5 bytes) 052000 1746157318.768348 write 0x3d0058 thru 0x3d04c3 (0x46c bytes) 053000 1746157325.464280 fallocate 0x11f717 thru 0x12bca7 (0xc591 bytes) 054000 1746157332.559611 write 0x364d73 thru 0x366e48 (0x20d6 bytes) 055000 1746157338.963001 write 0x2fc953 thru 0x302899 (0x5f47 bytes) 056000 1746157345.434064 mapread 0x1b4159 thru 0x1ba0b9 (0x5f61 bytes) 058000 1746157358.916777 read 0x0b46c4 thru 0x0bc55e (0x7e9b bytes) 059000 1746157364.918843 punch from 0x06d6b1 to 0x07ce3b (0xf78b bytes) 060000 1746157371.265075 trunc from 0x4f7fd5 to 0x1422f8 (0x3b5cdc bytes) 061000 1746157376.955648 write 0x3d941b thru 0x3dca71 (0x3657 bytes) 062000 1746157382.768805 trunc from 0x0bdb65 to 0x2c263c (0x204ad8 bytes) 064000 1746157393.181786 mapread 0x2a83cc thru 0x2b4696 (0xc2cb bytes) 065000 1746157399.898250 mapwrite 0x0114d8 thru 0x011bec (0x715 bytes) 066000 1746157406.331480 mapread 0x147b44 thru 0x14e732 (0x6bef bytes) 067000 1746157412.283316 fallocate 0x4c4bd7 thru 0x4c8671 (0x3a9b bytes) 068000 1746157418.408234 trunc from 0x33c59b to 0x2a126e (0x9b32c bytes) 069000 1746157424.273247 punch from 0x0cf47e to 0x0de56a (0xf0ed bytes) 070000 1746157430.039164 fallocate 0x2905d2 thru 0x2986aa (0x80d9 bytes) 071000 1746157435.716010 fallocate 0x21d836 thru 0x228834 (0xafff bytes) 072000 1746157442.675729 punch from 0x03daf5 to 0x041948 (0x3e54 bytes) 073000 1746157449.551931 trunc from 0x4e31b4 to 0x0dc66d (0x406b46 bytes) 074000 1746157455.799807 trunc from 0x0b2a24 to 0x0bba60 (0x903d bytes) 075000 1746157461.430928 write 0x108dd5 thru 0x10e354 (0x5580 bytes) 076000 1746157467.137037 write 0x506e3d thru 0x51020b (0x93cf bytes) 077000 1746157473.079609 mapwrite 0x381fee thru 0x385109 (0x311c bytes) 078000 1746157479.188510 trunc from 0x4ebf64 to 0x07b939 (0x47062a bytes) 079000 1746157485.147256 mapwrite 0x1ce82a thru 0x1da44a (0xbc21 bytes) 080000 1746157491.634430 write 0x129828 thru 0x129dd7 (0x5b0 bytes) 081000 1746157498.306109 punch from 0x209686 to 0x214d16 (0xb691 bytes) 083000 1746157513.019374 trunc from 0x10427c to 0x10a714 (0x6499 bytes) 084000 1746157520.158146 punch from 0x2158cd to 0x216649 (0xd7d bytes) 085000 1746157527.891543 mapread 0x009779 thru 0x00b5ea (0x1e72 bytes) 086000 1746157533.970863 punch from 0x132441 to 0x135865 (0x3425 bytes) skipping zero size write 088000 1746157546.535044 mapwrite 0x34d38d thru 0x35001b (0x2c8f bytes) 089000 1746157552.309441 trunc from 0x50ea4b to 0x4f4f45 (0x19b05 bytes) 090000 1746157559.640178 trunc from 0x00750a to 0x00d1b8 (0x5caf bytes) 091000 1746157566.268162 trunc from 0x2d1246 to 0x2d2383 (0x113e bytes) 092000 1746157573.453990 fallocate 0x051f86 thru 0x055688 (0x3703 bytes) 093000 1746157579.555620 mapread 0x037403 thru 0x046b15 (0xf713 bytes) 094000 1746157586.590839 write 0x23b887 thru 0x245dca (0xa544 bytes) 095000 1746157593.258128 write 0x089cae thru 0x0965c2 (0xc915 bytes) 096000 1746157598.913677 mapread 0x21c544 thru 0x22623d (0x9cfa bytes) 097000 1746157604.305118 mapwrite 0x1a808c thru 0x1b1a5b (0x99d0 bytes) 098000 1746157610.214420 mapwrite 0x385c9c thru 0x38e0f9 (0x845e bytes) 099000 1746157617.745849 trunc from 0x01c1f1 to 0x02732f (0xb13f bytes) 100000 1746157625.031705 punch from 0x1dec28 to 0x1e0a94 (0x1e6d bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (624s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 23:47:07 (1746157627) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 truncating to largest ever: 0x523dbd 001000 1746157637.818398 trunc from 0x038832 to 0x0445c5 (0xbd94 bytes) 002000 1746157646.025565 write 0x2dd6d5 thru 0x2e450a (0x6e36 bytes) fallocating to largest ever: 0x52677d fallocating to largest ever: 0x5283bd 003000 1746157653.170728 trunc from 0x4a9fc5 to 0x081ffd (0x427fc7 bytes) 004000 1746157660.910013 mapwrite 0x25ecaf thru 0x264d80 (0x60d2 bytes) 005000 1746157668.463667 mapwrite 0x207e47 thru 0x20df0d (0x60c7 bytes) 007000 1746157683.039358 punch from 0x45dbd5 to 0x46b4e1 (0xd90d bytes) 008000 1746157692.041295 punch from 0x069f2d to 0x0772ad (0xd381 bytes) 009000 1746157701.288865 trunc from 0x0c2a66 to 0x45c1d5 (0x399770 bytes) 010000 1746157708.538681 punch from 0x0b8ffd to 0x0c6914 (0xd918 bytes) 011000 1746157716.049697 fallocate 0x3809a0 thru 0x385e99 (0x54fa bytes) 012000 1746157723.406124 mapread 0x0be9cc thru 0x0ce3c1 (0xf9f6 bytes) 013000 1746157731.595362 punch from 0x22b156 to 0x22b385 (0x230 bytes) 015000 1746157747.730882 write 0x19659a thru 0x19f6a9 (0x9110 bytes) 016000 1746157755.685817 read 0x103a9e thru 0x10afcd (0x7530 bytes) 017000 1746157763.824996 fallocate 0x0ae8af thru 0x0bccbe (0xe410 bytes) 018000 1746157771.307370 mapwrite 0x065015 thru 0x0675bb (0x25a7 bytes) 019000 1746157778.743827 trunc from 0x24b317 to 0x24c40f (0x10f9 bytes) 020000 1746157785.980841 punch from 0x04ad45 to 0x053d2d (0x8fe9 bytes) 021000 1746157793.575333 trunc from 0x04a6fd to 0x04e1f2 (0x3af6 bytes) 022000 1746157801.410332 read 0x1339f3 thru 0x143970 (0xff7e bytes) 023000 1746157809.229589 mapwrite 0x03c0d2 thru 0x041f82 (0x5eb1 bytes) 024000 1746157815.361559 trunc from 0x08ff0c to 0x097f15 (0x800a bytes) 025000 1746157821.399052 write 0x3e7c4c thru 0x3f2372 (0xa727 bytes) 026000 1746157827.918939 write 0x2e9b1f thru 0x2ead04 (0x11e6 bytes) 027000 1746157833.758690 write 0x0f3701 thru 0x10087c (0xd17c bytes) 029000 1746157847.435721 punch from 0x166d6d to 0x16c134 (0x53c8 bytes) 030000 1746157854.743414 fallocate 0x175766 thru 0x176652 (0xeed bytes) 032000 1746157869.886787 fallocate 0x4e4b5c thru 0x4f3960 (0xee05 bytes) 033000 1746157876.746185 mapread 0x11504d thru 0x11f39a (0xa34e bytes) 034000 1746157883.662411 write 0x3bf8eb thru 0x3ccbc0 (0xd2d6 bytes) 037000 1746157905.660424 mapwrite 0x06b35d thru 0x07874a (0xd3ee bytes) 039000 1746157920.611604 trunc from 0x28ec5b to 0x29c5c4 (0xd96a bytes) 040000 1746157928.258399 trunc from 0x2450ae to 0x24840b (0x335e bytes) 041000 1746157935.387936 punch from 0x19575e to 0x19e8b6 (0x9159 bytes) 042000 1746157943.446406 mapread 0x107e06 thru 0x10a9f5 (0x2bf0 bytes) 044000 1746157959.078222 read 0x246fed thru 0x254267 (0xd27b bytes) 045000 1746157968.215915 mapwrite 0x3621ee thru 0x363f59 (0x1d6c bytes) 046000 1746157977.985925 mapread 0x14bcc1 thru 0x1522bd (0x65fd bytes) 047000 1746157987.447320 trunc from 0x2ad543 to 0x2b9b08 (0xc5c6 bytes) 048000 1746157996.982052 write 0x1c42d1 thru 0x1d1b7a (0xd8aa bytes) 049000 1746158004.123322 trunc from 0x141de7 to 0x14eef8 (0xd112 bytes) 050000 1746158010.430469 trunc from 0x171680 to 0x178c52 (0x75d3 bytes) 051000 1746158017.081473 fallocate 0x2ae942 thru 0x2b010e (0x17cd bytes) 054000 1746158035.286698 trunc from 0x414d02 to 0x4105c6 (0x473b bytes) 056000 1746158048.482909 trunc from 0x1132ec to 0x11c600 (0x9315 bytes) 059000 1746158068.999748 fallocate 0x3ec91c thru 0x3ef39e (0x2a83 bytes) 060000 1746158076.608472 mapread 0x0c20b8 thru 0x0c32ae (0x11f7 bytes) 061000 1746158084.336467 trunc from 0x17d3bc to 0x0219f0 (0x15b9cb bytes) 062000 1746158092.380279 fallocate 0x393ee4 thru 0x39e303 (0xa420 bytes) 063000 1746158100.799395 trunc from 0x5239c2 to 0x2e4f6d (0x23ea54 bytes) skipping zero size write 064000 1746158109.934375 trunc from 0x24d00d to 0x3509bb (0x1039af bytes) 066000 1746158123.624949 trunc from 0x0bd04b to 0x0c05c4 (0x357a bytes) 067000 1746158130.795986 mapwrite 0x0d8c04 thru 0x0e0bc2 (0x7fbf bytes) 068000 1746158137.338029 punch from 0x0926c2 to 0x09f03a (0xc979 bytes) 070000 1746158151.203625 read 0x1cf123 thru 0x1de566 (0xf444 bytes) 072000 1746158165.994184 mapread 0x3591d2 thru 0x35eefb (0x5d2a bytes) 073000 1746158174.163178 trunc from 0x525f5a to 0x34ab99 (0x1db3c0 bytes) 075000 1746158188.957476 trunc from 0x1c59bd to 0x0951b5 (0x130807 bytes) 076000 1746158196.880052 trunc from 0x483c67 to 0x3f4fd0 (0x8ec96 bytes) 078000 1746158212.506178 mapread 0x0978f2 thru 0x09857c (0xc8b bytes) 079000 1746158219.169422 fallocate 0x51091a thru 0x514a4a (0x4131 bytes) 080000 1746158225.110933 write 0x4b8a61 thru 0x4bc076 (0x3616 bytes) 082000 1746158239.569666 mapwrite 0x4bdd83 thru 0x4c621d (0x849b bytes) 083000 1746158247.624723 trunc from 0x268a28 to 0x26ad56 (0x232f bytes) skipping zero size read 085000 1746158264.272962 punch from 0x23bdb0 to 0x2455f4 (0x9845 bytes) 086000 1746158271.719038 trunc from 0x0353fa to 0x03aa4d (0x5654 bytes) 087000 1746158279.088854 fallocate 0x202f07 thru 0x207edb (0x4fd5 bytes) 089000 1746158294.216465 punch from 0x32fdd2 to 0x332a34 (0x2c63 bytes) 090000 1746158302.024992 punch from 0x04295e to 0x04b70a (0x8dad bytes) 091000 1746158309.645169 fallocate 0x40f577 thru 0x40fb93 (0x61d bytes) 093000 1746158323.356521 trunc from 0x4925b1 to 0x4737c8 (0x1ede8 bytes) 094000 1746158330.754403 trunc from 0x4f51be to 0x4d61e7 (0x1efd6 bytes) 095000 1746158338.553210 trunc from 0x318e05 to 0x13cf48 (0x1dbebc bytes) 096000 1746158345.459593 punch from 0x25ad37 to 0x26a724 (0xf9ee bytes) 097000 1746158353.286434 fallocate 0x0f43d6 thru 0x0f652e (0x2159 bytes) 098000 1746158361.019475 read 0x3bcea8 thru 0x3bd746 (0x89f bytes) 100000 1746158377.660217 trunc from 0x0b2f4f to 0x0b92e0 (0x6392 bytes) All operations completed A-OK! PASS fsx_partial_punch (752s) == sanity-benchmark test complete, duration 1852 sec ===== 23:59:39 (1746158379) === sanity-benchmark: start cleanup 23:59:40 (1746158380) === === sanity-benchmark: finish cleanup 23:59:41 (1746158381) ===