-----============= acceptance-small: sanity-benchmark ============----- Thu May 1 16:26:27 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg113-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanity-benchmark.*ex: No such file or directory excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 16:26:38 (1746131198) === oleg113-client.virtnet: executing check_config_client /mnt/lustre oleg113-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg113-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012b4db000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012b4db000.idle_timeout=debug disable quota as required oleg113-server: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 16:26:58 (1746131218) === == sanity-benchmark test dbench: dbench ================== 16:26:59 (1746131219) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7685] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg113-client.virtnet] [20] [-t] [120] bash: rundbench: Permission denied debug=0x33f0484 PASS dbench (4s) == sanity-benchmark test bonnie: bonnie++ ================ 16:27:03 (1746131223) min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7685] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [bonnie++] [-f] [-r] [0] [-s5281] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg113-clien 5281M 69572 63 61035 55 148864 32 1037 173 Latency 38530us 122ms 131ms 33169us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg113-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 115 15 4161 23 150 10 102 14 225 11 133 10 Latency 83197us 28261us 53528us 110ms 23581us 76573us 1.97,1.97,oleg113-client.virtnet,1,1746138463,5281M,,,,69572,63,61035,55,,,148864,32,1037,173,10,,,,,115,15,4161,23,150,10,102,14,225,11,133,10,,38530us,122ms,,131ms,33169us,83197us,28261us,53528us,110ms,23581us,76573us debug=0x33f0484 PASS bonnie (603s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 16:37:07 (1746131827) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 3828 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 3828 skipping zero length zero range skipping zero size read skipping zero size read skipping zero size read fallocating to largest ever: 0x3b8ec fallocating to largest ever: 0x1b708e zero_range to largest ever: 0x1ea0e2 fallocating to largest ever: 0x1f50cd fallocating to largest ever: 0x504c9b fallocating to largest ever: 0x5077b6 fallocating to largest ever: 0x527af2 001000 1746131838.192888 fallocate 0x4c5fad thru 0x4c97ef (0x3843 bytes) fallocating to largest ever: 0x5285e2 003000 1746131856.349705 trunc from 0x161fa5 to 0x16a92f (0x898b bytes) 005000 1746131871.805978 trunc from 0x174746 to 0x17c47c (0x7d37 bytes) 006000 1746131878.683895 mapwrite 0x001a4e thru 0x00984e (0x7e01 bytes) 008000 1746131894.818003 mapwrite 0x0c70b2 thru 0x0cdf1f (0x6e6e bytes) 009000 1746131902.757548 fallocate 0x11757b thru 0x122e5b (0xb8e1 bytes) 010000 1746131910.591027 write 0x2fff9a thru 0x3045f2 (0x4659 bytes) 011000 1746131917.403013 trunc from 0x152cb3 to 0x162b87 (0xfed5 bytes) 012000 1746131924.869956 read 0x25c6f3 thru 0x25da40 (0x134e bytes) 013000 1746131932.897265 punch from 0x4bddaf to 0x4bfa13 (0x1c65 bytes) 015000 1746131950.374143 write 0x408ec8 thru 0x40ccda (0x3e13 bytes) 016000 1746131957.423869 trunc from 0x0ad076 to 0x0af7e3 (0x276e bytes) 017000 1746131964.390992 fallocate 0x37c002 thru 0x37c87f (0x87e bytes) 018000 1746131972.801813 write 0x24d491 thru 0x253fb3 (0x6b23 bytes) 019000 1746131981.681538 fallocate 0x16be8b thru 0x16eac3 (0x2c39 bytes) 020000 1746131989.306822 read 0x0b7efb thru 0x0c4ead (0xcfb3 bytes) 021000 1746131996.637223 fallocate 0x485581 thru 0x48fb8d (0xa60d bytes) 022000 1746132001.926362 punch from 0x4b4de3 to 0x4b7a2d (0x2c4b bytes) 023000 1746132007.786587 read 0x07ddde thru 0x0863cc (0x85ef bytes) 024000 1746132013.804077 read 0x2163c7 thru 0x21b3db (0x5015 bytes) 025000 1746132019.332971 punch from 0x1b140f to 0x1b4cf8 (0x38ea bytes) 026000 1746132026.282459 mapread 0x0fdea1 thru 0x10cd0d (0xee6d bytes) 027000 1746132032.875904 punch from 0x014610 to 0x01942f (0x4e20 bytes) 028000 1746132040.375608 mapwrite 0x200aa7 thru 0x20eaf2 (0xe04c bytes) 029000 1746132047.469542 mapwrite 0x49be68 thru 0x4a975c (0xd8f5 bytes) 030000 1746132055.620083 mapread 0x084048 thru 0x092ae4 (0xea9d bytes) 031000 1746132063.545925 trunc from 0x46d9f1 to 0x3deaf7 (0x8eef9 bytes) 034000 1746132088.013638 mapread 0x3b21f1 thru 0x3bfeba (0xdcca bytes) 035000 1746132095.527480 trunc from 0x4bfeac to 0x00c59c (0x4b390f bytes) 037000 1746132108.405441 punch from 0x4fcc76 to 0x50ab83 (0xdf0e bytes) 038000 1746132116.582634 mapread 0x0f814d thru 0x0fecf9 (0x6bad bytes) 039000 1746132124.170758 trunc from 0x47656c to 0x2c689b (0x1afcd0 bytes) 040000 1746132131.183622 fallocate 0x50fcfd thru 0x51a490 (0xa794 bytes) 041000 1746132139.232545 read 0x2cf2e8 thru 0x2de3fb (0xf114 bytes) 042000 1746132147.117415 punch from 0x366408 to 0x371944 (0xb53d bytes) 043000 1746132155.579142 punch from 0x17ff16 to 0x18be2f (0xbf1a bytes) 044000 1746132163.811241 fallocate 0x0929fc thru 0x093df7 (0x13fc bytes) 048000 1746132197.702146 fallocate 0x3134e3 thru 0x31c574 (0x9092 bytes) 049000 1746132205.996550 write 0x03e203 thru 0x03ebad (0x9ab bytes) 050000 1746132214.074556 write 0x28eb21 thru 0x299b42 (0xb022 bytes) 052000 1746132230.073295 trunc from 0x1891a4 to 0x18d29d (0x40fa bytes) 053000 1746132237.724663 trunc from 0x22d263 to 0x2364be (0x925c bytes) 054000 1746132244.014066 mapwrite 0x38e2f7 thru 0x3968d8 (0x85e2 bytes) 056000 1746132256.754714 trunc from 0x5170a5 to 0x0ffe26 (0x41727e bytes) 057000 1746132264.271345 fallocate 0x043c5b thru 0x0458c6 (0x1c6c bytes) 059000 1746132277.997353 trunc from 0x4107d0 to 0x426b53 (0x16384 bytes) 060000 1746132285.108233 punch from 0x434bbd to 0x438751 (0x3b95 bytes) 061000 1746132293.325033 punch from 0x0c2683 to 0x0c68cd (0x424b bytes) 062000 1746132301.150360 mapread 0x24749c thru 0x252e5d (0xb9c2 bytes) 064000 1746132316.147987 mapread 0x1a4bab thru 0x1a7ed2 (0x3328 bytes) 065000 1746132324.591811 mapwrite 0x19beb9 thru 0x1aacb7 (0xedff bytes) skipping zero size read 066000 1746132332.678066 trunc from 0x0131d1 to 0x023149 (0xff79 bytes) 067000 1746132339.820895 mapread 0x02321d thru 0x02a386 (0x716a bytes) 068000 1746132347.821665 mapwrite 0x416fae thru 0x423d54 (0xcda7 bytes) 069000 1746132355.829572 mapwrite 0x094cbe thru 0x09abb3 (0x5ef6 bytes) 070000 1746132364.878009 fallocate 0x42666f thru 0x43129e (0xac30 bytes) 071000 1746132374.332463 mapread 0x2bd76c thru 0x2c9f20 (0xc7b5 bytes) 072000 1746132382.154050 trunc from 0x30b72e to 0x30c06b (0x93e bytes) 074000 1746132398.229581 punch from 0x167fd7 to 0x1712fc (0x9326 bytes) 075000 1746132406.629963 trunc from 0x2c7192 to 0x0a8c0e (0x21e583 bytes) 076000 1746132414.717044 fallocate 0x1a9d74 thru 0x1b1378 (0x7605 bytes) 077000 1746132422.065017 punch from 0x31905e to 0x328f06 (0xfea9 bytes) 080000 1746132446.809856 mapread 0x285321 thru 0x294cc3 (0xf9a3 bytes) 081000 1746132456.463252 read 0x1dc299 thru 0x1ddc20 (0x1988 bytes) 082000 1746132464.796625 trunc from 0x12aa54 to 0x12cb00 (0x20ad bytes) 083000 1746132472.034167 write 0x313329 thru 0x31f5ad (0xc285 bytes) 084000 1746132480.025205 trunc from 0x02641d to 0x02ef69 (0x8b4d bytes) 085000 1746132488.184376 mapread 0x05ce96 thru 0x063b6e (0x6cd9 bytes) 086000 1746132496.719287 trunc from 0x1893a2 to 0x194c74 (0xb8d3 bytes) 087000 1746132505.308329 mapread 0x0ccc4b thru 0x0d9234 (0xc5ea bytes) 088000 1746132512.339155 trunc from 0x471af3 to 0x1e09da (0x291118 bytes) 089000 1746132519.390883 punch from 0x1fd18c to 0x20c153 (0xefc8 bytes) 091000 1746132535.126001 read 0x0986e7 thru 0x09d88b (0x51a5 bytes) 092000 1746132542.381825 mapwrite 0x09dd2f thru 0x0a9ad6 (0xbda8 bytes) 093000 1746132550.239939 trunc from 0x4e6961 to 0x0da9b0 (0x40bfb0 bytes) 095000 1746132566.410493 mapwrite 0x0f8145 thru 0x0fe474 (0x6330 bytes) 096000 1746132573.019895 mapwrite 0x1bad9a thru 0x1c0278 (0x54df bytes) 097000 1746132579.448143 mapwrite 0x1c695b thru 0x1cfab5 (0x915b bytes) 098000 1746132587.219621 trunc from 0x21cc0d to 0x226771 (0x9b65 bytes) 100000 1746132602.942772 punch from 0x43d2e7 to 0x44a43f (0xd159 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (778s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 16:50:06 (1746132606) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 truncating to largest ever: 0x523dbd 001000 1746132618.114190 trunc from 0x038832 to 0x0445c5 (0xbd94 bytes) 002000 1746132627.846006 write 0x2dd6d5 thru 0x2e450a (0x6e36 bytes) fallocating to largest ever: 0x52677d fallocating to largest ever: 0x5283bd 003000 1746132636.545980 trunc from 0x4a9fc5 to 0x081ffd (0x427fc7 bytes) 004000 1746132645.223995 mapwrite 0x25ecaf thru 0x264d80 (0x60d2 bytes) 005000 1746132653.723041 mapwrite 0x207e47 thru 0x20df0d (0x60c7 bytes) 007000 1746132671.319131 punch from 0x45dbd5 to 0x46b4e1 (0xd90d bytes) 008000 1746132680.683761 punch from 0x069f2d to 0x0772ad (0xd381 bytes) 009000 1746132691.724649 trunc from 0x0c2a66 to 0x45c1d5 (0x399770 bytes) 010000 1746132701.548168 punch from 0x0b8ffd to 0x0c6914 (0xd918 bytes) 011000 1746132711.020730 fallocate 0x3809a0 thru 0x385e99 (0x54fa bytes) 012000 1746132721.316781 mapread 0x0be9cc thru 0x0ce3c1 (0xf9f6 bytes) 013000 1746132729.826295 punch from 0x22b156 to 0x22b385 (0x230 bytes) 015000 1746132749.514132 write 0x19659a thru 0x19f6a9 (0x9110 bytes) 016000 1746132759.353957 read 0x103a9e thru 0x10afcd (0x7530 bytes) 017000 1746132769.674148 fallocate 0x0ae8af thru 0x0bccbe (0xe410 bytes) 018000 1746132779.789100 mapwrite 0x065015 thru 0x0675bb (0x25a7 bytes) 019000 1746132790.447898 trunc from 0x24b317 to 0x24c40f (0x10f9 bytes) 020000 1746132799.971730 punch from 0x04ad45 to 0x053d2d (0x8fe9 bytes) 021000 1746132809.364939 trunc from 0x04a6fd to 0x04e1f2 (0x3af6 bytes) 022000 1746132819.597276 read 0x1339f3 thru 0x143970 (0xff7e bytes) 023000 1746132830.233284 mapwrite 0x03c0d2 thru 0x041f82 (0x5eb1 bytes) 024000 1746132840.336367 trunc from 0x08ff0c to 0x097f15 (0x800a bytes) 025000 1746132849.951983 write 0x3e7c4c thru 0x3f2372 (0xa727 bytes) 026000 1746132859.497542 write 0x2e9b1f thru 0x2ead04 (0x11e6 bytes) 027000 1746132870.298977 write 0x0f3701 thru 0x10087c (0xd17c bytes) 029000 1746132889.489443 punch from 0x166d6d to 0x16c134 (0x53c8 bytes) 030000 1746132898.835570 fallocate 0x175766 thru 0x176652 (0xeed bytes) 032000 1746132918.883668 fallocate 0x4e4b5c thru 0x4f3960 (0xee05 bytes) 033000 1746132929.641685 mapread 0x11504d thru 0x11f39a (0xa34e bytes) 034000 1746132938.823093 write 0x3bf8eb thru 0x3ccbc0 (0xd2d6 bytes) 037000 1746132965.371218 mapwrite 0x06b35d thru 0x07874a (0xd3ee bytes) 039000 1746132982.443348 trunc from 0x28ec5b to 0x29c5c4 (0xd96a bytes) 040000 1746132991.284155 trunc from 0x2450ae to 0x24840b (0x335e bytes) 041000 1746133000.994481 punch from 0x19575e to 0x19e8b6 (0x9159 bytes) 042000 1746133009.249504 mapread 0x107e06 thru 0x10a9f5 (0x2bf0 bytes) 044000 1746133026.180603 read 0x246fed thru 0x254267 (0xd27b bytes) 045000 1746133034.988098 mapwrite 0x3621ee thru 0x363f59 (0x1d6c bytes) 046000 1746133044.800440 mapread 0x14bcc1 thru 0x1522bd (0x65fd bytes) 047000 1746133054.144848 trunc from 0x2ad543 to 0x2b9b08 (0xc5c6 bytes) 048000 1746133062.903971 write 0x1c42d1 thru 0x1d1b7a (0xd8aa bytes) 049000 1746133070.096843 trunc from 0x141de7 to 0x14eef8 (0xd112 bytes) 050000 1746133077.865848 trunc from 0x171680 to 0x178c52 (0x75d3 bytes) 051000 1746133086.621406 fallocate 0x2ae942 thru 0x2b010e (0x17cd bytes) 054000 1746133114.438879 trunc from 0x414d02 to 0x4105c6 (0x473b bytes) 056000 1746133132.764670 trunc from 0x1132ec to 0x11c600 (0x9315 bytes) 059000 1746133162.023972 fallocate 0x3ec91c thru 0x3ef39e (0x2a83 bytes) 060000 1746133170.501109 mapread 0x0c20b8 thru 0x0c32ae (0x11f7 bytes) 061000 1746133180.782816 trunc from 0x17d3bc to 0x0219f0 (0x15b9cb bytes) 062000 1746133189.736949 fallocate 0x393ee4 thru 0x39e303 (0xa420 bytes) 063000 1746133198.323606 trunc from 0x5239c2 to 0x2e4f6d (0x23ea54 bytes) skipping zero size write 064000 1746133207.676901 trunc from 0x24d00d to 0x3509bb (0x1039af bytes) 066000 1746133227.032866 trunc from 0x0bd04b to 0x0c05c4 (0x357a bytes) 067000 1746133236.102306 mapwrite 0x0d8c04 thru 0x0e0bc2 (0x7fbf bytes) 068000 1746133247.285254 punch from 0x0926c2 to 0x09f03a (0xc979 bytes) 070000 1746133266.732055 read 0x1cf123 thru 0x1de566 (0xf444 bytes) 072000 1746133287.126790 mapread 0x3591d2 thru 0x35eefb (0x5d2a bytes) 073000 1746133297.711873 trunc from 0x525f5a to 0x34ab99 (0x1db3c0 bytes) 075000 1746133317.069931 trunc from 0x1c59bd to 0x0951b5 (0x130807 bytes) 076000 1746133326.457728 trunc from 0x483c67 to 0x3f4fd0 (0x8ec96 bytes) 078000 1746133347.062249 mapread 0x0978f2 thru 0x09857c (0xc8b bytes) 079000 1746133358.221845 fallocate 0x51091a thru 0x514a4a (0x4131 bytes) 080000 1746133367.605858 write 0x4b8a61 thru 0x4bc076 (0x3616 bytes) 082000 1746133389.051024 mapwrite 0x4bdd83 thru 0x4c621d (0x849b bytes) 083000 1746133397.852944 trunc from 0x268a28 to 0x26ad56 (0x232f bytes) skipping zero size read 085000 1746133417.879190 punch from 0x23bdb0 to 0x2455f4 (0x9845 bytes) 086000 1746133429.389295 trunc from 0x0353fa to 0x03aa4d (0x5654 bytes) 087000 1746133439.199809 fallocate 0x202f07 thru 0x207edb (0x4fd5 bytes) 089000 1746133457.610839 punch from 0x32fdd2 to 0x332a34 (0x2c63 bytes) 090000 1746133466.534431 punch from 0x04295e to 0x04b70a (0x8dad bytes) 091000 1746133476.469805 fallocate 0x40f577 thru 0x40fb93 (0x61d bytes) 093000 1746133495.209864 trunc from 0x4925b1 to 0x4737c8 (0x1ede8 bytes) 094000 1746133505.225303 trunc from 0x4f51be to 0x4d61e7 (0x1efd6 bytes) 095000 1746133515.451887 trunc from 0x318e05 to 0x13cf48 (0x1dbebc bytes) 096000 1746133525.451296 punch from 0x25ad37 to 0x26a724 (0xf9ee bytes) 097000 1746133535.114325 fallocate 0x0f43d6 thru 0x0f652e (0x2159 bytes) 098000 1746133544.244336 read 0x3bcea8 thru 0x3bd746 (0x89f bytes) 100000 1746133565.106908 trunc from 0x0b2f4f to 0x0b92e0 (0x6392 bytes) All operations completed A-OK! PASS fsx_partial_punch (962s) == sanity-benchmark test complete, duration 2380 sec ===== 17:06:08 (1746133568) === sanity-benchmark: start cleanup 17:06:09 (1746133569) === === sanity-benchmark: finish cleanup 17:06:11 (1746133571) ===