-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:51 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:56 (1734015836) === oleg304-client.virtnet: executing check_config_client /mnt/lustre oleg304-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg304-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6c9f800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6c9f800.idle_timeout=debug disable quota as required oleg304-server: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:11 (1734015851) === == sanity-benchmark test dbench: dbench ================== 10:04:12 (1734015852) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7708] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg304-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg304-client.virtnet at Thu Dec 12 10:04:14 EST 2024 waiting for dbench pid 10295 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 15 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 2 8 1.76 MB/sec warmup 1 sec latency 884.468 ms 20 79 35.03 MB/sec warmup 2 sec latency 175.147 ms 20 152 42.89 MB/sec warmup 3 sec latency 203.663 ms 20 212 41.40 MB/sec warmup 4 sec latency 159.171 ms 20 278 41.50 MB/sec warmup 5 sec latency 133.710 ms 20 337 40.61 MB/sec warmup 6 sec latency 115.823 ms 20 398 40.30 MB/sec warmup 7 sec latency 128.449 ms 20 469 40.98 MB/sec warmup 8 sec latency 130.836 ms 20 546 41.64 MB/sec warmup 9 sec latency 128.772 ms 20 653 42.14 MB/sec warmup 10 sec latency 410.098 ms 20 690 38.52 MB/sec warmup 11 sec latency 254.823 ms 20 729 35.48 MB/sec warmup 12 sec latency 241.489 ms 20 774 32.87 MB/sec warmup 13 sec latency 297.791 ms 20 812 30.69 MB/sec warmup 14 sec latency 253.434 ms 20 872 28.81 MB/sec warmup 15 sec latency 241.957 ms 20 915 27.14 MB/sec warmup 16 sec latency 329.927 ms 20 968 25.78 MB/sec warmup 17 sec latency 276.961 ms 20 1018 24.72 MB/sec warmup 18 sec latency 299.901 ms 20 1108 24.14 MB/sec warmup 19 sec latency 145.108 ms 20 1177 23.00 MB/sec warmup 20 sec latency 83.969 ms 20 1253 22.39 MB/sec warmup 21 sec latency 94.511 ms 20 1341 22.21 MB/sec warmup 22 sec latency 86.095 ms 20 1439 22.61 MB/sec warmup 23 sec latency 313.118 ms 20 1548 0.95 MB/sec execute 1 sec latency 432.695 ms 20 1623 1.18 MB/sec execute 2 sec latency 320.820 ms 20 1676 1.12 MB/sec execute 3 sec latency 380.212 ms 20 1738 1.05 MB/sec execute 4 sec latency 102.847 ms 20 1812 1.07 MB/sec execute 5 sec latency 91.990 ms 20 1872 1.08 MB/sec execute 6 sec latency 314.885 ms 20 1925 1.05 MB/sec execute 7 sec latency 225.294 ms 20 2001 1.12 MB/sec execute 8 sec latency 410.559 ms 20 2059 1.19 MB/sec execute 9 sec latency 91.519 ms 20 2129 1.26 MB/sec execute 10 sec latency 106.982 ms 20 2207 1.71 MB/sec execute 11 sec latency 78.648 ms 20 2247 1.81 MB/sec execute 12 sec latency 548.835 ms 20 2333 2.57 MB/sec execute 13 sec latency 378.093 ms 20 2382 2.73 MB/sec execute 14 sec latency 405.213 ms 20 2423 2.85 MB/sec execute 15 sec latency 402.600 ms 20 2481 3.00 MB/sec execute 16 sec latency 306.701 ms 20 2574 4.01 MB/sec execute 17 sec latency 355.952 ms 20 2691 4.68 MB/sec execute 18 sec latency 282.396 ms 20 2830 6.64 MB/sec execute 19 sec latency 406.552 ms 20 2877 6.82 MB/sec execute 20 sec latency 1013.841 ms 20 2980 7.12 MB/sec execute 21 sec latency 1060.519 ms 20 3108 7.17 MB/sec execute 22 sec latency 432.503 ms 20 3253 7.63 MB/sec execute 23 sec latency 304.723 ms 20 3337 7.79 MB/sec execute 24 sec latency 389.216 ms 20 3462 8.91 MB/sec execute 25 sec latency 223.652 ms 20 3586 9.56 MB/sec execute 26 sec latency 71.011 ms 20 3665 9.35 MB/sec execute 27 sec latency 79.104 ms 20 3736 9.45 MB/sec execute 28 sec latency 142.846 ms 20 3796 9.42 MB/sec execute 29 sec latency 114.727 ms 20 3847 9.15 MB/sec execute 30 sec latency 129.145 ms 20 3900 8.95 MB/sec execute 31 sec latency 95.973 ms 20 3956 8.75 MB/sec execute 32 sec latency 86.053 ms 20 3998 8.48 MB/sec execute 33 sec latency 119.425 ms 20 4038 8.24 MB/sec execute 34 sec latency 137.767 ms 20 4097 8.01 MB/sec execute 35 sec latency 117.939 ms 20 4175 7.83 MB/sec execute 36 sec latency 322.802 ms 20 4230 7.66 MB/sec execute 37 sec latency 416.068 ms 20 4267 7.50 MB/sec execute 38 sec latency 270.309 ms 20 4296 7.35 MB/sec execute 39 sec latency 276.763 ms 20 4332 7.21 MB/sec execute 40 sec latency 255.640 ms 20 4370 7.08 MB/sec execute 41 sec latency 227.853 ms 20 4426 6.98 MB/sec execute 42 sec latency 223.197 ms 20 4471 6.87 MB/sec execute 43 sec latency 326.705 ms 20 4515 6.75 MB/sec execute 44 sec latency 383.799 ms 20 4570 6.77 MB/sec execute 45 sec latency 281.090 ms 20 4652 6.91 MB/sec execute 46 sec latency 375.015 ms 20 4732 6.84 MB/sec execute 47 sec latency 88.741 ms 20 4805 6.78 MB/sec execute 48 sec latency 83.650 ms 20 4910 7.31 MB/sec execute 49 sec latency 150.650 ms 20 5001 7.63 MB/sec execute 50 sec latency 347.495 ms 20 5046 7.49 MB/sec execute 51 sec latency 347.699 ms 20 5115 7.36 MB/sec execute 52 sec latency 373.948 ms 20 5170 7.25 MB/sec execute 53 sec latency 193.036 ms 20 5222 7.13 MB/sec execute 54 sec latency 351.650 ms 20 5275 7.01 MB/sec execute 55 sec latency 198.329 ms 20 5336 6.91 MB/sec execute 56 sec latency 77.237 ms 20 5390 6.80 MB/sec execute 57 sec latency 91.023 ms 20 5453 6.70 MB/sec execute 58 sec latency 238.385 ms 20 5533 6.62 MB/sec execute 59 sec latency 235.597 ms 20 5600 6.54 MB/sec execute 60 sec latency 92.436 ms 20 5686 6.47 MB/sec execute 61 sec latency 98.719 ms 20 5751 6.40 MB/sec execute 62 sec latency 87.977 ms 20 5846 6.50 MB/sec execute 63 sec latency 262.162 ms 20 5926 6.55 MB/sec execute 64 sec latency 286.065 ms 20 5964 6.48 MB/sec execute 65 sec latency 327.437 ms 20 6008 6.46 MB/sec execute 66 sec latency 400.329 ms 20 6085 6.52 MB/sec execute 67 sec latency 354.870 ms 20 6197 6.74 MB/sec execute 68 sec latency 250.096 ms 20 6326 7.16 MB/sec execute 69 sec latency 326.987 ms 20 6469 7.47 MB/sec execute 70 sec latency 385.692 ms 20 6533 7.48 MB/sec execute 71 sec latency 367.009 ms 20 6681 7.51 MB/sec execute 72 sec latency 314.303 ms 20 6820 7.68 MB/sec execute 73 sec latency 268.045 ms 20 6919 7.78 MB/sec execute 74 sec latency 199.973 ms 20 7037 8.14 MB/sec execute 75 sec latency 303.473 ms 20 7141 8.30 MB/sec execute 76 sec latency 80.204 ms 20 7219 8.26 MB/sec execute 77 sec latency 78.574 ms 20 7271 8.24 MB/sec execute 78 sec latency 158.420 ms 20 7326 8.24 MB/sec execute 79 sec latency 119.097 ms 20 7375 8.20 MB/sec execute 80 sec latency 120.955 ms 20 7435 8.14 MB/sec execute 81 sec latency 76.992 ms 20 7489 8.07 MB/sec execute 82 sec latency 95.717 ms 20 7533 7.98 MB/sec execute 83 sec latency 117.928 ms 20 7572 7.88 MB/sec execute 84 sec latency 119.688 ms 20 7625 7.79 MB/sec execute 85 sec latency 109.217 ms 20 7691 7.71 MB/sec execute 86 sec latency 124.144 ms 20 7742 7.64 MB/sec execute 87 sec latency 540.700 ms 20 7785 7.57 MB/sec execute 88 sec latency 432.140 ms 20 7818 7.50 MB/sec execute 89 sec latency 283.877 ms 20 7857 7.44 MB/sec execute 90 sec latency 278.055 ms 20 7900 7.38 MB/sec execute 91 sec latency 286.405 ms 20 7942 7.32 MB/sec execute 92 sec latency 246.162 ms 20 7998 7.27 MB/sec execute 93 sec latency 279.422 ms 20 8046 7.22 MB/sec execute 94 sec latency 316.799 ms 20 8107 7.22 MB/sec execute 95 sec latency 224.885 ms 20 8193 7.30 MB/sec execute 96 sec latency 269.993 ms 20 8271 7.25 MB/sec execute 97 sec latency 92.204 ms 20 8334 7.20 MB/sec execute 98 sec latency 109.007 ms 20 8434 7.37 MB/sec execute 99 sec latency 88.417 ms 20 8535 7.63 MB/sec execute 100 sec latency 294.312 ms 20 8589 7.56 MB/sec execute 101 sec latency 377.750 ms 20 8654 7.50 MB/sec execute 102 sec latency 229.293 ms 20 8713 7.44 MB/sec execute 103 sec latency 216.759 ms 20 8784 7.38 MB/sec execute 104 sec latency 186.499 ms 20 8854 7.32 MB/sec execute 105 sec latency 166.128 ms 20 8923 7.26 MB/sec execute 106 sec latency 118.310 ms 20 9011 7.21 MB/sec execute 107 sec latency 181.379 ms 20 9109 7.16 MB/sec execute 108 sec latency 167.540 ms 20 9206 7.12 MB/sec execute 109 sec latency 64.536 ms 20 9302 7.08 MB/sec execute 110 sec latency 77.161 ms 20 9407 7.14 MB/sec execute 111 sec latency 319.135 ms 20 9491 7.17 MB/sec execute 112 sec latency 256.065 ms 20 9561 7.18 MB/sec execute 113 sec latency 246.584 ms 20 9660 7.21 MB/sec execute 114 sec latency 192.744 ms 20 9853 7.54 MB/sec execute 115 sec latency 210.249 ms 20 10048 7.85 MB/sec execute 116 sec latency 212.049 ms 20 10211 7.88 MB/sec execute 117 sec latency 215.692 ms 20 10435 8.08 MB/sec execute 118 sec latency 223.720 ms 20 10597 8.35 MB/sec execute 119 sec latency 142.990 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 30885 38.569 172.027 Close 23184 9.614 75.584 Rename 1307 56.999 154.105 Unlink 5730 12.883 63.086 Qpathinfo 29031 9.522 124.348 Qfileinfo 5306 0.165 19.388 Qfsinfo 5202 0.167 27.621 Sfileinfo 2320 37.976 191.532 Find 11374 2.278 130.235 WriteX 15739 4.101 104.061 ReadX 52386 0.027 9.483 LockX 120 9.373 25.675 UnlockX 120 9.593 18.457 Flush 2093 180.446 1060.511 Throughput 8.35472 MB/sec 20 clients 20 procs max_latency=1060.519 ms stopping dbench on /mnt/lustre/d0.oleg304-client.virtnet at Thu Dec 12 10:06:40 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg304-client.virtnet /mnt/lustre/d0.oleg304-client.virtnet /mnt/lustre/d0.oleg304-client.virtnet removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg304-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:47 (1734016007) min OST has 3286016kB available, using 4929024kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7708] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4813] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg304-clien 4813M 61963 48 48683 40 237266 46 1858 178 Latency 699ms 619ms 108ms 372ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg304-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 267 17 5352 24 427 12 320 17 808 11 229 10 Latency 19900us 27844us 65887us 40553us 8576us 40771us 1.97,1.97,oleg304-client.virtnet,1,1734004834,4813M,,,,61963,48,48683,40,,,237266,46,1858,178,10,,,,,267,17,5352,24,427,12,320,17,808,11,229,10,,699ms,619ms,,108ms,372ms,19900us,27844us,65887us,40553us,8576us,40771us debug=0x33f0484 PASS bonnie (369s) == sanity-benchmark test iozone: iozone ================== 10:12:56 (1734016376) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7708] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:18 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 164159 182589 178086 240774 61028 168075 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:18:03 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 24094 25850 113160 102888 81356 35632 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1113s) == sanity-benchmark test fsx: fsx ======================== 10:31:29 (1734017489) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 3606 -P /tmp -l 5642496 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 3606 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x491711 truncating to largest ever: 0x501c6f truncating to largest ever: 0x54de41 truncating to largest ever: 0x55b14d truncating to largest ever: 0x55b6d0 truncating to largest ever: 0x55d312 007000 1734017508.131825 write 0x183747 thru 0x183a69 (0x323 bytes) truncating to largest ever: 0x55f531 009000 1734017513.725981 trunc from 0x484555 to 0x02ee11 (0x455743 bytes) 010000 1734017516.948619 read 0x4d3b43 thru 0x4e29af (0xee6d bytes) truncating to largest ever: 0x560c01 016000 1734017536.283597 mapwrite 0x3167f6 thru 0x3193a4 (0x2baf bytes) 020000 1734017548.557895 trunc from 0x4a05a2 to 0x1cebd3 (0x2d19ce bytes) 021000 1734017551.968699 trunc from 0x52f067 to 0x507788 (0x278de bytes) 024000 1734017560.942108 write 0x2c5482 thru 0x2cf0a0 (0x9c1f bytes) 025000 1734017563.935239 mapwrite 0x3d83f9 thru 0x3e7c39 (0xf841 bytes) 028000 1734017572.311995 mapread 0x2c0ad3 thru 0x2c5103 (0x4631 bytes) 029000 1734017575.225649 write 0x2339b8 thru 0x23ecec (0xb335 bytes) 031000 1734017580.904960 trunc from 0x46b342 to 0x259fc7 (0x21137a bytes) 032000 1734017583.743613 mapwrite 0x271c76 thru 0x272317 (0x6a2 bytes) truncating to largest ever: 0x56101c 033000 1734017586.609929 mapread 0x1998a5 thru 0x1a589b (0xbff7 bytes) 036000 1734017595.194256 write 0x036ddc thru 0x03935b (0x2580 bytes) 037000 1734017598.038003 trunc from 0x44fd64 to 0x52c9f6 (0xdcc93 bytes) 038000 1734017601.000821 write 0x06f4b9 thru 0x071f11 (0x2a59 bytes) 040000 1734017607.108500 trunc from 0x371130 to 0x316286 (0x5aea9 bytes) 043000 1734017616.141856 trunc from 0x4692cb to 0x38a929 (0xde9a1 bytes) 044000 1734017618.664810 read 0x27f70f thru 0x282d61 (0x3653 bytes) 045000 1734017620.917963 mapread 0x2d6f4b thru 0x2ddcfa (0x6db0 bytes) truncating to largest ever: 0x561188 047000 1734017626.164245 mapwrite 0x000e2f thru 0x00b1eb (0xa3bd bytes) 048000 1734017628.708287 read 0x2e5323 thru 0x2eee0c (0x9aea bytes) 049000 1734017631.520569 mapread 0x13b809 thru 0x13be96 (0x68e bytes) 050000 1734017633.865398 mapread 0x130699 thru 0x1384d7 (0x7e3f bytes) 052000 1734017639.430195 write 0x4a466b thru 0x4ab6a3 (0x7039 bytes) 053000 1734017642.100506 mapwrite 0x3afb11 thru 0x3b0b28 (0x1018 bytes) 054000 1734017644.386092 read 0x1790e1 thru 0x18727e (0xe19e bytes) 056000 1734017649.471806 trunc from 0x414390 to 0x081624 (0x392d6b bytes) 057000 1734017651.862232 write 0x4a68b8 thru 0x4a69da (0x123 bytes) 059000 1734017656.800885 mapread 0x453cd8 thru 0x458f6f (0x5298 bytes) truncating to largest ever: 0x5611d4 060000 1734017659.761742 mapread 0x152d19 thru 0x1540c6 (0x13ae bytes) 061000 1734017663.055943 mapwrite 0x2f8c23 thru 0x302097 (0x9475 bytes) 062000 1734017665.699624 read 0x1086c0 thru 0x11389a (0xb1db bytes) 063000 1734017668.220172 write 0x44f22d thru 0x457f27 (0x8cfb bytes) 065000 1734017673.154538 mapwrite 0x3d980a thru 0x3e5865 (0xc05c bytes) 066000 1734017675.709948 mapread 0x01593d thru 0x025367 (0xfa2b bytes) 070000 1734017685.873367 trunc from 0x554527 to 0x293701 (0x2c0e25 bytes) 071000 1734017688.934662 trunc from 0x2f2c17 to 0x24c56b (0xa66ab bytes) 072000 1734017691.253919 read 0x0c5fb5 thru 0x0cd8a0 (0x78ec bytes) 074000 1734017696.280290 read 0x0b8170 thru 0x0c2be7 (0xaa78 bytes) 075000 1734017698.829944 read 0x1c3996 thru 0x1cff0d (0xc578 bytes) 080000 1734017711.070950 read 0x01b5cc thru 0x01ecd6 (0x370b bytes) 086000 1734017726.750211 read 0x35fd25 thru 0x36ebdd (0xeeb9 bytes) 089000 1734017733.801005 trunc from 0x4ebb37 to 0x222ff3 (0x2c8b43 bytes) 090000 1734017736.198463 read 0x15f9c8 thru 0x16762c (0x7c65 bytes) 091000 1734017738.743038 read 0x07ce20 thru 0x085356 (0x8537 bytes) 094000 1734017746.533212 mapread 0x06ed3e thru 0x0753d7 (0x669a bytes) 095000 1734017749.195316 mapread 0x0d4d08 thru 0x0d77fe (0x2af7 bytes) 098000 1734017757.274641 mapwrite 0x0fdab1 thru 0x102923 (0x4e73 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4833987 (4736 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (274s) == sanity-benchmark test complete, duration 1932 sec ===== 10:36:03 (1734017763) === sanity-benchmark: start cleanup 10:36:03 (1734017763) === === sanity-benchmark: finish cleanup 10:36:04 (1734017764) ===