-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:56 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:01 (1734015841) === oleg452-client.virtnet: executing check_config_client /mnt/lustre oleg452-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg452-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff880136ad8000.idle_timeout=debug osc.lustre-OST0001-osc-ffff880136ad8000.idle_timeout=debug disable quota as required oleg452-server: oleg452-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:16 (1734015856) === == sanity-benchmark test dbench: dbench ================== 10:04:17 (1734015857) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7714] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg452-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg452-client.virtnet at Thu Dec 12 10:04:19 EST 2024 waiting for dbench pid 10301 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 0 5 0.00 MB/sec warmup 1 sec latency 939.183 ms 8 46 18.96 MB/sec warmup 2 sec latency 1866.288 ms 20 97 27.63 MB/sec warmup 3 sec latency 204.979 ms 20 144 30.96 MB/sec warmup 4 sec latency 293.347 ms 20 192 30.75 MB/sec warmup 5 sec latency 212.635 ms 20 241 30.70 MB/sec warmup 6 sec latency 167.207 ms 20 287 30.35 MB/sec warmup 7 sec latency 161.622 ms 20 330 29.86 MB/sec warmup 8 sec latency 173.918 ms 20 371 29.42 MB/sec warmup 9 sec latency 264.729 ms 20 416 29.39 MB/sec warmup 10 sec latency 171.492 ms 20 471 29.98 MB/sec warmup 11 sec latency 140.929 ms 20 535 30.46 MB/sec warmup 12 sec latency 172.212 ms 20 585 30.13 MB/sec warmup 13 sec latency 676.728 ms 20 638 29.90 MB/sec warmup 14 sec latency 520.798 ms 20 676 28.17 MB/sec warmup 15 sec latency 568.794 ms 20 703 26.49 MB/sec warmup 16 sec latency 331.323 ms 20 731 25.02 MB/sec warmup 17 sec latency 420.743 ms 20 753 23.69 MB/sec warmup 18 sec latency 351.942 ms 20 787 22.51 MB/sec warmup 19 sec latency 359.675 ms 20 820 21.49 MB/sec warmup 20 sec latency 395.830 ms 20 857 20.53 MB/sec warmup 21 sec latency 349.545 ms 20 900 19.71 MB/sec warmup 22 sec latency 322.605 ms 20 932 18.90 MB/sec warmup 23 sec latency 358.561 ms 20 1019 6.82 MB/sec execute 1 sec latency 485.478 ms 20 1065 5.67 MB/sec execute 2 sec latency 395.768 ms 20 1122 6.52 MB/sec execute 3 sec latency 246.943 ms 20 1175 5.19 MB/sec execute 4 sec latency 138.175 ms 20 1225 5.42 MB/sec execute 5 sec latency 130.567 ms 20 1294 7.51 MB/sec execute 6 sec latency 113.878 ms 20 1339 7.32 MB/sec execute 7 sec latency 299.540 ms 20 1415 8.78 MB/sec execute 8 sec latency 314.133 ms 20 1469 9.01 MB/sec execute 9 sec latency 462.481 ms 20 1506 8.16 MB/sec execute 10 sec latency 499.074 ms 20 1550 7.48 MB/sec execute 11 sec latency 373.101 ms 20 1589 6.91 MB/sec execute 12 sec latency 470.770 ms 20 1636 6.45 MB/sec execute 13 sec latency 478.459 ms 20 1675 6.03 MB/sec execute 14 sec latency 373.229 ms 20 1729 5.68 MB/sec execute 15 sec latency 435.133 ms 20 1773 5.37 MB/sec execute 16 sec latency 272.404 ms 20 1827 5.11 MB/sec execute 17 sec latency 340.294 ms 20 1871 4.87 MB/sec execute 18 sec latency 372.173 ms 20 1907 4.65 MB/sec execute 19 sec latency 388.415 ms 20 1936 4.44 MB/sec execute 20 sec latency 939.561 ms 20 1984 4.29 MB/sec execute 21 sec latency 583.451 ms 20 2044 4.15 MB/sec execute 22 sec latency 307.322 ms 20 2093 4.04 MB/sec execute 23 sec latency 111.261 ms 20 2141 3.98 MB/sec execute 24 sec latency 203.376 ms 20 2202 3.93 MB/sec execute 25 sec latency 490.477 ms 20 2255 4.07 MB/sec execute 26 sec latency 586.172 ms 20 2297 4.00 MB/sec execute 27 sec latency 479.054 ms 20 2364 4.23 MB/sec execute 28 sec latency 674.723 ms 20 2398 4.17 MB/sec execute 29 sec latency 559.818 ms 20 2438 4.17 MB/sec execute 30 sec latency 596.485 ms 20 2481 4.17 MB/sec execute 31 sec latency 581.591 ms 20 2549 4.48 MB/sec execute 32 sec latency 390.799 ms 20 2632 4.85 MB/sec execute 33 sec latency 485.513 ms 20 2710 5.12 MB/sec execute 34 sec latency 474.311 ms 20 2823 5.83 MB/sec execute 35 sec latency 360.417 ms 20 2901 6.01 MB/sec execute 36 sec latency 573.576 ms 20 2982 6.19 MB/sec execute 37 sec latency 604.036 ms 20 3073 6.27 MB/sec execute 38 sec latency 488.613 ms 20 3127 6.23 MB/sec execute 39 sec latency 662.268 ms 20 3216 6.31 MB/sec execute 40 sec latency 570.075 ms 20 3303 6.48 MB/sec execute 41 sec latency 521.160 ms 20 3372 6.66 MB/sec execute 42 sec latency 503.412 ms 20 3452 6.94 MB/sec execute 43 sec latency 480.909 ms 20 3524 7.05 MB/sec execute 44 sec latency 489.245 ms 20 3619 7.39 MB/sec execute 45 sec latency 101.930 ms 20 3667 7.30 MB/sec execute 46 sec latency 146.659 ms 20 3717 7.29 MB/sec execute 47 sec latency 153.321 ms 20 3761 7.22 MB/sec execute 48 sec latency 121.781 ms 20 3806 7.20 MB/sec execute 49 sec latency 134.960 ms 20 3849 7.13 MB/sec execute 50 sec latency 114.113 ms 20 3886 7.02 MB/sec execute 51 sec latency 159.183 ms 20 3925 6.90 MB/sec execute 52 sec latency 169.890 ms 20 3965 6.81 MB/sec execute 53 sec latency 154.078 ms 20 3996 6.69 MB/sec execute 54 sec latency 201.104 ms 20 4039 6.57 MB/sec execute 55 sec latency 106.621 ms 20 4083 6.46 MB/sec execute 56 sec latency 159.504 ms 20 4123 6.35 MB/sec execute 57 sec latency 668.142 ms 20 4163 6.26 MB/sec execute 58 sec latency 372.926 ms 20 4205 6.17 MB/sec execute 59 sec latency 555.832 ms 20 4245 6.09 MB/sec execute 60 sec latency 607.823 ms 20 4270 6.01 MB/sec execute 61 sec latency 440.893 ms 20 4301 5.94 MB/sec execute 62 sec latency 331.646 ms 20 4327 5.86 MB/sec execute 63 sec latency 355.444 ms 20 4361 5.79 MB/sec execute 64 sec latency 354.550 ms 20 4387 5.73 MB/sec execute 65 sec latency 401.992 ms 20 4414 5.66 MB/sec execute 66 sec latency 424.273 ms 20 4456 5.60 MB/sec execute 67 sec latency 359.275 ms 20 4490 5.55 MB/sec execute 68 sec latency 430.957 ms 20 4527 5.53 MB/sec execute 69 sec latency 476.367 ms 20 4580 5.54 MB/sec execute 70 sec latency 395.381 ms 20 4626 5.52 MB/sec execute 71 sec latency 408.906 ms 20 4686 5.58 MB/sec execute 72 sec latency 354.186 ms 20 4744 5.52 MB/sec execute 73 sec latency 147.660 ms 20 4814 5.65 MB/sec execute 74 sec latency 121.665 ms 20 4882 5.73 MB/sec execute 75 sec latency 100.921 ms 20 4929 5.74 MB/sec execute 76 sec latency 440.822 ms 20 5010 6.01 MB/sec execute 77 sec latency 401.864 ms 20 5059 5.94 MB/sec execute 78 sec latency 330.894 ms 20 5097 5.87 MB/sec execute 79 sec latency 417.418 ms 20 5144 5.81 MB/sec execute 80 sec latency 537.473 ms 20 5182 5.74 MB/sec execute 81 sec latency 359.958 ms 20 5219 5.68 MB/sec execute 82 sec latency 413.305 ms 20 5255 5.62 MB/sec execute 83 sec latency 302.287 ms 20 5291 5.56 MB/sec execute 84 sec latency 412.174 ms 20 5328 5.50 MB/sec execute 85 sec latency 142.473 ms 20 5375 5.45 MB/sec execute 86 sec latency 324.027 ms 20 5420 5.40 MB/sec execute 87 sec latency 345.072 ms 20 5464 5.34 MB/sec execute 88 sec latency 383.151 ms 20 5514 5.29 MB/sec execute 89 sec latency 419.276 ms 20 5575 5.25 MB/sec execute 90 sec latency 306.251 ms 20 5637 5.21 MB/sec execute 91 sec latency 300.478 ms 20 5697 5.19 MB/sec execute 92 sec latency 118.820 ms 20 5764 5.18 MB/sec execute 93 sec latency 260.532 ms 20 5812 5.16 MB/sec execute 94 sec latency 388.962 ms 20 5868 5.17 MB/sec execute 95 sec latency 341.703 ms 20 5930 5.21 MB/sec execute 96 sec latency 511.153 ms 20 5968 5.20 MB/sec execute 97 sec latency 467.635 ms 20 6014 5.18 MB/sec execute 98 sec latency 400.435 ms 20 6072 5.24 MB/sec execute 99 sec latency 367.727 ms 20 6155 5.34 MB/sec execute 100 sec latency 304.485 ms 20 6252 5.47 MB/sec execute 101 sec latency 336.335 ms 20 6352 5.64 MB/sec execute 102 sec latency 440.236 ms 20 6468 5.84 MB/sec execute 103 sec latency 510.709 ms 20 6566 5.92 MB/sec execute 104 sec latency 401.611 ms 20 6678 5.95 MB/sec execute 105 sec latency 348.336 ms 20 6775 6.01 MB/sec execute 106 sec latency 443.566 ms 20 6895 6.13 MB/sec execute 107 sec latency 397.402 ms 20 6978 6.24 MB/sec execute 108 sec latency 399.235 ms 20 7057 6.31 MB/sec execute 109 sec latency 322.230 ms 20 7156 6.47 MB/sec execute 110 sec latency 118.084 ms 20 7227 6.48 MB/sec execute 111 sec latency 89.659 ms 20 7280 6.48 MB/sec execute 112 sec latency 166.559 ms 20 7336 6.48 MB/sec execute 113 sec latency 114.770 ms 20 7390 6.48 MB/sec execute 114 sec latency 115.783 ms 20 7439 6.44 MB/sec execute 115 sec latency 121.780 ms 20 7484 6.39 MB/sec execute 116 sec latency 111.862 ms 20 7529 6.35 MB/sec execute 117 sec latency 111.619 ms 20 7578 6.30 MB/sec execute 118 sec latency 133.746 ms 20 7634 6.25 MB/sec execute 119 sec latency 340.987 ms 20 cleanup 120 sec 20 cleanup 121 sec 14 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 23339 50.505 219.069 Close 16959 13.983 77.036 Rename 972 78.294 178.182 Unlink 4567 16.636 78.841 Qpathinfo 21836 13.074 150.195 Qfileinfo 3717 0.284 29.290 Qfsinfo 3793 0.265 63.642 Sfileinfo 1697 53.640 132.198 Find 8121 4.674 150.911 WriteX 11228 6.087 148.816 ReadX 37078 0.039 15.393 LockX 80 13.174 29.026 UnlockX 80 12.138 23.577 Flush 1292 267.087 939.546 Throughput 6.25146 MB/sec 20 clients 20 procs max_latency=939.561 ms stopping dbench on /mnt/lustre/d0.oleg452-client.virtnet at Thu Dec 12 10:06:46 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg452-client.virtnet /mnt/lustre/d0.oleg452-client.virtnet /mnt/lustre/d0.oleg452-client.virtnet removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg452-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:54 (1734016014) min OST has 3316736kB available, using 4975104kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7714] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4858] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg452-clien 4858M 72088 59 45710 40 102788 26 516.8 118 Latency 33592us 281ms 111ms 426ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg452-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 200 18 4072 20 270 12 268 17 506 12 105 9 Latency 26715us 37364us 66146us 20790us 9514us 100ms 1.97,1.97,oleg452-client.virtnet,1,1734004869,4858M,,,,72088,59,45710,40,,,102788,26,516.8,118,10,,,,,200,18,4072,20,270,12,268,17,506,12,105,9,,33592us,281ms,,111ms,426ms,26715us,37364us,66146us,20790us,9514us,100ms debug=0x33f0484 PASS bonnie (498s) == sanity-benchmark test iozone: iozone ================== 10:15:12 (1734016512) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7714] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:15:35 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 127170 145776 188012 255011 44058 166656 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:21:11 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 22418 23236 86615 105108 80796 35593 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1222s) == sanity-benchmark test fsx: fsx ======================== 10:35:34 (1734017734) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 9449 -P /tmp -l 5642496 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 9449 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x91ede truncating to largest ever: 0x31463d truncating to largest ever: 0x362948 truncating to largest ever: 0x3fb4e6 truncating to largest ever: 0x45be5b truncating to largest ever: 0x539860 truncating to largest ever: 0x544bb3 truncating to largest ever: 0x54c30f truncating to largest ever: 0x55e0f0 truncating to largest ever: 0x56129e 005000 1734017751.752774 write 0x2fb68f thru 0x2fedaf (0x3721 bytes) 006000 1734017754.971847 mapread 0x1004f0 thru 0x10b049 (0xab5a bytes) 007000 1734017758.266246 mapread 0x010f63 thru 0x01e70e (0xd7ac bytes) 008000 1734017761.551848 write 0x2e06da thru 0x2e869b (0x7fc2 bytes) 009000 1734017764.887086 mapwrite 0x0e85b8 thru 0x0f3d0d (0xb756 bytes) 011000 1734017771.375359 write 0x4cbaef thru 0x4dab1c (0xf02e bytes) 015000 1734017782.749724 mapwrite 0x40f61d thru 0x410362 (0xd46 bytes) truncating to largest ever: 0x5615c6 017000 1734017789.226586 trunc from 0x226900 to 0x220df1 (0x5b0e bytes) 018000 1734017792.413313 mapread 0x001224 thru 0x009617 (0x83f4 bytes) 020000 1734017798.888031 mapread 0x1cd1bc thru 0x1d368e (0x64d3 bytes) 022000 1734017805.822757 write 0x52be0f thru 0x5344fc (0x86ee bytes) 023000 1734017808.945853 write 0x0b75be thru 0x0c2250 (0xac93 bytes) 026000 1734017817.746591 trunc from 0x4cef5a to 0x51c86c (0x4d913 bytes) 027000 1734017820.969681 mapwrite 0x3ad9bb thru 0x3b0f08 (0x354e bytes) 028000 1734017823.802674 trunc from 0x1ab4b8 to 0x0f4ab4 (0xb6a03 bytes) 029000 1734017827.341409 mapwrite 0x14844d thru 0x14cb39 (0x46ed bytes) 030000 1734017830.933493 mapwrite 0x46cf01 thru 0x479faa (0xd0aa bytes) 032000 1734017837.425970 trunc from 0x376571 to 0x43988b (0xc331b bytes) 033000 1734017840.886917 write 0x2af9f9 thru 0x2b4470 (0x4a78 bytes) 039000 1734017859.544924 trunc from 0x460026 to 0x0feb6c (0x3614b9 bytes) 041000 1734017865.568978 mapread 0x3b0a0f thru 0x3c02cf (0xf8c1 bytes) 047000 1734017884.186304 mapread 0x25a3e4 thru 0x25ff8a (0x5ba7 bytes) 049000 1734017891.232338 trunc from 0x309000 to 0x399dc2 (0x90dc3 bytes) 051000 1734017897.738561 trunc from 0x5344fb to 0x2e0a3a (0x253ac0 bytes) 052000 1734017900.671310 mapwrite 0x08f7db thru 0x099462 (0x9c88 bytes) 053000 1734017903.954336 write 0x456357 thru 0x45fd1d (0x99c7 bytes) 054000 1734017907.119449 write 0x00f902 thru 0x0162fe (0x69fd bytes) 056000 1734017913.147467 write 0x4de1aa thru 0x4ee184 (0xffdb bytes) 057000 1734017916.505270 mapwrite 0x447b91 thru 0x44e628 (0x6a98 bytes) 062000 1734017932.741992 write 0x3d9c79 thru 0x3e96c8 (0xfa50 bytes) 063000 1734017935.843389 write 0x165abe thru 0x175a4d (0xff90 bytes) 065000 1734017942.513277 mapwrite 0x4aefa8 thru 0x4bab10 (0xbb69 bytes) 067000 1734017948.670201 mapwrite 0x557c5b thru 0x560195 (0x853b bytes) 068000 1734017951.555818 trunc from 0x333338 to 0x246d35 (0xec602 bytes) 069000 1734017954.873336 mapread 0x342a2b thru 0x351fb1 (0xf587 bytes) 070000 1734017958.317565 write 0x3319ce thru 0x33759f (0x5bd2 bytes) 071000 1734017961.415501 mapread 0x22e938 thru 0x235efc (0x75c5 bytes) 072000 1734017963.914538 trunc from 0x3bee56 to 0x2b2434 (0x10ca21 bytes) 077000 1734017980.620337 mapread 0x2cf73d thru 0x2daf4e (0xb812 bytes) 079000 1734017987.082150 read 0x4d6b1f thru 0x4e0fda (0xa4bc bytes) 081000 1734017993.445376 read 0x2015cf thru 0x20b718 (0xa14a bytes) 082000 1734017996.275334 read 0x1f61da thru 0x2039ff (0xd826 bytes) 087000 1734018010.533931 write 0x12a78b thru 0x12acce (0x544 bytes) 088000 1734018013.063098 trunc from 0x2e27f5 to 0x076955 (0x26be9f bytes) 089000 1734018015.765435 mapwrite 0x117dcd thru 0x11defb (0x612f bytes) 092000 1734018023.949219 trunc from 0x51c3d4 to 0x317af5 (0x2048de bytes) 093000 1734018027.022149 trunc from 0x44cc2b to 0x34f1bb (0xfda6f bytes) 095000 1734018035.855146 trunc from 0x131049 to 0x1a0614 (0x6f5cc bytes) 096000 1734018040.903323 trunc from 0x2b9049 to 0x00a1a4 (0x2aeea4 bytes) skipping zero size read 097000 1734018045.375076 write 0x2fd6b7 thru 0x309bad (0xc4f7 bytes) 099000 1734018050.779159 read 0x23a248 thru 0x23c83e (0x25f7 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4537168 (4480 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (320s) == sanity-benchmark test complete, duration 2218 sec ===== 10:40:54 (1734018054) === sanity-benchmark: start cleanup 10:40:54 (1734018054) === === sanity-benchmark: finish cleanup 10:40:55 (1734018055) ===