-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:40 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:44 (1734015824) === oleg302-client.virtnet: executing check_config_client /mnt/lustre oleg302-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg302-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b588d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b588d800.idle_timeout=debug disable quota as required oleg302-server: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:03:52 (1734015832) === == sanity-benchmark test dbench: dbench ================== 10:03:53 (1734015833) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6983] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg302-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg302-client.virtnet at Thu Dec 12 10:03:54 EST 2024 waiting for dbench pid 9450 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 114 105.81 MB/sec warmup 1 sec latency 109.899 ms 20 225 86.77 MB/sec warmup 2 sec latency 106.371 ms 20 330 79.85 MB/sec warmup 3 sec latency 80.676 ms 20 443 77.89 MB/sec warmup 4 sec latency 77.220 ms 20 553 76.49 MB/sec warmup 5 sec latency 98.399 ms 20 668 70.50 MB/sec warmup 6 sec latency 340.369 ms 20 718 60.71 MB/sec warmup 7 sec latency 199.468 ms 20 769 53.37 MB/sec warmup 8 sec latency 269.377 ms 20 816 47.74 MB/sec warmup 9 sec latency 173.269 ms 20 891 43.33 MB/sec warmup 10 sec latency 176.176 ms 20 949 39.78 MB/sec warmup 11 sec latency 167.356 ms 20 1010 36.91 MB/sec warmup 12 sec latency 231.556 ms 20 1104 35.29 MB/sec warmup 13 sec latency 94.774 ms 20 1167 32.86 MB/sec warmup 14 sec latency 116.222 ms 20 1233 31.12 MB/sec warmup 15 sec latency 105.394 ms 20 1295 29.59 MB/sec warmup 16 sec latency 117.250 ms 20 1420 30.59 MB/sec warmup 17 sec latency 221.507 ms 20 1476 28.91 MB/sec warmup 18 sec latency 192.728 ms 20 1529 27.44 MB/sec warmup 19 sec latency 224.574 ms 20 1596 26.13 MB/sec warmup 20 sec latency 169.063 ms 20 1658 24.94 MB/sec warmup 21 sec latency 198.896 ms 20 1722 23.85 MB/sec warmup 22 sec latency 209.458 ms 20 1788 22.86 MB/sec warmup 23 sec latency 91.159 ms 20 1895 0.71 MB/sec execute 1 sec latency 224.379 ms 20 1967 1.11 MB/sec execute 2 sec latency 168.479 ms 20 2024 1.17 MB/sec execute 3 sec latency 97.219 ms 20 2075 1.29 MB/sec execute 4 sec latency 97.649 ms 20 2140 1.32 MB/sec execute 5 sec latency 90.016 ms 20 2204 1.82 MB/sec execute 6 sec latency 113.489 ms 20 2267 2.57 MB/sec execute 7 sec latency 274.891 ms 20 2349 3.53 MB/sec execute 8 sec latency 224.083 ms 20 2396 3.74 MB/sec execute 9 sec latency 299.746 ms 20 2440 3.69 MB/sec execute 10 sec latency 295.522 ms 20 2479 3.86 MB/sec execute 11 sec latency 749.516 ms 20 2566 4.90 MB/sec execute 12 sec latency 250.782 ms 20 2688 6.52 MB/sec execute 13 sec latency 289.273 ms 20 2815 7.96 MB/sec execute 14 sec latency 278.864 ms 20 2904 8.71 MB/sec execute 15 sec latency 346.550 ms 20 2968 8.96 MB/sec execute 16 sec latency 1002.753 ms 20 3044 8.65 MB/sec execute 17 sec latency 300.724 ms 20 3187 8.80 MB/sec execute 18 sec latency 372.947 ms 20 3285 9.09 MB/sec execute 19 sec latency 345.598 ms 20 3373 9.48 MB/sec execute 20 sec latency 307.524 ms 20 3447 9.95 MB/sec execute 21 sec latency 346.961 ms 20 3542 10.56 MB/sec execute 22 sec latency 98.368 ms 20 3614 10.63 MB/sec execute 23 sec latency 102.362 ms 20 3672 10.38 MB/sec execute 24 sec latency 125.206 ms 20 3718 10.14 MB/sec execute 25 sec latency 151.682 ms 20 3759 10.01 MB/sec execute 26 sec latency 135.951 ms 20 3809 9.92 MB/sec execute 27 sec latency 123.676 ms 20 3845 9.60 MB/sec execute 28 sec latency 116.700 ms 20 3881 9.31 MB/sec execute 29 sec latency 103.969 ms 20 3913 9.07 MB/sec execute 30 sec latency 158.284 ms 20 3950 8.83 MB/sec execute 31 sec latency 134.981 ms 20 3988 8.56 MB/sec execute 32 sec latency 114.254 ms 20 4019 8.30 MB/sec execute 33 sec latency 110.571 ms 20 4056 8.06 MB/sec execute 34 sec latency 126.364 ms 20 4083 7.84 MB/sec execute 35 sec latency 201.260 ms 20 4126 7.63 MB/sec execute 36 sec latency 353.799 ms 20 4186 7.45 MB/sec execute 37 sec latency 210.414 ms 20 4228 7.29 MB/sec execute 38 sec latency 559.437 ms 20 4259 7.15 MB/sec execute 39 sec latency 419.926 ms 20 4295 7.01 MB/sec execute 40 sec latency 345.907 ms 20 4323 6.88 MB/sec execute 41 sec latency 381.607 ms 20 4365 6.76 MB/sec execute 42 sec latency 296.177 ms 20 4401 6.65 MB/sec execute 43 sec latency 280.570 ms 20 4442 6.53 MB/sec execute 44 sec latency 256.118 ms 20 4477 6.43 MB/sec execute 45 sec latency 378.095 ms 20 4514 6.37 MB/sec execute 46 sec latency 583.368 ms 20 4556 6.33 MB/sec execute 47 sec latency 336.245 ms 20 4608 6.33 MB/sec execute 48 sec latency 214.540 ms 20 4663 6.34 MB/sec execute 49 sec latency 289.814 ms 20 4723 6.30 MB/sec execute 50 sec latency 143.118 ms 20 4790 6.36 MB/sec execute 51 sec latency 111.632 ms 20 4855 6.44 MB/sec execute 52 sec latency 116.755 ms 20 4919 6.64 MB/sec execute 53 sec latency 270.550 ms 20 4983 6.81 MB/sec execute 54 sec latency 366.125 ms 20 5034 6.83 MB/sec execute 55 sec latency 216.687 ms 20 5073 6.72 MB/sec execute 56 sec latency 243.227 ms 20 5112 6.61 MB/sec execute 57 sec latency 263.050 ms 20 5156 6.51 MB/sec execute 58 sec latency 212.918 ms 20 5193 6.41 MB/sec execute 59 sec latency 232.077 ms 20 5235 6.32 MB/sec execute 60 sec latency 172.056 ms 20 5280 6.23 MB/sec execute 61 sec latency 206.596 ms 20 5324 6.14 MB/sec execute 62 sec latency 122.143 ms 20 5355 6.05 MB/sec execute 63 sec latency 160.763 ms 20 5403 5.96 MB/sec execute 64 sec latency 238.336 ms 20 5449 5.89 MB/sec execute 65 sec latency 160.406 ms 20 5499 5.81 MB/sec execute 66 sec latency 218.417 ms 20 5558 5.75 MB/sec execute 67 sec latency 260.155 ms 20 5624 5.68 MB/sec execute 68 sec latency 198.650 ms 20 5677 5.62 MB/sec execute 69 sec latency 95.814 ms 20 5747 5.61 MB/sec execute 70 sec latency 194.553 ms 20 5809 5.61 MB/sec execute 71 sec latency 220.351 ms 20 5864 5.62 MB/sec execute 72 sec latency 302.225 ms 20 5927 5.63 MB/sec execute 73 sec latency 353.000 ms 20 5981 5.66 MB/sec execute 74 sec latency 434.214 ms 20 6034 5.64 MB/sec execute 75 sec latency 322.560 ms 20 6114 5.79 MB/sec execute 76 sec latency 357.987 ms 20 6205 5.96 MB/sec execute 77 sec latency 308.086 ms 20 6318 6.17 MB/sec execute 78 sec latency 317.247 ms 20 6418 6.33 MB/sec execute 79 sec latency 247.545 ms 20 6550 6.53 MB/sec execute 80 sec latency 303.130 ms 20 6638 6.60 MB/sec execute 81 sec latency 364.887 ms 20 6741 6.63 MB/sec execute 82 sec latency 393.623 ms 20 6857 6.80 MB/sec execute 83 sec latency 302.159 ms 20 6949 6.91 MB/sec execute 84 sec latency 341.434 ms 20 7033 7.03 MB/sec execute 85 sec latency 247.181 ms 20 7106 7.11 MB/sec execute 86 sec latency 341.383 ms 20 7190 7.24 MB/sec execute 87 sec latency 93.457 ms 20 7246 7.21 MB/sec execute 88 sec latency 98.424 ms 20 7295 7.20 MB/sec execute 89 sec latency 118.879 ms 20 7339 7.17 MB/sec execute 90 sec latency 161.434 ms 20 7385 7.16 MB/sec execute 91 sec latency 121.272 ms 20 7429 7.09 MB/sec execute 92 sec latency 95.525 ms 20 7470 7.03 MB/sec execute 93 sec latency 94.803 ms 20 7512 6.97 MB/sec execute 94 sec latency 110.826 ms 20 7545 6.90 MB/sec execute 95 sec latency 150.641 ms 20 7590 6.83 MB/sec execute 96 sec latency 111.030 ms 20 7635 6.77 MB/sec execute 97 sec latency 367.201 ms 20 7671 6.71 MB/sec execute 98 sec latency 368.985 ms 20 7719 6.65 MB/sec execute 99 sec latency 317.180 ms 20 7764 6.60 MB/sec execute 100 sec latency 359.786 ms 20 7811 6.55 MB/sec execute 101 sec latency 444.650 ms 20 7845 6.50 MB/sec execute 102 sec latency 291.970 ms 20 7883 6.46 MB/sec execute 103 sec latency 336.127 ms 20 7930 6.41 MB/sec execute 104 sec latency 276.015 ms 20 7969 6.37 MB/sec execute 105 sec latency 303.088 ms 20 8005 6.33 MB/sec execute 106 sec latency 462.294 ms 20 8054 6.31 MB/sec execute 107 sec latency 322.517 ms 20 8090 6.28 MB/sec execute 108 sec latency 357.780 ms 20 8144 6.27 MB/sec execute 109 sec latency 355.759 ms 20 8199 6.27 MB/sec execute 110 sec latency 224.636 ms 20 8278 6.33 MB/sec execute 111 sec latency 171.865 ms 20 8341 6.34 MB/sec execute 112 sec latency 118.301 ms 20 8397 6.36 MB/sec execute 113 sec latency 347.852 ms 20 8453 6.37 MB/sec execute 114 sec latency 297.722 ms 20 8512 6.45 MB/sec execute 115 sec latency 311.062 ms 20 8573 6.52 MB/sec execute 116 sec latency 195.058 ms 20 8622 6.48 MB/sec execute 117 sec latency 210.244 ms 20 8663 6.43 MB/sec execute 118 sec latency 188.253 ms 20 8705 6.38 MB/sec execute 119 sec latency 207.809 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 23425 53.649 201.246 Close 17193 12.279 63.399 Rename 1026 77.501 201.248 Unlink 4909 17.724 94.432 Qpathinfo 21812 12.776 150.173 Qfileinfo 3718 0.282 29.369 Qfsinfo 4080 0.194 26.410 Sfileinfo 2000 46.327 146.545 Find 8419 2.956 121.076 WriteX 11883 3.972 77.474 ReadX 37773 0.038 12.155 LockX 80 18.022 46.896 UnlockX 80 17.491 50.498 Flush 1689 187.654 1002.738 Throughput 6.38442 MB/sec 20 clients 20 procs max_latency=1002.753 ms stopping dbench on /mnt/lustre/d0.oleg302-client.virtnet at Thu Dec 12 10:06:21 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg302-client.virtnet /mnt/lustre/d0.oleg302-client.virtnet /mnt/lustre/d0.oleg302-client.virtnet removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg302-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:28 (1734015988) min OST has 3534848kB available, using 5302272kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6983] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5178] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg302-clien 5178M 85045 63 59099 48 142316 32 645.9 109 Latency 34151us 117ms 86291us 425ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg302-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 243 18 6341 28 376 13 337 17 820 11 438 13 Latency 19951us 19966us 53072us 19775us 4394us 14480us 1.97,1.97,oleg302-client.virtnet,1,1734005476,5178M,,,,85045,63,59099,48,,,142316,32,645.9,109,10,,,,,243,18,6341,28,376,13,337,17,820,11,438,13,,34151us,117ms,,86291us,425ms,19951us,19966us,53072us,19775us,4394us,14480us debug=0x33f0484 PASS bonnie (347s) == sanity-benchmark test iozone: iozone ================== 10:12:15 (1734016335) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6983] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:36 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 147794 143685 126062 223371 69903 108624 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:17:54 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 25892 25567 108877 113956 91686 33110 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1131s) == sanity-benchmark test fsx: fsx ======================== 10:31:06 (1734017466) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 21780 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 21780 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x2683d9 truncating to largest ever: 0x3660f7 truncating to largest ever: 0x49eb6b truncating to largest ever: 0x4e25d1 truncating to largest ever: 0x4ec437 truncating to largest ever: 0x544311 truncating to largest ever: 0x557a7e 001000 1734017469.316910 write 0x256259 thru 0x25955b (0x3303 bytes) truncating to largest ever: 0x55aff6 truncating to largest ever: 0x55ce17 003000 1734017474.302819 trunc from 0x4f3192 to 0x423ebe (0xcf2d3 bytes) truncating to largest ever: 0x56078d truncating to largest ever: 0x561694 008000 1734017487.812532 mapread 0x227382 thru 0x22b742 (0x43c1 bytes) 009000 1734017490.199583 mapwrite 0x42ee68 thru 0x43b86f (0xca08 bytes) 010000 1734017492.577168 mapwrite 0x45c41d thru 0x45cdae (0x992 bytes) 013000 1734017500.305516 read 0x02682e thru 0x030c51 (0xa424 bytes) 015000 1734017505.185990 mapread 0x29f3b5 thru 0x2aac87 (0xb8d3 bytes) 016000 1734017507.998350 write 0x21853e thru 0x22097d (0x8440 bytes) skipping zero size read 017000 1734017510.716162 mapread 0x235a64 thru 0x23b848 (0x5de5 bytes) 018000 1734017513.813070 mapwrite 0x311c53 thru 0x315313 (0x36c1 bytes) 019000 1734017516.676761 mapread 0x02d77d thru 0x032e51 (0x56d5 bytes) 020000 1734017519.591394 trunc from 0x19d029 to 0x323c78 (0x186c50 bytes) 022000 1734017525.492653 mapread 0x38e490 thru 0x390f5a (0x2acb bytes) 023000 1734017528.303885 mapread 0x1cfb21 thru 0x1dcfd2 (0xd4b2 bytes) 024000 1734017531.171890 mapwrite 0x1dbad5 thru 0x1e85ce (0xcafa bytes) 025000 1734017533.733274 trunc from 0x422eee to 0x00ed2f (0x4141be bytes) 029000 1734017545.424468 read 0x005746 thru 0x00a7bd (0x5078 bytes) 030000 1734017548.676369 mapread 0x180df1 thru 0x183543 (0x2753 bytes) 033000 1734017556.930349 read 0x150ddb thru 0x15f71b (0xe941 bytes) 034000 1734017559.800361 mapwrite 0x5354c9 thru 0x535afb (0x633 bytes) 036000 1734017565.305951 mapread 0x483a2f thru 0x490c04 (0xd1d6 bytes) 038000 1734017570.856108 mapwrite 0x357309 thru 0x365b95 (0xe88d bytes) 041000 1734017579.206491 mapwrite 0x4498e3 thru 0x44eae9 (0x5207 bytes) 043000 1734017584.548298 mapread 0x08f4eb thru 0x09e4d7 (0xefed bytes) truncating to largest ever: 0x5619c6 045000 1734017589.763414 mapwrite 0x437828 thru 0x440692 (0x8e6b bytes) 048000 1734017598.087313 read 0x03b860 thru 0x043cf3 (0x8494 bytes) 049000 1734017601.042757 trunc from 0x07ff85 to 0x0ae268 (0x2e2e4 bytes) 054000 1734017615.815552 mapread 0x01eed7 thru 0x022c81 (0x3dab bytes) 056000 1734017621.749424 trunc from 0x110b0c to 0x41f43c (0x30e931 bytes) 057000 1734017625.096177 read 0x0366ad thru 0x040b72 (0xa4c6 bytes) 059000 1734017631.090756 trunc from 0x46550f to 0x0ae5c0 (0x3b6f4e bytes) 061000 1734017635.994959 read 0x432af6 thru 0x43e0c4 (0xb5cf bytes) 062000 1734017638.532895 mapread 0x049b91 thru 0x0513b1 (0x7821 bytes) 067000 1734017652.217006 read 0x1d5e80 thru 0x1e0be6 (0xad67 bytes) 070000 1734017661.070131 trunc from 0x331315 to 0x5617ca (0x2304b6 bytes) 071000 1734017663.747752 read 0x445fdd thru 0x4492f5 (0x3319 bytes) 076000 1734017677.089584 mapwrite 0x09d80e thru 0x0a0a90 (0x3283 bytes) 078000 1734017682.352032 mapread 0x1b8220 thru 0x1c5aeb (0xd8cc bytes) 079000 1734017685.093777 read 0x085250 thru 0x09081d (0xb5ce bytes) 082000 1734017692.577094 mapwrite 0x035647 thru 0x035ad0 (0x48a bytes) 083000 1734017695.059881 write 0x456ece thru 0x45ebda (0x7d0d bytes) 084000 1734017697.746471 trunc from 0x47b7ca to 0x1bcce1 (0x2beae8 bytes) 086000 1734017702.497576 read 0x37688d thru 0x37c36e (0x5ae2 bytes) 087000 1734017704.896268 mapread 0x406c38 thru 0x409b13 (0x2edc bytes) 093000 1734017720.935768 mapwrite 0x0dcca7 thru 0x0eb7ed (0xeb47 bytes) 097000 1734017730.961774 mapwrite 0x4a50d3 thru 0x4af12f (0xa05d bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 3701239 (3712 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (273s) == sanity-benchmark test complete, duration 1919 sec ===== 10:35:39 (1734017739) === sanity-benchmark: start cleanup 10:35:39 (1734017739) === === sanity-benchmark: finish cleanup 10:35:40 (1734017740) ===