-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:00 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:08 (1734015848) === oleg447-client.virtnet: executing check_config_client /mnt/lustre oleg447-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg447-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5a57800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5a57800.idle_timeout=debug disable quota as required oleg447-server: oleg447-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:25 (1734015865) === == sanity-benchmark test dbench: dbench ================== 10:04:26 (1734015866) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7737] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg447-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg447-client.virtnet at Thu Dec 12 10:04:29 EST 2024 waiting for dbench pid 10328 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 14 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 0 4 0.00 MB/sec warmup 1 sec latency 956.433 ms 6 27 10.18 MB/sec warmup 2 sec latency 1891.353 ms 20 84 24.28 MB/sec warmup 3 sec latency 297.182 ms 20 135 29.63 MB/sec warmup 4 sec latency 301.494 ms 20 182 29.36 MB/sec warmup 5 sec latency 181.332 ms 20 231 29.58 MB/sec warmup 6 sec latency 151.994 ms 20 279 29.72 MB/sec warmup 7 sec latency 172.791 ms 20 328 29.72 MB/sec warmup 8 sec latency 167.612 ms 20 366 29.10 MB/sec warmup 9 sec latency 223.382 ms 20 418 29.49 MB/sec warmup 10 sec latency 184.871 ms 20 475 30.18 MB/sec warmup 11 sec latency 145.226 ms 20 539 30.81 MB/sec warmup 12 sec latency 200.526 ms 20 606 31.27 MB/sec warmup 13 sec latency 634.622 ms 20 667 30.17 MB/sec warmup 14 sec latency 507.030 ms 20 693 28.23 MB/sec warmup 15 sec latency 351.618 ms 20 727 26.59 MB/sec warmup 16 sec latency 345.437 ms 20 750 25.08 MB/sec warmup 17 sec latency 395.364 ms 20 788 23.77 MB/sec warmup 18 sec latency 383.356 ms 20 819 22.62 MB/sec warmup 19 sec latency 395.916 ms 20 870 21.59 MB/sec warmup 20 sec latency 290.201 ms 20 891 20.63 MB/sec warmup 21 sec latency 565.335 ms 20 926 19.77 MB/sec warmup 22 sec latency 385.238 ms 20 974 19.12 MB/sec warmup 23 sec latency 325.840 ms 20 1085 15.17 MB/sec execute 1 sec latency 470.166 ms 20 1153 8.40 MB/sec execute 2 sec latency 88.984 ms 20 1199 5.86 MB/sec execute 3 sec latency 126.391 ms 20 1265 7.47 MB/sec execute 4 sec latency 98.140 ms 20 1304 6.71 MB/sec execute 5 sec latency 223.715 ms 20 1372 9.51 MB/sec execute 6 sec latency 243.326 ms 20 1441 11.00 MB/sec execute 7 sec latency 345.558 ms 20 1495 9.72 MB/sec execute 8 sec latency 353.315 ms 20 1543 8.71 MB/sec execute 9 sec latency 413.865 ms 20 1598 7.95 MB/sec execute 10 sec latency 274.561 ms 20 1647 7.30 MB/sec execute 11 sec latency 374.236 ms 20 1693 6.77 MB/sec execute 12 sec latency 503.576 ms 20 1750 6.30 MB/sec execute 13 sec latency 116.543 ms 20 1812 5.92 MB/sec execute 14 sec latency 354.647 ms 20 1876 5.61 MB/sec execute 15 sec latency 248.591 ms 20 1931 5.32 MB/sec execute 16 sec latency 326.379 ms 20 2016 5.11 MB/sec execute 17 sec latency 232.092 ms 20 2063 4.92 MB/sec execute 18 sec latency 123.102 ms 20 2100 4.72 MB/sec execute 19 sec latency 207.704 ms 20 2177 4.74 MB/sec execute 20 sec latency 105.305 ms 20 2218 4.62 MB/sec execute 21 sec latency 731.408 ms 20 2267 4.60 MB/sec execute 22 sec latency 393.276 ms 20 2349 4.94 MB/sec execute 23 sec latency 466.056 ms 20 2384 4.88 MB/sec execute 24 sec latency 722.441 ms 20 2431 4.83 MB/sec execute 25 sec latency 778.846 ms 20 2483 4.85 MB/sec execute 26 sec latency 360.131 ms 20 2553 5.27 MB/sec execute 27 sec latency 436.077 ms 20 2659 5.71 MB/sec execute 28 sec latency 386.556 ms 20 2752 6.15 MB/sec execute 29 sec latency 416.130 ms 20 2862 6.96 MB/sec execute 30 sec latency 433.050 ms 20 2942 7.00 MB/sec execute 31 sec latency 556.158 ms 20 3030 7.25 MB/sec execute 32 sec latency 435.623 ms 20 3124 7.29 MB/sec execute 33 sec latency 459.746 ms 20 3227 7.39 MB/sec execute 34 sec latency 320.380 ms 20 3349 7.80 MB/sec execute 35 sec latency 377.640 ms 20 3449 8.06 MB/sec execute 36 sec latency 274.699 ms 20 3537 8.31 MB/sec execute 37 sec latency 243.851 ms 20 3638 8.74 MB/sec execute 38 sec latency 93.322 ms 20 3704 8.64 MB/sec execute 39 sec latency 104.918 ms 20 3742 8.52 MB/sec execute 40 sec latency 187.135 ms 20 3790 8.43 MB/sec execute 41 sec latency 143.626 ms 20 3844 8.41 MB/sec execute 42 sec latency 103.699 ms 20 3894 8.23 MB/sec execute 43 sec latency 123.347 ms 20 3941 8.09 MB/sec execute 44 sec latency 120.049 ms 20 3971 7.94 MB/sec execute 45 sec latency 173.315 ms 20 4016 7.77 MB/sec execute 46 sec latency 142.032 ms 20 4063 7.62 MB/sec execute 47 sec latency 178.676 ms 20 4101 7.47 MB/sec execute 48 sec latency 451.544 ms 20 4145 7.33 MB/sec execute 49 sec latency 570.107 ms 20 4199 7.20 MB/sec execute 50 sec latency 364.491 ms 20 4232 7.08 MB/sec execute 51 sec latency 600.071 ms 20 4264 6.98 MB/sec execute 52 sec latency 499.814 ms 20 4289 6.87 MB/sec execute 53 sec latency 297.850 ms 20 4316 6.77 MB/sec execute 54 sec latency 611.840 ms 20 4347 6.67 MB/sec execute 55 sec latency 316.119 ms 20 4384 6.58 MB/sec execute 56 sec latency 351.893 ms 20 4420 6.50 MB/sec execute 57 sec latency 345.818 ms 20 4462 6.42 MB/sec execute 58 sec latency 409.603 ms 20 4498 6.35 MB/sec execute 59 sec latency 374.694 ms 20 4540 6.33 MB/sec execute 60 sec latency 511.329 ms 20 4595 6.31 MB/sec execute 61 sec latency 260.137 ms 20 4650 6.32 MB/sec execute 62 sec latency 348.316 ms 20 4721 6.37 MB/sec execute 63 sec latency 245.969 ms 20 4783 6.35 MB/sec execute 64 sec latency 123.957 ms 20 4846 6.43 MB/sec execute 65 sec latency 123.701 ms 20 4909 6.51 MB/sec execute 66 sec latency 312.644 ms 20 4992 6.78 MB/sec execute 67 sec latency 338.629 ms 20 5042 6.76 MB/sec execute 68 sec latency 358.862 ms 20 5078 6.67 MB/sec execute 69 sec latency 369.753 ms 20 5121 6.58 MB/sec execute 70 sec latency 332.933 ms 20 5166 6.50 MB/sec execute 71 sec latency 431.136 ms 20 5209 6.42 MB/sec execute 72 sec latency 302.159 ms 20 5262 6.34 MB/sec execute 73 sec latency 275.128 ms 20 5312 6.27 MB/sec execute 74 sec latency 264.278 ms 20 5354 6.20 MB/sec execute 75 sec latency 295.590 ms 20 5410 6.13 MB/sec execute 76 sec latency 225.304 ms 20 5463 6.06 MB/sec execute 77 sec latency 301.566 ms 20 5514 6.00 MB/sec execute 78 sec latency 295.848 ms 20 5582 5.94 MB/sec execute 79 sec latency 327.826 ms 20 5646 5.89 MB/sec execute 80 sec latency 94.705 ms 20 5718 5.85 MB/sec execute 81 sec latency 236.948 ms 20 5793 5.85 MB/sec execute 82 sec latency 378.240 ms 20 5858 5.87 MB/sec execute 83 sec latency 297.519 ms 20 5920 5.90 MB/sec execute 84 sec latency 540.477 ms 20 5976 5.91 MB/sec execute 85 sec latency 346.109 ms 20 6029 5.92 MB/sec execute 86 sec latency 551.294 ms 20 6082 5.93 MB/sec execute 87 sec latency 344.539 ms 20 6165 6.08 MB/sec execute 88 sec latency 411.382 ms 20 6257 6.18 MB/sec execute 89 sec latency 485.173 ms 20 6334 6.31 MB/sec execute 90 sec latency 548.042 ms 20 6444 6.52 MB/sec execute 91 sec latency 462.950 ms 20 6573 6.63 MB/sec execute 92 sec latency 382.287 ms 20 6647 6.65 MB/sec execute 93 sec latency 514.225 ms 20 6750 6.71 MB/sec execute 94 sec latency 403.010 ms 20 6861 6.78 MB/sec execute 95 sec latency 382.261 ms 20 6973 6.98 MB/sec execute 96 sec latency 330.059 ms 20 7062 7.09 MB/sec execute 97 sec latency 226.654 ms 20 7162 7.26 MB/sec execute 98 sec latency 110.699 ms 20 7219 7.24 MB/sec execute 99 sec latency 145.651 ms 20 7281 7.21 MB/sec execute 100 sec latency 119.797 ms 20 7336 7.21 MB/sec execute 101 sec latency 113.904 ms 20 7397 7.21 MB/sec execute 102 sec latency 118.649 ms 20 7446 7.15 MB/sec execute 103 sec latency 88.115 ms 20 7495 7.10 MB/sec execute 104 sec latency 102.908 ms 20 7539 7.04 MB/sec execute 105 sec latency 124.616 ms 20 7586 6.98 MB/sec execute 106 sec latency 114.656 ms 20 7636 6.92 MB/sec execute 107 sec latency 351.210 ms 20 7693 6.87 MB/sec execute 108 sec latency 302.464 ms 20 7762 6.81 MB/sec execute 109 sec latency 359.979 ms 20 7808 6.77 MB/sec execute 110 sec latency 386.782 ms 20 7850 6.73 MB/sec execute 111 sec latency 248.413 ms 20 7882 6.68 MB/sec execute 112 sec latency 290.174 ms 20 7944 6.65 MB/sec execute 113 sec latency 220.846 ms 20 8007 6.62 MB/sec execute 114 sec latency 270.476 ms 20 8082 6.64 MB/sec execute 115 sec latency 186.154 ms 20 8163 6.63 MB/sec execute 116 sec latency 165.150 ms 20 8269 6.70 MB/sec execute 117 sec latency 191.988 ms 20 8379 6.80 MB/sec execute 118 sec latency 81.418 ms 20 8454 6.82 MB/sec execute 119 sec latency 226.255 ms 20 cleanup 120 sec 20 cleanup 121 sec 15 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 25713 45.281 214.157 Close 19024 11.762 87.347 Rename 1156 69.205 223.692 Unlink 5131 14.848 85.122 Qpathinfo 24047 11.646 229.608 Qfileinfo 4086 0.303 48.633 Qfsinfo 4359 0.227 23.182 Sfileinfo 2332 44.414 199.477 Find 9078 3.944 167.972 WriteX 12829 5.216 142.499 ReadX 41268 0.030 13.278 LockX 80 12.879 35.253 UnlockX 80 13.144 32.581 Flush 1748 209.729 778.840 Throughput 6.8206 MB/sec 20 clients 20 procs max_latency=778.846 ms stopping dbench on /mnt/lustre/d0.oleg447-client.virtnet at Thu Dec 12 10:06:56 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg447-client.virtnet /mnt/lustre/d0.oleg447-client.virtnet /mnt/lustre/d0.oleg447-client.virtnet removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg447-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (158s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:04 (1734016024) min OST has 3580928kB available, using 5371392kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7737] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5245] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg447-clien 5245M 71102 57 47089 42 138445 34 1094 147 Latency 29400us 164ms 94051us 648ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg447-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 234 17 4935 22 282 12 300 17 695 11 236 11 Latency 21905us 33844us 56613us 17237us 5959us 39618us 1.97,1.97,oleg447-client.virtnet,1,1734004922,5245M,,,,71102,57,47089,42,,,138445,34,1094,147,10,,,,,234,17,4935,22,282,12,300,17,695,11,236,11,,29400us,164ms,,94051us,648ms,21905us,33844us,56613us,17237us,5959us,39618us debug=0x33f0484 PASS bonnie (421s) == sanity-benchmark test iozone: iozone ================== 10:14:05 (1734016445) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7737] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:14:30 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 100833 109148 115591 188352 58018 90190 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:20:57 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 23457 24138 86273 93149 87913 33401 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1263s) == sanity-benchmark test fsx: fsx ======================== 10:35:08 (1734017708) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 12350 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 12350 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x786ab truncating to largest ever: 0x5069f9 truncating to largest ever: 0x554024 001000 1734017712.368014 mapread 0x03d8d3 thru 0x04a5ec (0xcd1a bytes) truncating to largest ever: 0x559bef truncating to largest ever: 0x55b681 truncating to largest ever: 0x55f30b truncating to largest ever: 0x56196b 007000 1734017729.581212 mapwrite 0x1a6073 thru 0x1b54b3 (0xf441 bytes) 009000 1734017734.795520 mapwrite 0x41f9b5 thru 0x42575a (0x5da6 bytes) 012000 1734017743.627050 read 0x06c913 thru 0x07baa4 (0xf192 bytes) 013000 1734017747.077536 mapwrite 0x4e20d2 thru 0x4e65e8 (0x4517 bytes) 014000 1734017750.091434 trunc from 0x3d5883 to 0x3057b0 (0xd00d2 bytes) 015000 1734017753.557186 mapread 0x53c559 thru 0x53c6cb (0x173 bytes) 017000 1734017759.730345 mapwrite 0x08dc50 thru 0x094983 (0x6d34 bytes) 022000 1734017774.539581 trunc from 0x356b97 to 0x4b62f5 (0x15f75f bytes) 024000 1734017780.741682 trunc from 0x336057 to 0x2d75ce (0x5ea88 bytes) 025000 1734017783.560639 trunc from 0x54dd59 to 0x32dcf1 (0x220067 bytes) 029000 1734017796.137603 write 0x1884fb thru 0x194c00 (0xc706 bytes) 030000 1734017799.529064 read 0x0e421e thru 0x0e43a8 (0x18b bytes) 036000 1734017817.321885 trunc from 0x5117f3 to 0x349cd2 (0x1c7b20 bytes) 041000 1734017832.283352 read 0x2b9c12 thru 0x2c3722 (0x9b11 bytes) 042000 1734017835.240863 mapwrite 0x382882 thru 0x3900de (0xd85d bytes) 044000 1734017841.252614 mapread 0x4a30b9 thru 0x4aa206 (0x714e bytes) 045000 1734017844.432961 mapwrite 0x2b42df thru 0x2b8bb9 (0x48db bytes) 046000 1734017847.453991 mapread 0x374d0d thru 0x383337 (0xe62b bytes) 047000 1734017850.491936 read 0x3d4c62 thru 0x3d4cde (0x7d bytes) truncating to largest ever: 0x561a1f 049000 1734017857.015610 read 0x4b4eb2 thru 0x4c06f2 (0xb841 bytes) 050000 1734017860.000081 read 0x3550e8 thru 0x363b90 (0xeaa9 bytes) 051000 1734017863.014516 read 0x069d48 thru 0x06a8a5 (0xb5e bytes) 053000 1734017869.522773 write 0x3250d4 thru 0x32ba56 (0x6983 bytes) 054000 1734017872.938497 write 0x127211 thru 0x13461a (0xd40a bytes) 058000 1734017884.849296 mapwrite 0x1f4a2d thru 0x1fb9ac (0x6f80 bytes) 059000 1734017888.270507 mapread 0x0163dc thru 0x01d60d (0x7232 bytes) 062000 1734017898.079408 read 0x13bbb1 thru 0x13e49c (0x28ec bytes) 065000 1734017907.191887 mapwrite 0x33e565 thru 0x346026 (0x7ac2 bytes) 068000 1734017916.758219 mapwrite 0x0a73c4 thru 0x0ad436 (0x6073 bytes) 069000 1734017919.941134 mapread 0x0013f8 thru 0x010334 (0xef3d bytes) 070000 1734017922.981893 mapread 0x35ec70 thru 0x36825d (0x95ee bytes) 074000 1734017935.495206 read 0x2fb06b thru 0x308624 (0xd5ba bytes) 075000 1734017938.507316 mapwrite 0x3f1e94 thru 0x3fc032 (0xa19f bytes) 079000 1734017950.097051 mapread 0x151795 thru 0x155a8d (0x42f9 bytes) 080000 1734017952.934756 mapread 0x01a781 thru 0x01e408 (0x3c88 bytes) 081000 1734017955.851603 mapwrite 0x4f087c thru 0x4f3d58 (0x34dd bytes) 082000 1734017958.951340 write 0x4f2fd8 thru 0x4f31bf (0x1e8 bytes) 083000 1734017962.163195 read 0x43b19c thru 0x44988c (0xe6f1 bytes) 085000 1734017967.617124 write 0x2d4884 thru 0x2d58bc (0x1039 bytes) 086000 1734017970.993793 trunc from 0x0ad25b to 0x54dadd (0x4a0883 bytes) 088000 1734017977.551182 mapwrite 0x1ec449 thru 0x1ee2a1 (0x1e59 bytes) 091000 1734017986.362164 mapwrite 0x35c48f thru 0x361b95 (0x5707 bytes) 094000 1734017994.683215 trunc from 0x25e2b5 to 0x1df113 (0x7f1a1 bytes) 095000 1734017997.416304 read 0x2f6772 thru 0x2f677f (0xe bytes) 097000 1734018002.745895 mapwrite 0x020bda thru 0x02fd5f (0xf186 bytes) 098000 1734018005.482114 mapwrite 0x39b2ac thru 0x3a17f5 (0x654a bytes) 099000 1734018008.652873 write 0x38934e thru 0x38d86c (0x451f bytes) 100000 1734018011.166212 mapwrite 0x2919f3 thru 0x2981c1 (0x67cf bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4641047 (4608 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (304s) == sanity-benchmark test complete, duration 2171 sec ===== 10:40:12 (1734018012) === sanity-benchmark: start cleanup 10:40:12 (1734018012) === === sanity-benchmark: finish cleanup 10:40:13 (1734018013) ===