-----============= acceptance-small: sanity-benchmark ============----- Tue Jun 4 23:04:33 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 23:04:37 (1717556677) === oleg153-client.virtnet: executing check_config_client /mnt/lustre oleg153-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg153-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b592a800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b592a800.idle_timeout=debug disable quota as required oleg153-server: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 23:04:42 (1717556682) === == sanity-benchmark test dbench: dbench ================== 23:04:42 (1717556682) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6958] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg153-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg153-client.virtnet at Tue Jun 4 23:04:43 EDT 2024 waiting for dbench pid 8941 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 239 182.94 MB/sec warmup 1 sec latency 92.664 ms 20 475 166.02 MB/sec warmup 2 sec latency 56.578 ms 20 689 141.21 MB/sec warmup 3 sec latency 235.123 ms 20 796 107.32 MB/sec warmup 4 sec latency 118.072 ms 20 909 86.90 MB/sec warmup 5 sec latency 138.254 ms 20 1043 76.00 MB/sec warmup 6 sec latency 141.204 ms 20 1206 65.85 MB/sec warmup 7 sec latency 46.036 ms 20 1450 65.04 MB/sec warmup 8 sec latency 144.146 ms 20 1597 58.10 MB/sec warmup 9 sec latency 163.932 ms 20 1782 52.60 MB/sec warmup 10 sec latency 106.967 ms 20 1950 48.08 MB/sec warmup 11 sec latency 102.786 ms 20 2173 44.61 MB/sec warmup 12 sec latency 88.096 ms 20 2403 43.14 MB/sec warmup 13 sec latency 138.811 ms 20 2609 42.07 MB/sec warmup 14 sec latency 145.044 ms 20 2977 44.70 MB/sec warmup 15 sec latency 122.899 ms 20 3368 44.79 MB/sec warmup 16 sec latency 122.423 ms 20 3688 45.76 MB/sec warmup 17 sec latency 89.988 ms 20 3884 44.26 MB/sec warmup 18 sec latency 30.929 ms 20 4035 42.17 MB/sec warmup 19 sec latency 32.622 ms 20 4201 40.16 MB/sec warmup 20 sec latency 180.798 ms 20 4302 38.48 MB/sec warmup 21 sec latency 284.687 ms 20 4390 36.94 MB/sec warmup 22 sec latency 182.788 ms 20 4512 35.69 MB/sec warmup 23 sec latency 171.229 ms 20 4918 32.05 MB/sec execute 1 sec latency 158.605 ms 20 5112 31.39 MB/sec execute 2 sec latency 99.123 ms 20 5261 21.79 MB/sec execute 3 sec latency 107.942 ms 20 5392 16.90 MB/sec execute 4 sec latency 114.757 ms 20 5523 14.04 MB/sec execute 5 sec latency 94.602 ms 20 5720 13.14 MB/sec execute 6 sec latency 81.381 ms 20 5898 13.36 MB/sec execute 7 sec latency 126.769 ms 20 6061 14.68 MB/sec execute 8 sec latency 184.769 ms 20 6295 18.02 MB/sec execute 9 sec latency 159.489 ms 20 6581 21.29 MB/sec execute 10 sec latency 155.064 ms 20 6848 22.39 MB/sec execute 11 sec latency 239.194 ms 20 7088 24.38 MB/sec execute 12 sec latency 137.535 ms 20 7279 24.97 MB/sec execute 13 sec latency 42.678 ms 20 7413 24.13 MB/sec execute 14 sec latency 50.026 ms 20 7539 22.80 MB/sec execute 15 sec latency 37.294 ms 20 7657 21.47 MB/sec execute 16 sec latency 176.227 ms 20 7802 20.42 MB/sec execute 17 sec latency 178.541 ms 20 7882 19.50 MB/sec execute 18 sec latency 143.056 ms 20 7979 18.76 MB/sec execute 19 sec latency 154.165 ms 20 8090 18.27 MB/sec execute 20 sec latency 173.517 ms 20 8240 18.27 MB/sec execute 21 sec latency 130.052 ms 20 8470 18.84 MB/sec execute 22 sec latency 90.492 ms 20 8689 19.38 MB/sec execute 23 sec latency 81.402 ms 20 8887 18.71 MB/sec execute 24 sec latency 76.577 ms 20 9120 18.19 MB/sec execute 25 sec latency 58.380 ms 20 9393 18.11 MB/sec execute 26 sec latency 80.929 ms 20 9661 18.79 MB/sec execute 27 sec latency 116.694 ms 20 9993 20.32 MB/sec execute 28 sec latency 123.406 ms 20 10351 21.66 MB/sec execute 29 sec latency 126.319 ms 20 10676 22.66 MB/sec execute 30 sec latency 104.595 ms 20 10918 23.04 MB/sec execute 31 sec latency 28.275 ms 20 11105 22.65 MB/sec execute 32 sec latency 130.276 ms 20 11273 22.05 MB/sec execute 33 sec latency 125.810 ms 20 11405 21.53 MB/sec execute 34 sec latency 153.512 ms 20 11529 21.11 MB/sec execute 35 sec latency 163.243 ms 20 11701 20.99 MB/sec execute 36 sec latency 100.483 ms 20 11945 21.30 MB/sec execute 37 sec latency 119.562 ms 20 12207 21.78 MB/sec execute 38 sec latency 105.862 ms 20 12398 21.31 MB/sec execute 39 sec latency 64.340 ms 20 12637 20.91 MB/sec execute 40 sec latency 81.917 ms 20 12878 20.73 MB/sec execute 41 sec latency 148.729 ms 20 13145 20.97 MB/sec execute 42 sec latency 119.113 ms 20 13516 22.09 MB/sec execute 43 sec latency 108.198 ms 20 13897 22.88 MB/sec execute 44 sec latency 141.868 ms 20 14222 23.66 MB/sec execute 45 sec latency 121.047 ms 20 14471 23.87 MB/sec execute 46 sec latency 70.870 ms 20 14652 23.54 MB/sec execute 47 sec latency 154.172 ms 20 14837 23.13 MB/sec execute 48 sec latency 180.419 ms 20 14976 22.78 MB/sec execute 49 sec latency 172.374 ms 20 15119 22.55 MB/sec execute 50 sec latency 111.975 ms 20 15302 22.46 MB/sec execute 51 sec latency 114.752 ms 20 15576 22.79 MB/sec execute 52 sec latency 113.463 ms 20 15844 22.86 MB/sec execute 53 sec latency 99.612 ms 20 16126 22.55 MB/sec execute 54 sec latency 61.882 ms 20 16469 22.53 MB/sec execute 55 sec latency 66.643 ms 20 16815 22.94 MB/sec execute 56 sec latency 110.688 ms 20 17294 24.07 MB/sec execute 57 sec latency 113.493 ms 20 17742 24.85 MB/sec execute 58 sec latency 112.749 ms 20 18071 25.17 MB/sec execute 59 sec latency 138.640 ms 20 18306 24.85 MB/sec execute 60 sec latency 99.768 ms 20 18527 24.57 MB/sec execute 61 sec latency 126.789 ms 20 18754 24.41 MB/sec execute 62 sec latency 126.581 ms 20 19111 24.74 MB/sec execute 63 sec latency 92.373 ms 20 19432 24.92 MB/sec execute 64 sec latency 68.142 ms 20 19728 24.67 MB/sec execute 65 sec latency 56.883 ms 20 20079 24.56 MB/sec execute 66 sec latency 69.056 ms 20 20399 24.85 MB/sec execute 67 sec latency 108.824 ms 20 20889 25.88 MB/sec execute 68 sec latency 164.120 ms 20 21333 26.47 MB/sec execute 69 sec latency 130.582 ms 20 21623 26.63 MB/sec execute 70 sec latency 85.580 ms 20 21849 26.40 MB/sec execute 71 sec latency 131.560 ms 20 22098 26.17 MB/sec execute 72 sec latency 140.596 ms 20 22309 25.99 MB/sec execute 73 sec latency 136.345 ms 20 22594 26.00 MB/sec execute 74 sec latency 102.503 ms 20 22950 26.38 MB/sec execute 75 sec latency 70.058 ms 20 23229 26.18 MB/sec execute 76 sec latency 75.258 ms 20 23572 26.05 MB/sec execute 77 sec latency 64.296 ms 20 23919 26.19 MB/sec execute 78 sec latency 98.025 ms 20 24362 26.99 MB/sec execute 79 sec latency 129.217 ms 20 24803 27.35 MB/sec execute 80 sec latency 120.567 ms 20 25150 27.68 MB/sec execute 81 sec latency 96.656 ms 20 25378 27.54 MB/sec execute 82 sec latency 159.666 ms 20 25630 27.30 MB/sec execute 83 sec latency 109.849 ms 20 25796 27.13 MB/sec execute 84 sec latency 114.725 ms 20 26014 26.97 MB/sec execute 85 sec latency 85.927 ms 20 26333 27.13 MB/sec execute 86 sec latency 86.188 ms 20 26649 27.25 MB/sec execute 87 sec latency 70.225 ms 20 26898 27.05 MB/sec execute 88 sec latency 61.663 ms 20 27227 26.97 MB/sec execute 89 sec latency 94.416 ms 20 27533 27.11 MB/sec execute 90 sec latency 114.509 ms 20 27931 27.62 MB/sec execute 91 sec latency 124.011 ms 20 28331 27.86 MB/sec execute 92 sec latency 134.459 ms 20 28679 28.19 MB/sec execute 93 sec latency 120.696 ms 20 28898 28.08 MB/sec execute 94 sec latency 121.542 ms 20 29106 27.88 MB/sec execute 95 sec latency 95.679 ms 20 29318 27.71 MB/sec execute 96 sec latency 170.408 ms 20 29510 27.52 MB/sec execute 97 sec latency 117.708 ms 20 29758 27.52 MB/sec execute 98 sec latency 108.266 ms 20 30067 27.78 MB/sec execute 99 sec latency 114.526 ms 20 30262 27.59 MB/sec execute 100 sec latency 83.907 ms 20 30496 27.45 MB/sec execute 101 sec latency 89.062 ms 20 30764 27.33 MB/sec execute 102 sec latency 74.421 ms 20 31050 27.39 MB/sec execute 103 sec latency 101.991 ms 20 31315 27.48 MB/sec execute 104 sec latency 106.628 ms 20 31694 27.84 MB/sec execute 105 sec latency 119.695 ms 20 32021 27.99 MB/sec execute 106 sec latency 153.586 ms 20 32278 28.11 MB/sec execute 107 sec latency 125.213 ms 20 32477 28.03 MB/sec execute 108 sec latency 100.552 ms 20 32659 27.86 MB/sec execute 109 sec latency 102.053 ms 20 32856 27.65 MB/sec execute 110 sec latency 139.551 ms 20 33025 27.48 MB/sec execute 111 sec latency 116.865 ms 20 33245 27.41 MB/sec execute 112 sec latency 113.920 ms 20 33551 27.56 MB/sec execute 113 sec latency 100.939 ms 20 33830 27.61 MB/sec execute 114 sec latency 85.321 ms 20 34079 27.48 MB/sec execute 115 sec latency 87.959 ms 20 34374 27.41 MB/sec execute 116 sec latency 75.876 ms 20 34695 27.45 MB/sec execute 117 sec latency 123.512 ms 20 35040 27.75 MB/sec execute 118 sec latency 141.888 ms 20 35418 27.96 MB/sec execute 119 sec latency 157.367 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 106653 11.222 57.777 Close 78844 2.884 23.666 Rename 4538 14.731 55.187 Unlink 21054 4.157 31.145 Qpathinfo 97204 2.568 38.909 Qfileinfo 17202 0.072 9.640 Qfsinfo 17684 0.030 9.125 Sfileinfo 8610 7.780 34.678 Find 37716 0.419 35.826 WriteX 52908 0.919 23.655 ReadX 170866 0.012 3.342 LockX 360 3.447 13.039 UnlockX 360 3.516 14.342 Flush 7321 58.743 239.188 Throughput 27.9559 MB/sec 20 clients 20 procs max_latency=239.194 ms stopping dbench on /mnt/lustre/d0.oleg153-client.virtnet at Tue Jun 4 23:07:08 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg153-client.virtnet /mnt/lustre/d0.oleg153-client.virtnet /mnt/lustre/d0.oleg153-client.virtnet removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg153-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) == sanity-benchmark test bonnie: bonnie++ ================ 23:07:11 (1717556831) min OST has 3072000kB available, using 4608000kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6958] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4500] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg153-clien 4500M 152607 92 106753 69 236549 44 1347 153 Latency 14172us 362ms 96948us 156ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg153-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 284 19 6988 31 511 13 402 17 1319 13 686 12 Latency 16950us 15166us 63163us 17606us 3226us 15673us 1.97,1.97,oleg153-client.virtnet,1,1717563765,4500M,,,,152607,92,106753,69,,,236549,44,1347,153,10,,,,,284,19,6988,31,511,13,402,17,1319,13,686,12,,14172us,362ms,,96948us,156ms,16950us,15166us,63163us,17606us,3226us,15673us debug=0x33f0484 PASS bonnie (211s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 23:10:43 (1717557043) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 6611 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 6611 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x28ca94 truncating to largest ever: 0x54a7e5 truncating to largest ever: 0x54f433 truncating to largest ever: 0x5524c1 001000 1717557076.264421 read 0x000b3d thru 0x00358e (0x2a52 bytes) truncating to largest ever: 0x552865 truncating to largest ever: 0x557b43 truncating to largest ever: 0x559647 006000 1717557092.348085 mapread 0x0633a9 thru 0x068e7f (0x5ad7 bytes) 007000 1717557095.215650 read 0x17ba20 thru 0x180062 (0x4643 bytes) truncating to largest ever: 0x55e0aa truncating to largest ever: 0x55e46e 009000 1717557101.574160 read 0x14cbe4 thru 0x153ff9 (0x7416 bytes) 010000 1717557104.489836 write 0x2f9fde thru 0x2fadbd (0xde0 bytes) truncating to largest ever: 0x560339 013000 1717557115.134004 trunc from 0x3c9acf to 0x20ee12 (0x1bacbc bytes) truncating to largest ever: 0x560632 016000 1717557124.263366 trunc from 0x19a235 to 0x1828d9 (0x1795b bytes) truncating to largest ever: 0x5629e3 019000 1717557134.964110 read 0x422131 thru 0x4236fb (0x15cb bytes) 020000 1717557137.845649 write 0x39cf8b thru 0x3a8555 (0xb5cb bytes) 022000 1717557143.868184 mapread 0x216519 thru 0x2196f5 (0x31dd bytes) 024000 1717557149.865079 mapwrite 0x0257eb thru 0x033d0c (0xe522 bytes) 026000 1717557155.126988 read 0x2c2ad1 thru 0x2cb414 (0x8944 bytes) 027000 1717557157.950019 trunc from 0x2fdccf to 0x34c4a6 (0x4e7d8 bytes) 029000 1717557164.115360 mapread 0x1c4360 thru 0x1ce56e (0xa20f bytes) 030000 1717557166.680481 trunc from 0x4daa25 to 0x50bae5 (0x310c1 bytes) 031000 1717557169.477916 mapread 0x1bc2ef thru 0x1c12ed (0x4fff bytes) 032000 1717557172.847103 read 0x13ecb6 thru 0x14c432 (0xd77d bytes) 038000 1717557189.872980 write 0x124458 thru 0x12cc4c (0x87f5 bytes) 041000 1717557198.243862 trunc from 0x348712 to 0x242ca9 (0x105a68 bytes) 042000 1717557200.782159 trunc from 0x19b4b8 to 0x3b9f67 (0x21eab0 bytes) 043000 1717557203.559180 write 0x20dc5d thru 0x219a33 (0xbdd7 bytes) 045000 1717557209.348210 trunc from 0x0fb863 to 0x51c64e (0x420dec bytes) 051000 1717557227.960916 read 0x11a887 thru 0x12112d (0x68a7 bytes) 052000 1717557230.878802 write 0x0146b1 thru 0x01923e (0x4b8e bytes) 053000 1717557233.509584 mapwrite 0x3f5bb8 thru 0x4055b0 (0xf9f9 bytes) 057000 1717557244.681996 write 0x3943bb thru 0x397d17 (0x395d bytes) 061000 1717557256.119897 trunc from 0x514a66 to 0x141730 (0x3d3335 bytes) 062000 1717557259.891308 read 0x3648b5 thru 0x364d4c (0x498 bytes) 068000 1717557278.334905 read 0x0f6678 thru 0x0fcddd (0x6766 bytes) 070000 1717557284.135932 write 0x2ad304 thru 0x2b4352 (0x704f bytes) truncating to largest ever: 0x562bed 071000 1717557287.160085 read 0x167ec5 thru 0x16e475 (0x65b1 bytes) 072000 1717557289.990902 write 0x2c52ea thru 0x2d1104 (0xbe1b bytes) 074000 1717557295.967917 mapread 0x3431db thru 0x34fd1d (0xcb43 bytes) 076000 1717557301.630135 trunc from 0x3ebd5f to 0x02e356 (0x3bda08 bytes) 077000 1717557304.789305 mapwrite 0x3e3f60 thru 0x3ef8c3 (0xb964 bytes) 078000 1717557307.689119 mapread 0x18d77e thru 0x1930d8 (0x595b bytes) 079000 1717557310.590223 read 0x0db69f thru 0x0e9503 (0xde65 bytes) 080000 1717557313.623654 trunc from 0x290538 to 0x369875 (0xd933e bytes) 081000 1717557316.730785 mapread 0x16f671 thru 0x17236f (0x2cff bytes) 084000 1717557325.911299 trunc from 0x543671 to 0x01e332 (0x52533e bytes) 086000 1717557331.954219 trunc from 0x228ee1 to 0x104442 (0x124a9e bytes) 088000 1717557338.134226 write 0x522706 thru 0x52d326 (0xac21 bytes) 089000 1717557341.075861 trunc from 0x18eae8 to 0x3b8431 (0x22994a bytes) 090000 1717557344.217217 trunc from 0x435444 to 0x3caf5f (0x6a4e4 bytes) 092000 1717557349.809713 read 0x2bd652 thru 0x2c6e49 (0x97f8 bytes) 094000 1717557355.656558 mapread 0x2154c7 thru 0x21745e (0x1f98 bytes) 095000 1717557358.462040 read 0x16b97b thru 0x178d89 (0xd40f bytes) 097000 1717557363.906409 mapread 0x12f6a2 thru 0x1386b4 (0x9013 bytes) 099000 1717557369.413858 write 0x413c85 thru 0x417507 (0x3883 bytes) 100000 1717557371.876954 trunc from 0x518fb0 to 0x4437d4 (0xd57db bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (329s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 23:16:12 (1717557372) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1717557381.028821 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1717557386.804091 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1717557389.835914 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1717557401.585159 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1717557404.383501 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1717557415.750808 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1717557418.419464 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1717557423.900643 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1717557430.131766 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1717557433.341670 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1717557438.806929 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1717557441.970110 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1717557453.592301 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1717557458.988100 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1717557467.931044 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1717557476.843913 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1717557479.583212 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1717557491.880290 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1717557495.430058 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1717557504.453781 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1717557507.491984 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1717557510.622378 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1717557518.995969 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1717557524.600701 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1717557530.319707 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1717557533.418645 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1717557562.977814 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1717557571.299781 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1717557574.459994 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1717557577.197718 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1717557580.235649 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1717557589.774186 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1717557592.561360 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1717557601.858305 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1717557605.118742 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1717557613.306588 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1717557621.761967 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1717557624.766267 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1717557632.829216 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1717557646.937864 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1717557649.608062 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1717557655.189522 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1717557660.951729 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (292s) == sanity-benchmark test complete, duration 991 sec ====== 23:21:04 (1717557664) === sanity-benchmark: start cleanup 23:21:05 (1717557665) === === sanity-benchmark: finish cleanup 23:21:05 (1717557665) ===