-----============= acceptance-small: sanity-benchmark ============----- Sun Nov 24 01:11:04 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 01:11:08 (1732428668) === oleg313-client.virtnet: executing check_config_client /mnt/lustre oleg313-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg313-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a656800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a656800.idle_timeout=debug disable quota as required oleg313-server: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 01:11:16 (1732428676) === == sanity-benchmark test dbench: dbench ================== 01:11:16 (1732428676) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6977] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg313-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg313-client.virtnet at Sun Nov 24 01:11:17 EST 2024 waiting for dbench pid 9443 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 216 168.10 MB/sec warmup 1 sec latency 77.849 ms 20 436 153.76 MB/sec warmup 2 sec latency 46.396 ms 20 673 141.10 MB/sec warmup 3 sec latency 230.603 ms 20 810 107.38 MB/sec warmup 4 sec latency 85.476 ms 20 993 88.08 MB/sec warmup 5 sec latency 99.318 ms 20 1250 77.41 MB/sec warmup 6 sec latency 33.457 ms 20 1543 74.56 MB/sec warmup 7 sec latency 100.716 ms 20 1823 65.84 MB/sec warmup 8 sec latency 66.620 ms 20 2122 59.27 MB/sec warmup 9 sec latency 58.326 ms 20 2428 56.19 MB/sec warmup 10 sec latency 79.481 ms 20 2878 59.48 MB/sec warmup 11 sec latency 106.222 ms 20 3397 60.03 MB/sec warmup 12 sec latency 100.097 ms 20 3804 61.19 MB/sec warmup 13 sec latency 27.829 ms 20 4046 57.25 MB/sec warmup 14 sec latency 20.581 ms 20 4277 53.78 MB/sec warmup 15 sec latency 211.549 ms 20 4480 51.05 MB/sec warmup 16 sec latency 113.431 ms 20 4786 49.95 MB/sec warmup 17 sec latency 70.391 ms 20 5125 50.25 MB/sec warmup 18 sec latency 53.509 ms 20 5353 47.81 MB/sec warmup 19 sec latency 50.465 ms 20 5627 45.71 MB/sec warmup 20 sec latency 71.277 ms 20 5909 44.70 MB/sec warmup 21 sec latency 90.595 ms 20 6153 44.36 MB/sec warmup 22 sec latency 124.452 ms 20 6645 46.18 MB/sec warmup 23 sec latency 111.803 ms 20 7417 27.28 MB/sec execute 1 sec latency 78.241 ms 20 7655 15.91 MB/sec execute 2 sec latency 98.885 ms 20 7850 12.68 MB/sec execute 3 sec latency 182.537 ms 20 8038 11.79 MB/sec execute 4 sec latency 76.214 ms 20 8326 14.64 MB/sec execute 5 sec latency 74.993 ms 20 8651 22.30 MB/sec execute 6 sec latency 73.365 ms 20 8888 19.71 MB/sec execute 7 sec latency 59.981 ms 20 9171 18.01 MB/sec execute 8 sec latency 57.682 ms 20 9482 18.99 MB/sec execute 9 sec latency 84.244 ms 20 9820 23.16 MB/sec execute 10 sec latency 129.371 ms 20 10299 27.38 MB/sec execute 11 sec latency 158.586 ms 20 10734 32.15 MB/sec execute 12 sec latency 57.484 ms 20 10983 31.47 MB/sec execute 13 sec latency 24.642 ms 20 11204 29.57 MB/sec execute 14 sec latency 103.570 ms 20 11394 28.04 MB/sec execute 15 sec latency 157.157 ms 20 11595 26.91 MB/sec execute 16 sec latency 72.019 ms 20 11915 27.65 MB/sec execute 17 sec latency 81.525 ms 20 12212 28.69 MB/sec execute 18 sec latency 63.612 ms 20 12438 27.38 MB/sec execute 19 sec latency 55.731 ms 20 12699 26.27 MB/sec execute 20 sec latency 61.993 ms 20 12995 26.08 MB/sec execute 21 sec latency 62.555 ms 20 13308 27.20 MB/sec execute 22 sec latency 89.987 ms 20 13848 29.76 MB/sec execute 23 sec latency 90.636 ms 20 14280 31.97 MB/sec execute 24 sec latency 70.081 ms 20 14536 31.69 MB/sec execute 25 sec latency 20.739 ms 20 14743 30.62 MB/sec execute 26 sec latency 112.923 ms 20 14946 29.73 MB/sec execute 27 sec latency 201.467 ms 20 15162 29.11 MB/sec execute 28 sec latency 88.192 ms 20 15501 29.71 MB/sec execute 29 sec latency 67.770 ms 20 15798 29.98 MB/sec execute 30 sec latency 72.919 ms 20 16024 29.14 MB/sec execute 31 sec latency 80.199 ms 20 16328 28.48 MB/sec execute 32 sec latency 44.373 ms 20 16668 28.73 MB/sec execute 33 sec latency 94.995 ms 20 17189 30.88 MB/sec execute 34 sec latency 87.472 ms 20 17739 32.54 MB/sec execute 35 sec latency 102.033 ms 20 18035 32.58 MB/sec execute 36 sec latency 22.766 ms 20 18272 31.85 MB/sec execute 37 sec latency 131.688 ms 20 18495 31.20 MB/sec execute 38 sec latency 117.469 ms 20 18718 30.73 MB/sec execute 39 sec latency 96.855 ms 20 19063 31.13 MB/sec execute 40 sec latency 77.349 ms 20 19360 31.27 MB/sec execute 41 sec latency 78.424 ms 20 19610 30.62 MB/sec execute 42 sec latency 50.702 ms 20 19922 30.10 MB/sec execute 43 sec latency 54.264 ms 20 20223 30.09 MB/sec execute 44 sec latency 96.120 ms 20 20673 31.53 MB/sec execute 45 sec latency 108.282 ms 20 21226 32.53 MB/sec execute 46 sec latency 111.068 ms 20 21567 33.00 MB/sec execute 47 sec latency 34.644 ms 20 21823 32.53 MB/sec execute 48 sec latency 19.675 ms 20 22029 31.97 MB/sec execute 49 sec latency 156.129 ms 20 22217 31.52 MB/sec execute 50 sec latency 104.743 ms 20 22503 31.53 MB/sec execute 51 sec latency 81.199 ms 20 22842 32.00 MB/sec execute 52 sec latency 63.932 ms 20 23083 31.47 MB/sec execute 53 sec latency 45.326 ms 20 23353 30.99 MB/sec execute 54 sec latency 44.496 ms 20 23662 30.82 MB/sec execute 55 sec latency 65.506 ms 20 24035 31.45 MB/sec execute 56 sec latency 92.215 ms 20 24557 32.30 MB/sec execute 57 sec latency 93.643 ms 20 25012 33.14 MB/sec execute 58 sec latency 108.009 ms 20 25280 32.93 MB/sec execute 59 sec latency 19.158 ms 20 25517 32.45 MB/sec execute 60 sec latency 179.805 ms 20 25728 32.07 MB/sec execute 61 sec latency 122.374 ms 20 25976 31.89 MB/sec execute 62 sec latency 83.109 ms 20 26332 32.42 MB/sec execute 63 sec latency 59.253 ms 20 26567 32.02 MB/sec execute 64 sec latency 51.813 ms 20 26815 31.60 MB/sec execute 65 sec latency 51.940 ms 20 27103 31.31 MB/sec execute 66 sec latency 52.892 ms 20 27407 31.40 MB/sec execute 67 sec latency 102.692 ms 20 27913 32.32 MB/sec execute 68 sec latency 98.045 ms 20 28375 32.97 MB/sec execute 69 sec latency 78.453 ms 20 28660 33.06 MB/sec execute 70 sec latency 24.846 ms 20 28884 32.77 MB/sec execute 71 sec latency 39.689 ms 20 29096 32.36 MB/sec execute 72 sec latency 217.966 ms 20 29285 32.06 MB/sec execute 73 sec latency 100.819 ms 20 29558 32.00 MB/sec execute 74 sec latency 81.610 ms 20 29864 32.20 MB/sec execute 75 sec latency 48.188 ms 20 30093 31.99 MB/sec execute 76 sec latency 53.016 ms 20 30323 31.63 MB/sec execute 77 sec latency 44.854 ms 20 30608 31.36 MB/sec execute 78 sec latency 42.248 ms 20 30938 31.46 MB/sec execute 79 sec latency 101.273 ms 20 31421 32.23 MB/sec execute 80 sec latency 103.784 ms 20 31919 32.79 MB/sec execute 81 sec latency 87.079 ms 20 32226 32.93 MB/sec execute 82 sec latency 22.010 ms 20 32440 32.64 MB/sec execute 83 sec latency 157.507 ms 20 32676 32.31 MB/sec execute 84 sec latency 132.062 ms 20 32870 32.06 MB/sec execute 85 sec latency 95.443 ms 20 33152 32.04 MB/sec execute 86 sec latency 66.690 ms 20 33483 32.31 MB/sec execute 87 sec latency 54.363 ms 20 33722 31.99 MB/sec execute 88 sec latency 61.172 ms 20 33994 31.70 MB/sec execute 89 sec latency 46.924 ms 20 34293 31.57 MB/sec execute 90 sec latency 92.831 ms 20 34618 31.79 MB/sec execute 91 sec latency 101.842 ms 20 35141 32.41 MB/sec execute 92 sec latency 88.119 ms 20 35612 32.96 MB/sec execute 93 sec latency 72.010 ms 20 35860 32.85 MB/sec execute 94 sec latency 21.716 ms 20 36069 32.55 MB/sec execute 95 sec latency 97.114 ms 20 36284 32.29 MB/sec execute 96 sec latency 98.847 ms 20 36498 32.10 MB/sec execute 97 sec latency 90.483 ms 20 36805 32.13 MB/sec execute 98 sec latency 67.780 ms 20 37111 32.27 MB/sec execute 99 sec latency 65.682 ms 20 37353 31.99 MB/sec execute 100 sec latency 58.045 ms 20 37622 31.75 MB/sec execute 101 sec latency 66.045 ms 20 37969 31.81 MB/sec execute 102 sec latency 71.844 ms 20 38404 32.31 MB/sec execute 103 sec latency 114.175 ms 20 38919 32.70 MB/sec execute 104 sec latency 89.365 ms 20 39287 32.97 MB/sec execute 105 sec latency 45.962 ms 20 39527 32.77 MB/sec execute 106 sec latency 159.757 ms 20 39782 32.52 MB/sec execute 107 sec latency 77.206 ms 20 39994 32.33 MB/sec execute 108 sec latency 111.362 ms 20 40302 32.33 MB/sec execute 109 sec latency 74.412 ms 20 40651 32.52 MB/sec execute 110 sec latency 60.832 ms 20 40926 32.27 MB/sec execute 111 sec latency 45.825 ms 20 41262 32.09 MB/sec execute 112 sec latency 40.275 ms 20 41634 32.21 MB/sec execute 113 sec latency 81.847 ms 20 42200 32.85 MB/sec execute 114 sec latency 98.517 ms 20 42713 33.30 MB/sec execute 115 sec latency 73.411 ms 20 42990 33.22 MB/sec execute 116 sec latency 137.552 ms 20 43231 32.98 MB/sec execute 117 sec latency 171.187 ms 20 43458 32.79 MB/sec execute 118 sec latency 84.029 ms 20 43751 32.78 MB/sec execute 119 sec latency 77.509 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 129138 9.921 42.791 Close 94367 1.836 18.220 Rename 5467 13.961 53.133 Unlink 26539 3.002 23.030 Qpathinfo 116178 2.401 30.457 Qfileinfo 19941 0.067 5.852 Qfsinfo 21388 0.021 4.353 Sfileinfo 10680 8.010 26.178 Find 44585 0.400 34.317 WriteX 63131 0.693 18.023 ReadX 198354 0.010 4.401 LockX 400 2.403 10.714 UnlockX 400 2.480 8.797 Flush 9096 38.901 217.959 Throughput 32.7811 MB/sec 20 clients 20 procs max_latency=217.966 ms stopping dbench on /mnt/lustre/d0.oleg313-client.virtnet at Sun Nov 24 01:13:41 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg313-client.virtnet /mnt/lustre/d0.oleg313-client.virtnet /mnt/lustre/d0.oleg313-client.virtnet removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg313-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 01:13:44 (1732428824) min OST has 3387392kB available, using 5081088kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6977] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4962] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg313-clien 4962M 164083 99 151015 96 423293 81 2354 145 Latency 2114us 23958us 29413us 155ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg313-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 477 17 8014 34 622 11 453 16 1064 13 599 11 Latency 16396us 13297us 49730us 14559us 2912us 13759us 1.97,1.97,oleg313-client.virtnet,1,1732439307,4962M,,,,164083,99,151015,96,,,423293,81,2354,145,10,,,,,477,17,8014,34,622,11,453,16,1064,13,599,11,,2114us,23958us,,29413us,155ms,16396us,13297us,49730us,14559us,2912us,13759us debug=0x33f0484 PASS bonnie (175s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 01:16:39 (1732428999) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 32392 -P /tmp -l 5646336 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 32392 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x25d522 truncating to largest ever: 0x28baf0 truncating to largest ever: 0x317b93 truncating to largest ever: 0x4a25ac truncating to largest ever: 0x4af1e1 truncating to largest ever: 0x531b18 truncating to largest ever: 0x548817 002000 1732429006.328224 mapread 0x1b23f9 thru 0x1bf4b0 (0xd0b8 bytes) truncating to largest ever: 0x551ee2 truncating to largest ever: 0x557f3d truncating to largest ever: 0x55cf8f truncating to largest ever: 0x560141 006000 1732429016.590610 mapwrite 0x52cfaa thru 0x538e69 (0xbec0 bytes) 007000 1732429019.319226 read 0x28a1f6 thru 0x2911d9 (0x6fe4 bytes) 008000 1732429022.015972 read 0x226a82 thru 0x228483 (0x1a02 bytes) 010000 1732429027.092377 mapread 0x00383e thru 0x00b45f (0x7c22 bytes) truncating to largest ever: 0x560382 015000 1732429040.153622 read 0x1daa32 thru 0x1dfe2d (0x53fc bytes) truncating to largest ever: 0x5605fe 018000 1732429047.825911 write 0x0b81e0 thru 0x0c6f46 (0xed67 bytes) 022000 1732429058.050547 trunc from 0x40509b to 0x3aa3ef (0x5acab bytes) skipping zero size write 023000 1732429060.712064 mapwrite 0x0a606d thru 0x0a80cb (0x205f bytes) 025000 1732429065.825724 mapread 0x384368 thru 0x392fa4 (0xec3d bytes) truncating to largest ever: 0x5623b0 030000 1732429079.517562 read 0x1fbd96 thru 0x1fd6f6 (0x1961 bytes) 032000 1732429084.755333 write 0x085953 thru 0x0893dd (0x3a8b bytes) 033000 1732429086.970838 mapwrite 0x36cd60 thru 0x36eb21 (0x1dc2 bytes) 034000 1732429089.335635 mapwrite 0x326510 thru 0x327b36 (0x1627 bytes) 035000 1732429091.894491 read 0x15806b thru 0x165d77 (0xdd0d bytes) 037000 1732429097.618426 trunc from 0x3f33f3 to 0x26cc6c (0x186786 bytes) 038000 1732429100.392547 mapread 0x0dd691 thru 0x0e4ce5 (0x7655 bytes) skipping zero size read 040000 1732429105.591238 trunc from 0x3fe1b1 to 0x14bfac (0x2b2204 bytes) 044000 1732429115.958423 mapread 0x19c647 thru 0x1a3985 (0x733f bytes) skipping zero size read 047000 1732429124.311127 mapwrite 0x43307d thru 0x43e3da (0xb35e bytes) 049000 1732429129.053533 mapwrite 0x2b63a4 thru 0x2c2190 (0xbded bytes) 050000 1732429131.544212 read 0x265b4b thru 0x26a354 (0x480a bytes) truncating to largest ever: 0x562509 051000 1732429134.221293 trunc from 0x1871d5 to 0x503bff (0x37ca2b bytes) 054000 1732429142.022948 mapread 0x0c7099 thru 0x0d6e0c (0xfd74 bytes) skipping zero size write 055000 1732429144.596023 mapwrite 0x3ccbd4 thru 0x3d3d32 (0x715f bytes) 056000 1732429147.310909 mapwrite 0x0240d0 thru 0x02b0e4 (0x7015 bytes) 057000 1732429149.544843 read 0x0067ee thru 0x00bf5b (0x576e bytes) 058000 1732429152.136692 trunc from 0x351a99 to 0x005673 (0x34c425 bytes) 060000 1732429157.528206 trunc from 0x412829 to 0x07b06a (0x3977be bytes) 061000 1732429160.290164 mapread 0x0886de thru 0x0961db (0xdafe bytes) 062000 1732429162.985319 read 0x5221b9 thru 0x528c33 (0x6a7b bytes) 064000 1732429168.244441 mapread 0x050bbe thru 0x05a5f5 (0x9a38 bytes) 065000 1732429171.039477 trunc from 0x4a339d to 0x079c30 (0x42976c bytes) 068000 1732429179.497693 mapread 0x20e1e2 thru 0x219be1 (0xba00 bytes) 071000 1732429186.827955 write 0x4f8167 thru 0x5060b7 (0xdf51 bytes) 073000 1732429192.273818 write 0x28d1e7 thru 0x2992c2 (0xc0dc bytes) 074000 1732429195.129385 mapwrite 0x11a36b thru 0x1259f6 (0xb68c bytes) 076000 1732429200.158635 write 0x4a1955 thru 0x4b17fa (0xfea6 bytes) 080000 1732429211.554247 write 0x4d5406 thru 0x4d806a (0x2c65 bytes) 081000 1732429214.179343 mapwrite 0x4f451f thru 0x5025bc (0xe09e bytes) 082000 1732429216.833761 mapread 0x21646a thru 0x217257 (0xdee bytes) 083000 1732429219.534350 read 0x3e4718 thru 0x3f3069 (0xe952 bytes) 086000 1732429227.964024 mapwrite 0x52c11c thru 0x52f3a3 (0x3288 bytes) 087000 1732429230.428092 trunc from 0x51a2d6 to 0x50ad25 (0xf5b0 bytes) 090000 1732429238.665403 trunc from 0x0a1475 to 0x44fbb7 (0x3ae743 bytes) 092000 1732429244.597439 write 0x1aba84 thru 0x1b689b (0xae18 bytes) 093000 1732429247.217082 mapwrite 0x2085df thru 0x2101ce (0x7bf0 bytes) 095000 1732429252.379337 read 0x267630 thru 0x275b4b (0xe51c bytes) 096000 1732429254.993336 write 0x32869f thru 0x3343ca (0xbd2c bytes) 099000 1732429263.171884 mapwrite 0x4cc221 thru 0x4ccda2 (0xb82 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (267s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 01:21:06 (1732429266) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1732429276.148380 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1732429283.183706 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1732429286.495319 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1732429299.490559 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1732429302.468543 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1732429314.123844 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1732429317.012178 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1732429323.000963 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1732429329.629425 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1732429332.693269 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1732429338.764569 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1732429342.141528 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1732429354.459353 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1732429360.187386 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1732429369.788919 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1732429379.393916 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1732429382.441563 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1732429395.649566 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1732429399.330844 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1732429409.042913 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1732429412.035543 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1732429415.379546 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1732429424.236237 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1732429430.135838 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1732429436.432773 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1732429439.811939 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1732429471.014261 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1732429479.878931 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1732429483.414367 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1732429487.299414 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1732429491.288458 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1732429502.984195 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1732429506.138734 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1732429515.960299 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1732429519.478968 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1732429528.834065 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1732429539.259438 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1732429542.609607 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1732429552.096456 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1732429566.942136 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1732429569.663894 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1732429575.733977 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1732429582.037875 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (320s) == sanity-benchmark test complete, duration 922 sec ====== 01:26:26 (1732429586) === sanity-benchmark: start cleanup 01:26:27 (1732429587) === === sanity-benchmark: finish cleanup 01:26:27 (1732429587) ===