-----============= acceptance-small: sanity-benchmark ============----- Fri Sep 20 13:18:59 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 13:19:06 (1726852746) === oleg101-client.virtnet: executing check_config_client /mnt/lustre oleg101-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg101-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5c32800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5c32800.idle_timeout=debug disable quota as required oleg101-server: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 13:19:15 (1726852755) === == sanity-benchmark test dbench: dbench ================== 13:19:15 (1726852755) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7735] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg101-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg101-client.virtnet at Fri Sep 20 13:19:16 EDT 2024 waiting for dbench pid 9851 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 161 134.56 MB/sec warmup 1 sec latency 97.830 ms 20 355 127.46 MB/sec warmup 2 sec latency 50.514 ms 20 555 126.10 MB/sec warmup 3 sec latency 133.513 ms 20 728 106.43 MB/sec warmup 4 sec latency 237.599 ms 20 814 85.97 MB/sec warmup 5 sec latency 132.394 ms 20 918 72.43 MB/sec warmup 6 sec latency 181.875 ms 20 1046 64.69 MB/sec warmup 7 sec latency 164.456 ms 20 1174 57.53 MB/sec warmup 8 sec latency 63.194 ms 20 1376 56.17 MB/sec warmup 9 sec latency 94.228 ms 20 1512 52.11 MB/sec warmup 10 sec latency 162.783 ms 20 1646 47.59 MB/sec warmup 11 sec latency 142.776 ms 20 1788 43.81 MB/sec warmup 12 sec latency 142.023 ms 20 1927 40.65 MB/sec warmup 13 sec latency 125.302 ms 20 2102 38.07 MB/sec warmup 14 sec latency 106.312 ms 20 2288 36.38 MB/sec warmup 15 sec latency 140.615 ms 20 2456 35.35 MB/sec warmup 16 sec latency 120.402 ms 20 2818 38.04 MB/sec warmup 17 sec latency 114.308 ms 20 3195 38.19 MB/sec warmup 18 sec latency 133.440 ms 20 3444 38.31 MB/sec warmup 19 sec latency 154.660 ms 20 3708 38.97 MB/sec warmup 20 sec latency 40.566 ms 20 3864 37.93 MB/sec warmup 21 sec latency 40.519 ms 20 4037 36.41 MB/sec warmup 22 sec latency 29.166 ms 20 4197 34.91 MB/sec warmup 23 sec latency 189.741 ms 20 4398 4.58 MB/sec execute 1 sec latency 173.039 ms 20 4520 6.49 MB/sec execute 2 sec latency 154.227 ms 20 4713 11.25 MB/sec execute 3 sec latency 136.481 ms 20 4927 17.38 MB/sec execute 4 sec latency 68.562 ms 20 5129 19.22 MB/sec execute 5 sec latency 96.874 ms 20 5248 16.38 MB/sec execute 6 sec latency 137.536 ms 20 5390 14.38 MB/sec execute 7 sec latency 111.660 ms 20 5485 12.76 MB/sec execute 8 sec latency 194.142 ms 20 5587 11.59 MB/sec execute 9 sec latency 210.056 ms 20 5726 11.02 MB/sec execute 10 sec latency 80.559 ms 20 5878 11.36 MB/sec execute 11 sec latency 257.707 ms 20 6028 11.72 MB/sec execute 12 sec latency 174.570 ms 20 6255 14.00 MB/sec execute 13 sec latency 154.878 ms 20 6497 17.06 MB/sec execute 14 sec latency 196.936 ms 20 6783 17.63 MB/sec execute 15 sec latency 181.039 ms 20 7034 19.78 MB/sec execute 16 sec latency 107.762 ms 20 7233 20.74 MB/sec execute 17 sec latency 48.857 ms 20 7397 20.58 MB/sec execute 18 sec latency 38.674 ms 20 7521 19.73 MB/sec execute 19 sec latency 64.357 ms 20 7647 18.79 MB/sec execute 20 sec latency 56.529 ms 20 7740 17.96 MB/sec execute 21 sec latency 214.240 ms 20 7828 17.31 MB/sec execute 22 sec latency 223.908 ms 20 7920 16.76 MB/sec execute 23 sec latency 127.834 ms 20 7984 16.19 MB/sec execute 24 sec latency 172.168 ms 20 8082 15.94 MB/sec execute 25 sec latency 229.408 ms 20 8192 15.68 MB/sec execute 26 sec latency 233.971 ms 20 8351 16.09 MB/sec execute 27 sec latency 54.333 ms 20 8564 17.03 MB/sec execute 28 sec latency 122.108 ms 20 8679 16.50 MB/sec execute 29 sec latency 170.748 ms 20 8808 16.02 MB/sec execute 30 sec latency 95.405 ms 20 8908 15.56 MB/sec execute 31 sec latency 137.691 ms 20 9001 15.12 MB/sec execute 32 sec latency 163.319 ms 20 9138 14.75 MB/sec execute 33 sec latency 158.190 ms 20 9217 14.39 MB/sec execute 34 sec latency 69.373 ms 20 9349 14.28 MB/sec execute 35 sec latency 235.512 ms 20 9441 14.10 MB/sec execute 36 sec latency 196.477 ms 20 9525 14.07 MB/sec execute 37 sec latency 227.236 ms 20 9595 13.84 MB/sec execute 38 sec latency 409.603 ms 20 9720 14.28 MB/sec execute 39 sec latency 239.424 ms 20 9964 15.26 MB/sec execute 40 sec latency 174.527 ms 20 10080 15.15 MB/sec execute 41 sec latency 468.512 ms 20 10253 15.32 MB/sec execute 42 sec latency 211.932 ms 20 10445 15.68 MB/sec execute 43 sec latency 188.907 ms 20 10585 15.93 MB/sec execute 44 sec latency 197.001 ms 20 10706 16.17 MB/sec execute 45 sec latency 149.624 ms 20 10797 16.04 MB/sec execute 46 sec latency 72.113 ms 20 10887 15.89 MB/sec execute 47 sec latency 70.208 ms 20 10992 15.71 MB/sec execute 48 sec latency 54.904 ms 20 11062 15.44 MB/sec execute 49 sec latency 84.096 ms 20 11146 15.15 MB/sec execute 50 sec latency 74.198 ms 20 11227 14.88 MB/sec execute 51 sec latency 242.396 ms 20 11321 14.63 MB/sec execute 52 sec latency 232.833 ms 20 11390 14.41 MB/sec execute 53 sec latency 164.691 ms 20 11447 14.20 MB/sec execute 54 sec latency 218.770 ms 20 11544 14.03 MB/sec execute 55 sec latency 113.508 ms 20 11663 14.01 MB/sec execute 56 sec latency 148.273 ms 20 11776 13.99 MB/sec execute 57 sec latency 254.885 ms 20 11918 14.13 MB/sec execute 58 sec latency 67.435 ms 20 12038 14.11 MB/sec execute 59 sec latency 192.845 ms 20 12211 14.34 MB/sec execute 60 sec latency 134.009 ms 20 12344 14.14 MB/sec execute 61 sec latency 109.903 ms 20 12469 13.95 MB/sec execute 62 sec latency 128.693 ms 20 12592 13.76 MB/sec execute 63 sec latency 163.271 ms 20 12755 13.62 MB/sec execute 64 sec latency 129.570 ms 20 12924 13.61 MB/sec execute 65 sec latency 152.606 ms 20 13089 13.70 MB/sec execute 66 sec latency 118.099 ms 20 13352 14.21 MB/sec execute 67 sec latency 118.453 ms 20 13627 14.72 MB/sec execute 68 sec latency 148.028 ms 20 13781 14.83 MB/sec execute 69 sec latency 247.196 ms 20 13989 15.05 MB/sec execute 70 sec latency 259.324 ms 20 14118 15.21 MB/sec execute 71 sec latency 434.337 ms 20 14276 15.43 MB/sec execute 72 sec latency 109.859 ms 20 14385 15.38 MB/sec execute 73 sec latency 73.014 ms 20 14466 15.32 MB/sec execute 74 sec latency 86.726 ms 20 14546 15.16 MB/sec execute 75 sec latency 78.501 ms 20 14620 14.99 MB/sec execute 76 sec latency 128.979 ms 20 14701 14.80 MB/sec execute 77 sec latency 208.712 ms 20 14782 14.63 MB/sec execute 78 sec latency 188.459 ms 20 14888 14.48 MB/sec execute 79 sec latency 256.335 ms 20 14946 14.33 MB/sec execute 80 sec latency 184.601 ms 20 15042 14.21 MB/sec execute 81 sec latency 140.108 ms 20 15112 14.09 MB/sec execute 82 sec latency 184.448 ms 20 15215 14.08 MB/sec execute 83 sec latency 166.449 ms 20 15340 14.05 MB/sec execute 84 sec latency 162.741 ms 20 15520 14.28 MB/sec execute 85 sec latency 92.134 ms 20 15688 14.42 MB/sec execute 86 sec latency 126.477 ms 20 15805 14.29 MB/sec execute 87 sec latency 139.307 ms 20 15900 14.15 MB/sec execute 88 sec latency 110.264 ms 20 16034 14.02 MB/sec execute 89 sec latency 114.397 ms 20 16188 13.90 MB/sec execute 90 sec latency 134.259 ms 20 16370 13.84 MB/sec execute 91 sec latency 85.449 ms 20 16564 13.88 MB/sec execute 92 sec latency 115.629 ms 20 16745 14.03 MB/sec execute 93 sec latency 129.562 ms 20 17000 14.41 MB/sec execute 94 sec latency 155.430 ms 20 17313 14.80 MB/sec execute 95 sec latency 115.133 ms 20 17583 15.07 MB/sec execute 96 sec latency 154.808 ms 20 17820 15.41 MB/sec execute 97 sec latency 100.930 ms 20 17947 15.38 MB/sec execute 98 sec latency 46.567 ms 20 18057 15.34 MB/sec execute 99 sec latency 66.784 ms 20 18159 15.21 MB/sec execute 100 sec latency 50.617 ms 20 18221 15.07 MB/sec execute 101 sec latency 351.745 ms 20 18330 14.94 MB/sec execute 102 sec latency 277.246 ms 20 18435 14.82 MB/sec execute 103 sec latency 176.685 ms 20 18497 14.70 MB/sec execute 104 sec latency 222.326 ms 20 18588 14.60 MB/sec execute 105 sec latency 146.837 ms 20 18683 14.52 MB/sec execute 106 sec latency 205.681 ms 20 18821 14.53 MB/sec execute 107 sec latency 111.447 ms 20 19015 14.64 MB/sec execute 108 sec latency 116.491 ms 20 19200 14.79 MB/sec execute 109 sec latency 122.629 ms 20 19364 14.78 MB/sec execute 110 sec latency 116.991 ms 20 19458 14.66 MB/sec execute 111 sec latency 156.253 ms 20 19569 14.55 MB/sec execute 112 sec latency 160.878 ms 20 19755 14.45 MB/sec execute 113 sec latency 89.891 ms 20 19980 14.42 MB/sec execute 114 sec latency 76.088 ms 20 20180 14.47 MB/sec execute 115 sec latency 102.054 ms 20 20418 14.69 MB/sec execute 116 sec latency 122.500 ms 20 20802 15.16 MB/sec execute 117 sec latency 124.803 ms 20 21093 15.36 MB/sec execute 118 sec latency 115.054 ms 20 21352 15.68 MB/sec execute 119 sec latency 89.847 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 58640 21.090 128.970 Close 43922 4.857 42.233 Rename 2563 29.273 122.130 Unlink 11177 6.890 57.728 Qpathinfo 53351 5.000 92.984 Qfileinfo 9602 0.103 11.227 Qfsinfo 9816 0.058 21.228 Sfileinfo 4905 18.682 73.443 Find 20881 0.782 77.300 WriteX 29675 2.058 57.359 ReadX 95537 0.018 9.983 LockX 200 4.781 18.373 UnlockX 200 4.693 18.530 Flush 4140 85.685 468.506 Throughput 15.6759 MB/sec 20 clients 20 procs max_latency=468.512 ms stopping dbench on /mnt/lustre/d0.oleg101-client.virtnet at Fri Sep 20 13:21:41 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg101-client.virtnet /mnt/lustre/d0.oleg101-client.virtnet /mnt/lustre/d0.oleg101-client.virtnet removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg101-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (150s) == sanity-benchmark test bonnie: bonnie++ ================ 13:21:45 (1726852905) min OST has 3164160kB available, using 4746240kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7735] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4635] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg101-clien 4635M 112622 76 93222 63 242442 43 1223 146 Latency 35964us 122ms 43989us 193ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg101-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 168 16 3072 14 255 12 163 15 371 11 221 11 Latency 48088us 50945us 68818us 37085us 21492us 43629us 1.97,1.97,oleg101-client.virtnet,1,1726842268,4635M,,,,112622,76,93222,63,,,242442,43,1223,146,10,,,,,168,16,3072,14,255,12,163,15,371,11,221,11,,35964us,122ms,,43989us,193ms,48088us,50945us,68818us,37085us,21492us,43629us debug=0x33f0484 PASS bonnie (368s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 13:27:54 (1726853274) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 25323 -P /tmp -l 5646336 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 25323 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x2ba043 truncating to largest ever: 0x4b18ef truncating to largest ever: 0x4f6aaa truncating to largest ever: 0x522a2e truncating to largest ever: 0x55647e truncating to largest ever: 0x55687f truncating to largest ever: 0x557a99 truncating to largest ever: 0x561a39 004000 1726853309.920807 read 0x067f31 thru 0x06bfc2 (0x4092 bytes) 005000 1726853318.757753 mapwrite 0x01059a thru 0x0121cb (0x1c32 bytes) 006000 1726853328.133664 mapwrite 0x3234cc thru 0x325a44 (0x2579 bytes) 007000 1726853337.596355 write 0x558bb2 thru 0x5627ff (0x9c4e bytes) 009000 1726853352.373655 read 0x246912 thru 0x24bd02 (0x53f1 bytes) 010000 1726853359.995224 mapwrite 0x2224ed thru 0x229dbb (0x78cf bytes) 011000 1726853367.964863 mapwrite 0x04e5e6 thru 0x054098 (0x5ab3 bytes) 012000 1726853374.518714 write 0x0ff663 thru 0x10d402 (0xdda0 bytes) 013000 1726853379.474033 trunc from 0x4a068b to 0x19f44d (0x30123d bytes) 015000 1726853392.177765 write 0x1b04bd thru 0x1bbd89 (0xb8cd bytes) 016000 1726853399.522490 mapread 0x0bd009 thru 0x0c9a15 (0xca0d bytes) 017000 1726853405.142969 read 0x16a113 thru 0x17a03e (0xff2c bytes) 019000 1726853421.337280 trunc from 0x16a3c2 to 0x3834e9 (0x219128 bytes) 021000 1726853436.833414 mapread 0x0b33a6 thru 0x0b7b50 (0x47ab bytes) 022000 1726853445.259496 read 0x1db22e thru 0x1e9031 (0xde04 bytes) 023000 1726853452.533099 read 0x2110b2 thru 0x214e0c (0x3d5b bytes) 024000 1726853460.244052 write 0x10b146 thru 0x116f46 (0xbe01 bytes) 025000 1726853465.983498 trunc from 0x01c80c to 0x535c10 (0x519405 bytes) 026000 1726853471.875485 mapwrite 0x4692da thru 0x47471b (0xb442 bytes) 027000 1726853480.329246 write 0x47c388 thru 0x48aae0 (0xe759 bytes) truncating to largest ever: 0x561b5e 028000 1726853488.572356 trunc from 0x4070c7 to 0x3a1b58 (0x6556e bytes) truncating to largest ever: 0x561c3a 029000 1726853498.379932 write 0x101830 thru 0x10430d (0x2ade bytes) 032000 1726853525.743474 mapread 0x008ac1 thru 0x0184ff (0xfa3f bytes) 033000 1726853534.943055 read 0x09f32a thru 0x0a7084 (0x7d5b bytes) 034000 1726853543.906397 mapread 0x431b48 thru 0x4390c3 (0x757c bytes) 035000 1726853552.757081 write 0x13c38c thru 0x14438d (0x8002 bytes) 036000 1726853559.087870 mapwrite 0x17af7b thru 0x184b22 (0x9ba8 bytes) 037000 1726853567.164218 mapwrite 0x3047bc thru 0x30f0ef (0xa934 bytes) 038000 1726853574.131042 mapread 0x0a671d thru 0x0adb5b (0x743f bytes) 040000 1726853589.562461 write 0x17b71c thru 0x18503c (0x9921 bytes) 041000 1726853596.495701 write 0x471981 thru 0x476b47 (0x51c7 bytes) 042000 1726853604.842091 write 0x1781c0 thru 0x181408 (0x9249 bytes) 043000 1726853611.067028 mapread 0x1cf14e thru 0x1d7a0a (0x88bd bytes) 044000 1726853620.019102 mapread 0x00285e thru 0x0055de (0x2d81 bytes) 047000 1726853645.238018 mapread 0x16fa85 thru 0x17c3c3 (0xc93f bytes) 048000 1726853651.025914 read 0x0848bb thru 0x086024 (0x176a bytes) skipping zero size read 050000 1726853664.274601 write 0x24d2c1 thru 0x253835 (0x6575 bytes) 052000 1726853679.586566 trunc from 0x32d5ad to 0x3b9da2 (0x8c7f6 bytes) 055000 1726853700.227729 mapread 0x49842a thru 0x49a5c7 (0x219e bytes) 058000 1726853721.555762 mapwrite 0x02ee81 thru 0x0368ee (0x7a6e bytes) 063000 1726853759.149953 write 0x387f5e thru 0x3928c0 (0xa963 bytes) 064000 1726853765.085438 write 0x40dc26 thru 0x414275 (0x6650 bytes) 066000 1726853780.394586 read 0x033fbe thru 0x042a1c (0xea5f bytes) 068000 1726853793.681181 read 0x0301dc thru 0x033072 (0x2e97 bytes) 069000 1726853800.325208 write 0x4d88f8 thru 0x4da2d1 (0x19da bytes) 073000 1726853831.353418 mapread 0x1f9ac2 thru 0x201811 (0x7d50 bytes) 075000 1726853849.282847 mapread 0x03a34c thru 0x0426fe (0x83b3 bytes) 076000 1726853858.435054 trunc from 0x2e867d to 0x18dad5 (0x15aba7 bytes) 079000 1726853882.818858 trunc from 0x4eec0b to 0x3e651d (0x1086ed bytes) 080000 1726853892.482238 mapread 0x1d6bd9 thru 0x1e17cf (0xabf7 bytes) truncating to largest ever: 0x5620e7 081000 1726853900.779260 trunc from 0x4e5f5e to 0x0f0d76 (0x3f51e7 bytes) 086000 1726853941.543181 mapwrite 0x4b059e thru 0x4bc318 (0xbd7b bytes) 087000 1726853948.593907 mapwrite 0x500820 thru 0x50550f (0x4cf0 bytes) 088000 1726853956.973997 mapread 0x3a3d20 thru 0x3a9c1d (0x5efe bytes) 089000 1726853967.252258 mapread 0x242ac7 thru 0x251321 (0xe85b bytes) 090000 1726853977.269234 read 0x1ccfa2 thru 0x1cf373 (0x23d2 bytes) 092000 1726853995.635846 write 0x0a8513 thru 0x0b5080 (0xcb6e bytes) 094000 1726854012.869039 mapread 0x346d62 thru 0x34cb20 (0x5dbf bytes) 097000 1726854038.026186 write 0x41198b thru 0x41de1e (0xc494 bytes) 098000 1726854047.980838 read 0x4159e1 thru 0x424c23 (0xf243 bytes) 099000 1726854057.507238 read 0x3e61b8 thru 0x3ebaca (0x5913 bytes) 100000 1726854066.959092 read 0x1dffc1 thru 0x1ee003 (0xe043 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (795s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 13:41:09 (1726854069) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1726854099.556543 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1726854122.095400 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1726854131.735748 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1726854173.004610 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1726854179.074788 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1726854200.342601 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1726854207.776629 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1726854222.923000 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1726854242.934408 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1726854251.037415 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1726854266.833157 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1726854276.790791 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1726854306.370784 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1726854320.570586 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1726854344.789805 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1726854367.835993 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1726854375.585076 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1726854407.753273 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1726854417.541361 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1726854444.435788 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1726854451.646259 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1726854460.914098 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1726854484.529787 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1726854499.802220 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1726854515.458267 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1726854522.398499 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1726854596.152352 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1726854618.351124 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1726854624.919722 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1726854630.712135 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1726854637.249285 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1726854658.589106 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1726854667.101428 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1726854690.778791 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1726854698.135647 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1726854716.457972 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1726854734.688025 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1726854740.343151 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1726854758.977083 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1726854788.960969 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1726854795.064712 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1726854808.892380 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1726854819.907420 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (756s) == sanity-benchmark test complete, duration 2085 sec ===== 13:53:45 (1726854825) === sanity-benchmark: start cleanup 13:53:46 (1726854826) === === sanity-benchmark: finish cleanup 13:53:46 (1726854826) ===