-----============= acceptance-small: sanity-benchmark ============----- Wed Jul 24 23:55:36 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 23:55:40 (1721879740) === oleg423-client.virtnet: executing check_config_client /mnt/lustre oleg423-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg423-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b61f1800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b61f1800.idle_timeout=debug disable quota as required oleg423-server: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 23:55:46 (1721879746) === == sanity-benchmark test dbench: dbench ================== 23:55:46 (1721879746) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6946] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg423-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg423-client.virtnet at Wed Jul 24 23:55:48 EDT 2024 waiting for dbench pid 8935 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 122 110.61 MB/sec warmup 1 sec latency 124.249 ms 20 265 99.59 MB/sec warmup 2 sec latency 87.014 ms 20 392 92.83 MB/sec warmup 3 sec latency 68.731 ms 20 543 93.62 MB/sec warmup 4 sec latency 161.715 ms 20 680 84.68 MB/sec warmup 5 sec latency 422.728 ms 20 771 71.17 MB/sec warmup 6 sec latency 155.494 ms 20 865 61.69 MB/sec warmup 7 sec latency 126.941 ms 20 966 54.66 MB/sec warmup 8 sec latency 145.605 ms 20 1154 51.10 MB/sec warmup 9 sec latency 120.579 ms 20 1425 52.02 MB/sec warmup 10 sec latency 137.276 ms 20 1644 47.59 MB/sec warmup 11 sec latency 171.271 ms 20 1889 43.97 MB/sec warmup 12 sec latency 95.115 ms 20 2171 41.17 MB/sec warmup 13 sec latency 95.380 ms 20 2408 40.10 MB/sec warmup 14 sec latency 142.081 ms 20 2648 40.14 MB/sec warmup 15 sec latency 171.116 ms 20 2984 41.99 MB/sec warmup 16 sec latency 152.583 ms 20 3302 41.40 MB/sec warmup 17 sec latency 148.865 ms 20 3646 43.08 MB/sec warmup 18 sec latency 99.808 ms 20 3878 41.97 MB/sec warmup 19 sec latency 25.178 ms 20 4058 40.07 MB/sec warmup 20 sec latency 28.446 ms 20 4199 38.27 MB/sec warmup 21 sec latency 345.015 ms 20 4319 36.78 MB/sec warmup 22 sec latency 203.795 ms 20 4446 35.44 MB/sec warmup 23 sec latency 126.746 ms 20 4918 40.38 MB/sec execute 1 sec latency 150.181 ms 20 5135 35.79 MB/sec execute 2 sec latency 118.444 ms 20 5283 24.69 MB/sec execute 3 sec latency 73.278 ms 20 5432 19.19 MB/sec execute 4 sec latency 86.862 ms 20 5626 16.48 MB/sec execute 5 sec latency 89.566 ms 20 5831 15.82 MB/sec execute 6 sec latency 87.159 ms 20 6019 17.48 MB/sec execute 7 sec latency 168.417 ms 20 6238 19.75 MB/sec execute 8 sec latency 196.264 ms 20 6525 23.89 MB/sec execute 9 sec latency 133.205 ms 20 6823 25.33 MB/sec execute 10 sec latency 186.800 ms 20 7145 28.13 MB/sec execute 11 sec latency 219.224 ms 20 7386 28.57 MB/sec execute 12 sec latency 29.377 ms 20 7546 26.93 MB/sec execute 13 sec latency 55.266 ms 20 7656 25.14 MB/sec execute 14 sec latency 171.361 ms 20 7797 23.70 MB/sec execute 15 sec latency 214.952 ms 20 7911 22.54 MB/sec execute 16 sec latency 224.418 ms 20 8065 21.82 MB/sec execute 17 sec latency 115.310 ms 20 8276 22.08 MB/sec execute 18 sec latency 116.524 ms 20 8508 22.73 MB/sec execute 19 sec latency 75.135 ms 20 8699 22.71 MB/sec execute 20 sec latency 94.920 ms 20 8853 21.76 MB/sec execute 21 sec latency 84.219 ms 20 9055 20.96 MB/sec execute 22 sec latency 74.143 ms 20 9269 20.43 MB/sec execute 23 sec latency 78.123 ms 20 9496 20.56 MB/sec execute 24 sec latency 89.791 ms 20 9721 21.20 MB/sec execute 25 sec latency 133.235 ms 20 10067 22.93 MB/sec execute 26 sec latency 121.916 ms 20 10392 23.67 MB/sec execute 27 sec latency 144.829 ms 20 10691 24.77 MB/sec execute 28 sec latency 97.288 ms 20 10914 24.93 MB/sec execute 29 sec latency 30.383 ms 20 11079 24.40 MB/sec execute 30 sec latency 161.626 ms 20 11239 23.71 MB/sec execute 31 sec latency 145.857 ms 20 11399 23.14 MB/sec execute 32 sec latency 191.291 ms 20 11544 22.70 MB/sec execute 33 sec latency 137.158 ms 20 11737 22.67 MB/sec execute 34 sec latency 121.697 ms 20 11967 22.75 MB/sec execute 35 sec latency 109.769 ms 20 12218 23.23 MB/sec execute 36 sec latency 72.381 ms 20 12396 22.68 MB/sec execute 37 sec latency 75.393 ms 20 12575 22.17 MB/sec execute 38 sec latency 53.370 ms 20 12834 21.91 MB/sec execute 39 sec latency 62.736 ms 20 13130 22.29 MB/sec execute 40 sec latency 130.472 ms 20 13431 22.93 MB/sec execute 41 sec latency 139.314 ms 20 13776 23.99 MB/sec execute 42 sec latency 116.799 ms 20 14123 24.49 MB/sec execute 43 sec latency 121.965 ms 20 14391 24.94 MB/sec execute 44 sec latency 82.381 ms 20 14570 24.72 MB/sec execute 45 sec latency 36.360 ms 20 14716 24.27 MB/sec execute 46 sec latency 208.833 ms 20 14864 23.81 MB/sec execute 47 sec latency 194.044 ms 20 15018 23.46 MB/sec execute 48 sec latency 118.248 ms 20 15205 23.26 MB/sec execute 49 sec latency 110.687 ms 20 15451 23.45 MB/sec execute 50 sec latency 116.571 ms 20 15690 23.72 MB/sec execute 51 sec latency 80.582 ms 20 15904 23.48 MB/sec execute 52 sec latency 76.161 ms 20 16104 23.11 MB/sec execute 53 sec latency 73.024 ms 20 16339 22.85 MB/sec execute 54 sec latency 84.288 ms 20 16589 22.97 MB/sec execute 55 sec latency 93.776 ms 20 16860 23.22 MB/sec execute 56 sec latency 125.679 ms 20 17277 24.26 MB/sec execute 57 sec latency 148.969 ms 20 17613 24.57 MB/sec execute 58 sec latency 145.053 ms 20 17894 25.03 MB/sec execute 59 sec latency 106.330 ms 20 18073 24.87 MB/sec execute 60 sec latency 28.542 ms 20 18259 24.57 MB/sec execute 61 sec latency 219.554 ms 20 18443 24.24 MB/sec execute 62 sec latency 141.929 ms 20 18595 23.97 MB/sec execute 63 sec latency 115.755 ms 20 18792 23.85 MB/sec execute 64 sec latency 101.316 ms 20 19058 24.01 MB/sec execute 65 sec latency 80.184 ms 20 19324 24.26 MB/sec execute 66 sec latency 69.473 ms 20 19527 23.95 MB/sec execute 67 sec latency 64.142 ms 20 19741 23.66 MB/sec execute 68 sec latency 60.478 ms 20 19999 23.50 MB/sec execute 69 sec latency 74.998 ms 20 20272 23.69 MB/sec execute 70 sec latency 112.744 ms 20 20501 23.81 MB/sec execute 71 sec latency 197.168 ms 20 20905 24.64 MB/sec execute 72 sec latency 108.498 ms 20 21252 24.90 MB/sec execute 73 sec latency 149.240 ms 20 21531 25.18 MB/sec execute 74 sec latency 74.612 ms 20 21722 25.05 MB/sec execute 75 sec latency 49.647 ms 20 21863 24.77 MB/sec execute 76 sec latency 229.040 ms 20 22008 24.49 MB/sec execute 77 sec latency 117.015 ms 20 22144 24.25 MB/sec execute 78 sec latency 120.577 ms 20 22310 24.10 MB/sec execute 79 sec latency 123.345 ms 20 22526 24.16 MB/sec execute 80 sec latency 103.109 ms 20 22742 24.17 MB/sec execute 81 sec latency 81.281 ms 20 22953 24.21 MB/sec execute 82 sec latency 62.525 ms 20 23137 23.96 MB/sec execute 83 sec latency 59.597 ms 20 23388 23.78 MB/sec execute 84 sec latency 73.361 ms 20 23623 23.66 MB/sec execute 85 sec latency 69.522 ms 20 23863 23.82 MB/sec execute 86 sec latency 122.912 ms 20 24068 23.87 MB/sec execute 87 sec latency 163.273 ms 20 24395 24.40 MB/sec execute 88 sec latency 127.175 ms 20 24737 24.61 MB/sec execute 89 sec latency 131.996 ms 20 24946 24.75 MB/sec execute 90 sec latency 125.340 ms 20 25125 24.73 MB/sec execute 91 sec latency 35.538 ms 20 25276 24.58 MB/sec execute 92 sec latency 167.178 ms 20 25403 24.36 MB/sec execute 93 sec latency 161.680 ms 20 25534 24.12 MB/sec execute 94 sec latency 135.245 ms 20 25654 23.92 MB/sec execute 95 sec latency 177.336 ms 20 25762 23.75 MB/sec execute 96 sec latency 115.982 ms 20 25894 23.62 MB/sec execute 97 sec latency 121.784 ms 20 26023 23.57 MB/sec execute 98 sec latency 109.562 ms 20 26153 23.49 MB/sec execute 99 sec latency 136.949 ms 20 26321 23.43 MB/sec execute 100 sec latency 96.616 ms 20 26472 23.44 MB/sec execute 101 sec latency 131.121 ms 20 26593 23.23 MB/sec execute 102 sec latency 87.997 ms 20 26700 23.02 MB/sec execute 103 sec latency 92.983 ms 20 26809 22.83 MB/sec execute 104 sec latency 74.867 ms 20 26969 22.69 MB/sec execute 105 sec latency 68.744 ms 20 27097 22.54 MB/sec execute 106 sec latency 105.504 ms 20 27275 22.55 MB/sec execute 107 sec latency 96.000 ms 20 27439 22.56 MB/sec execute 108 sec latency 167.488 ms 20 27612 22.57 MB/sec execute 109 sec latency 176.079 ms 20 27833 22.74 MB/sec execute 110 sec latency 184.954 ms 20 28016 22.85 MB/sec execute 111 sec latency 197.664 ms 20 28154 22.83 MB/sec execute 112 sec latency 221.603 ms 20 28328 22.82 MB/sec execute 113 sec latency 152.910 ms 20 28496 22.89 MB/sec execute 114 sec latency 114.615 ms 20 28651 22.88 MB/sec execute 115 sec latency 40.690 ms 20 28777 22.77 MB/sec execute 116 sec latency 189.423 ms 20 28898 22.62 MB/sec execute 117 sec latency 131.516 ms 20 28997 22.45 MB/sec execute 118 sec latency 129.614 ms 20 29114 22.28 MB/sec execute 119 sec latency 145.523 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 85103 14.891 70.891 Close 62369 2.858 18.803 Rename 3556 21.723 82.429 Unlink 17215 4.677 34.155 Qpathinfo 77179 3.608 55.611 Qfileinfo 13455 0.094 14.303 Qfsinfo 14058 0.037 4.901 Sfileinfo 6729 12.327 51.715 Find 29762 0.549 54.946 WriteX 41704 1.062 22.806 ReadX 133795 0.016 5.579 LockX 280 4.563 17.856 UnlockX 280 4.259 15.239 Flush 5795 62.955 229.033 Throughput 22.2812 MB/sec 20 clients 20 procs max_latency=229.040 ms stopping dbench on /mnt/lustre/d0.oleg423-client.virtnet at Wed Jul 24 23:58:13 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg423-client.virtnet /mnt/lustre/d0.oleg423-client.virtnet /mnt/lustre/d0.oleg423-client.virtnet removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg423-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (150s) == sanity-benchmark test bonnie: bonnie++ ================ 23:58:16 (1721879896) min OST has 3319808kB available, using 4979712kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6946] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4863] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg423-clien 4863M 133577 94 121941 90 313392 81 1743 146 Latency 92976us 44955us 43823us 347ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg423-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 340 17 7377 32 435 12 271 17 799 12 427 12 Latency 17055us 15187us 60741us 16214us 6434us 16299us 1.97,1.97,oleg423-client.virtnet,1,1721887311,4863M,,,,133577,94,121941,90,,,313392,81,1743,146,10,,,,,340,17,7377,32,435,12,271,17,799,12,427,12,,92976us,44955us,,43823us,347ms,17055us,15187us,60741us,16214us,6434us,16299us debug=0x33f0484 PASS bonnie (235s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 00:02:11 (1721880131) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 32536 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 32536 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x197064 truncating to largest ever: 0x482cca truncating to largest ever: 0x557108 skipping zero size read 001000 1721880136.749363 mapread 0x1e2e79 thru 0x1f06c8 (0xd850 bytes) truncating to largest ever: 0x55a8bd 004000 1721880149.329247 write 0x12020f thru 0x1255d6 (0x53c8 bytes) truncating to largest ever: 0x55abbc 005000 1721880153.615557 mapread 0x4b6632 thru 0x4c1aae (0xb47d bytes) truncating to largest ever: 0x55de1b 006000 1721880159.160321 read 0x2273a0 thru 0x229383 (0x1fe4 bytes) skipping zero size read 011000 1721880182.734660 trunc from 0x424d91 to 0x3c1301 (0x63a8f bytes) truncating to largest ever: 0x561847 012000 1721880186.432013 mapread 0x2fb8e8 thru 0x307dd8 (0xc4f1 bytes) 013000 1721880191.241960 trunc from 0x010788 to 0x4a323c (0x492ab5 bytes) 016000 1721880204.992743 trunc from 0x2c56b3 to 0x21ecef (0xa69c3 bytes) 019000 1721880218.440803 write 0x520f96 thru 0x52ab08 (0x9b73 bytes) 023000 1721880238.378645 mapwrite 0x141f04 thru 0x1454cd (0x35ca bytes) 024000 1721880242.938544 trunc from 0x3adf1f to 0x2f504e (0xb8ed0 bytes) 025000 1721880247.540083 mapread 0x17e29d thru 0x18ca8e (0xe7f2 bytes) 026000 1721880251.384971 write 0x3485c3 thru 0x35487f (0xc2bd bytes) 028000 1721880258.237001 write 0x3c674b thru 0x3ccd79 (0x662f bytes) 031000 1721880270.881639 write 0x0a45aa thru 0x0aa4ef (0x5f46 bytes) 032000 1721880275.601249 read 0x08690e thru 0x0915f4 (0xace7 bytes) 033000 1721880280.242290 write 0x3b78dc thru 0x3be6ad (0x6dd2 bytes) 034000 1721880284.241489 write 0x4ac276 thru 0x4b4c01 (0x898c bytes) 035000 1721880289.008022 trunc from 0x51f975 to 0x133ddb (0x3ebb99 bytes) truncating to largest ever: 0x561c65 038000 1721880300.318903 mapwrite 0x031895 thru 0x039e77 (0x85e3 bytes) 039000 1721880304.163991 mapread 0x00f043 thru 0x00f4a2 (0x460 bytes) 040000 1721880307.734134 trunc from 0x53fd19 to 0x492bd5 (0xad143 bytes) 041000 1721880311.452291 mapwrite 0x4fcd0e thru 0x50231f (0x5612 bytes) 042000 1721880314.802466 trunc from 0x4e3f1d to 0x34ee1f (0x1950fd bytes) truncating to largest ever: 0x562047 044000 1721880321.396742 mapwrite 0x14cddd thru 0x15757c (0xa7a0 bytes) skipping zero size write 046000 1721880328.659546 write 0x48b92a thru 0x495fd4 (0xa6ab bytes) 049000 1721880338.570586 write 0x301d5d thru 0x308c5f (0x6f03 bytes) 050000 1721880342.373368 mapread 0x31fbb6 thru 0x325dab (0x61f6 bytes) 052000 1721880351.209357 mapread 0x0dbc03 thru 0x0dd3d5 (0x17d3 bytes) 056000 1721880368.143012 write 0x0308fc thru 0x03b160 (0xa865 bytes) 057000 1721880371.808899 write 0x102721 thru 0x107ab3 (0x5393 bytes) 058000 1721880375.298984 write 0x07299e thru 0x081c41 (0xf2a4 bytes) 062000 1721880388.586207 mapread 0x1e5b9a thru 0x1f027c (0xa6e3 bytes) 063000 1721880391.785398 write 0x0caa90 thru 0x0d68a2 (0xbe13 bytes) 064000 1721880394.512695 write 0x10b66f thru 0x119bf9 (0xe58b bytes) 065000 1721880397.614123 read 0x073a9c thru 0x07ab3e (0x70a3 bytes) 068000 1721880406.964083 mapwrite 0x03c7a7 thru 0x0401c1 (0x3a1b bytes) 070000 1721880413.728699 trunc from 0x22b6bd to 0x163c52 (0xc7a6a bytes) 071000 1721880416.746862 trunc from 0x5442d2 to 0x0818b7 (0x4c2a1a bytes) 072000 1721880420.113753 read 0x303477 thru 0x306e33 (0x39bd bytes) 074000 1721880426.710154 read 0x50940e thru 0x50c621 (0x3214 bytes) 075000 1721880429.785831 read 0x4dd581 thru 0x4e0d5a (0x37da bytes) 078000 1721880438.086526 read 0x19ee0e thru 0x1a4a66 (0x5c59 bytes) 079000 1721880440.987608 read 0x072932 thru 0x078b0c (0x61db bytes) 083000 1721880453.847286 trunc from 0x477357 to 0x47679e (0xbb8 bytes) 084000 1721880457.436903 read 0x130afe thru 0x132096 (0x1599 bytes) 085000 1721880461.635786 write 0x0d7944 thru 0x0d8adf (0x119c bytes) 088000 1721880470.697452 mapread 0x13809c thru 0x13905f (0xfc4 bytes) 090000 1721880476.581871 trunc from 0x52188f to 0x505139 (0x1c755 bytes) 091000 1721880478.925237 read 0x230dd9 thru 0x233218 (0x2440 bytes) 092000 1721880481.713242 mapwrite 0x3a5098 thru 0x3aeae7 (0x9a50 bytes) 093000 1721880484.755528 mapwrite 0x19ddf3 thru 0x1ad334 (0xf542 bytes) 094000 1721880488.075276 mapwrite 0x0f6808 thru 0x1058f3 (0xf0ec bytes) 095000 1721880491.006365 mapread 0x1035cc thru 0x1048f0 (0x1325 bytes) 097000 1721880497.177861 trunc from 0x42aa96 to 0x37276a (0xb832b bytes) 099000 1721880503.551725 trunc from 0x17fde9 to 0x249a08 (0xc9c20 bytes) 100000 1721880506.295324 trunc from 0x5161f6 to 0x2b84a0 (0x25dd55 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (376s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 00:08:27 (1721880507) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1721880517.133561 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1721880524.925776 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1721880528.832688 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1721880543.893340 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1721880546.839457 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1721880559.511965 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1721880562.909965 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1721880569.581640 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1721880577.413513 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1721880581.068666 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1721880588.623740 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1721880592.978806 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1721880607.829387 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1721880614.592673 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1721880626.186461 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1721880637.452234 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1721880640.661433 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1721880655.876704 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1721880659.954780 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1721880671.234941 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1721880674.878160 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1721880678.713532 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1721880689.269248 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1721880696.353230 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1721880703.742161 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1721880707.647631 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1721880743.658393 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1721880753.936077 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1721880757.834799 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1721880761.355864 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1721880764.900371 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1721880776.943523 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1721880780.634170 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1721880792.908384 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1721880797.114811 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1721880807.487268 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1721880818.234267 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1721880821.876418 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1721880831.937832 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1721880849.343626 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1721880852.524216 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1721880859.378367 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1721880866.671162 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (364s) == sanity-benchmark test complete, duration 1135 sec ===== 00:14:31 (1721880871) === sanity-benchmark: start cleanup 00:14:31 (1721880871) === === sanity-benchmark: finish cleanup 00:14:31 (1721880871) ===