-----============= acceptance-small: sanity-benchmark ============----- Tue Jun 4 23:04:45 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 23:04:51 (1717556691) === oleg146-client.virtnet: executing check_config_client /mnt/lustre oleg146-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg146-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b638b000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b638b000.idle_timeout=debug disable quota as required oleg146-server: oleg146-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 23:05:00 (1717556700) === == sanity-benchmark test dbench: dbench ================== 23:05:00 (1717556700) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7532] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg146-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg146-client.virtnet at Tue Jun 4 23:05:01 EDT 2024 waiting for dbench pid 9731 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 177 143.63 MB/sec warmup 1 sec latency 67.834 ms 20 373 133.29 MB/sec warmup 2 sec latency 51.514 ms 20 628 138.57 MB/sec warmup 3 sec latency 46.882 ms 20 815 107.40 MB/sec warmup 4 sec latency 36.650 ms 20 1025 89.92 MB/sec warmup 5 sec latency 33.379 ms 20 1270 78.40 MB/sec warmup 6 sec latency 34.363 ms 20 1563 74.59 MB/sec warmup 7 sec latency 35.575 ms 20 1819 65.81 MB/sec warmup 8 sec latency 31.372 ms 20 2068 59.13 MB/sec warmup 9 sec latency 28.042 ms 20 2341 55.70 MB/sec warmup 10 sec latency 31.080 ms 20 2521 52.30 MB/sec warmup 11 sec latency 49.566 ms 20 2965 55.77 MB/sec warmup 12 sec latency 30.857 ms 20 3375 54.91 MB/sec warmup 13 sec latency 36.199 ms 20 3699 55.52 MB/sec warmup 14 sec latency 27.240 ms 20 3883 53.16 MB/sec warmup 15 sec latency 37.950 ms 20 3969 50.07 MB/sec warmup 16 sec latency 55.269 ms 20 4155 47.20 MB/sec warmup 17 sec latency 63.473 ms 20 4325 44.94 MB/sec warmup 18 sec latency 70.964 ms 20 4498 43.03 MB/sec warmup 19 sec latency 31.677 ms 20 4695 42.08 MB/sec warmup 20 sec latency 42.477 ms 20 4938 42.16 MB/sec warmup 21 sec latency 68.595 ms 20 5138 41.12 MB/sec warmup 22 sec latency 50.021 ms 20 5319 39.47 MB/sec warmup 23 sec latency 37.895 ms 20 5820 13.09 MB/sec execute 1 sec latency 29.032 ms 20 6004 18.02 MB/sec execute 2 sec latency 35.892 ms 20 6324 32.99 MB/sec execute 3 sec latency 38.743 ms 20 6838 42.11 MB/sec execute 4 sec latency 35.548 ms 20 7243 49.66 MB/sec execute 5 sec latency 33.048 ms 20 7480 45.12 MB/sec execute 6 sec latency 26.650 ms 20 7723 39.05 MB/sec execute 7 sec latency 56.820 ms 20 7995 35.70 MB/sec execute 8 sec latency 33.507 ms 20 8318 35.15 MB/sec execute 9 sec latency 23.287 ms 20 8638 37.42 MB/sec execute 10 sec latency 36.567 ms 20 8875 34.39 MB/sec execute 11 sec latency 27.836 ms 20 9169 32.03 MB/sec execute 12 sec latency 23.071 ms 20 9498 31.71 MB/sec execute 13 sec latency 22.300 ms 20 9938 35.49 MB/sec execute 14 sec latency 29.118 ms 20 10439 37.77 MB/sec execute 15 sec latency 29.063 ms 20 10776 39.39 MB/sec execute 16 sec latency 27.578 ms 20 10994 38.31 MB/sec execute 17 sec latency 26.564 ms 20 11236 36.40 MB/sec execute 18 sec latency 45.792 ms 20 11518 35.09 MB/sec execute 19 sec latency 34.569 ms 20 11854 34.79 MB/sec execute 20 sec latency 26.382 ms 20 12241 36.07 MB/sec execute 21 sec latency 26.981 ms 20 12588 34.70 MB/sec execute 22 sec latency 19.503 ms 20 13002 34.36 MB/sec execute 23 sec latency 19.972 ms 20 13511 36.89 MB/sec execute 24 sec latency 21.994 ms 20 14184 39.74 MB/sec execute 25 sec latency 23.305 ms 20 14512 39.72 MB/sec execute 26 sec latency 21.950 ms 20 14768 38.42 MB/sec execute 27 sec latency 56.479 ms 20 15069 37.48 MB/sec execute 28 sec latency 65.844 ms 20 15449 37.54 MB/sec execute 29 sec latency 23.400 ms 20 15804 38.01 MB/sec execute 30 sec latency 28.623 ms 20 16098 36.95 MB/sec execute 31 sec latency 29.322 ms 20 16478 36.46 MB/sec execute 32 sec latency 21.407 ms 20 16878 37.36 MB/sec execute 33 sec latency 22.848 ms 20 17523 39.06 MB/sec execute 34 sec latency 24.519 ms 20 18005 40.30 MB/sec execute 35 sec latency 21.913 ms 20 18334 39.45 MB/sec execute 36 sec latency 36.838 ms 20 18683 38.83 MB/sec execute 37 sec latency 22.332 ms 20 19167 39.62 MB/sec execute 38 sec latency 17.496 ms 20 19554 39.13 MB/sec execute 39 sec latency 23.246 ms 20 20062 38.70 MB/sec execute 40 sec latency 16.204 ms 20 20692 40.32 MB/sec execute 41 sec latency 20.426 ms 20 21396 42.14 MB/sec execute 42 sec latency 21.001 ms 20 21759 41.89 MB/sec execute 43 sec latency 21.576 ms 20 22118 41.16 MB/sec execute 44 sec latency 37.586 ms 20 22499 41.04 MB/sec execute 45 sec latency 19.806 ms 20 22947 41.44 MB/sec execute 46 sec latency 21.327 ms 20 23381 40.76 MB/sec execute 47 sec latency 18.614 ms 20 23855 40.86 MB/sec execute 48 sec latency 18.361 ms 20 24553 42.47 MB/sec execute 49 sec latency 25.269 ms 20 25097 43.43 MB/sec execute 50 sec latency 26.110 ms 20 25382 42.84 MB/sec execute 51 sec latency 32.659 ms 20 25705 42.22 MB/sec execute 52 sec latency 33.577 ms 20 26124 42.26 MB/sec execute 53 sec latency 23.623 ms 20 26554 42.40 MB/sec execute 54 sec latency 19.969 ms 20 26985 41.81 MB/sec execute 55 sec latency 16.372 ms 20 27458 42.13 MB/sec execute 56 sec latency 19.568 ms 20 28132 43.33 MB/sec execute 57 sec latency 44.173 ms 20 28638 44.06 MB/sec execute 58 sec latency 54.296 ms 20 28936 43.52 MB/sec execute 59 sec latency 35.139 ms 20 29260 42.97 MB/sec execute 60 sec latency 28.794 ms 20 29649 42.96 MB/sec execute 61 sec latency 20.999 ms 20 30059 43.09 MB/sec execute 62 sec latency 22.066 ms 20 30452 42.52 MB/sec execute 63 sec latency 17.997 ms 20 30904 42.53 MB/sec execute 64 sec latency 18.529 ms 20 31540 43.63 MB/sec execute 65 sec latency 23.518 ms 20 32070 44.28 MB/sec execute 66 sec latency 21.998 ms 20 32371 44.00 MB/sec execute 67 sec latency 23.686 ms 20 32653 43.45 MB/sec execute 68 sec latency 47.282 ms 20 33006 43.17 MB/sec execute 69 sec latency 20.888 ms 20 33391 43.34 MB/sec execute 70 sec latency 22.288 ms 20 33782 43.05 MB/sec execute 71 sec latency 27.010 ms 20 34189 42.70 MB/sec execute 72 sec latency 20.415 ms 20 34642 43.01 MB/sec execute 73 sec latency 22.352 ms 20 35305 43.96 MB/sec execute 74 sec latency 26.794 ms 20 35762 44.29 MB/sec execute 75 sec latency 21.149 ms 20 36041 43.85 MB/sec execute 76 sec latency 29.957 ms 20 36360 43.46 MB/sec execute 77 sec latency 21.270 ms 20 36724 43.40 MB/sec execute 78 sec latency 21.227 ms 20 37109 43.49 MB/sec execute 79 sec latency 21.894 ms 20 37430 43.02 MB/sec execute 80 sec latency 22.277 ms 20 37781 42.72 MB/sec execute 81 sec latency 22.528 ms 20 38139 42.84 MB/sec execute 82 sec latency 28.885 ms 20 38690 43.46 MB/sec execute 83 sec latency 27.179 ms 20 39139 43.83 MB/sec execute 84 sec latency 24.390 ms 20 39408 43.66 MB/sec execute 85 sec latency 28.556 ms 20 39633 43.21 MB/sec execute 86 sec latency 36.779 ms 20 39922 42.85 MB/sec execute 87 sec latency 28.877 ms 20 40196 42.65 MB/sec execute 88 sec latency 41.569 ms 20 40538 42.78 MB/sec execute 89 sec latency 30.125 ms 20 40820 42.45 MB/sec execute 90 sec latency 26.034 ms 20 41133 42.08 MB/sec execute 91 sec latency 28.237 ms 20 41502 41.98 MB/sec execute 92 sec latency 24.658 ms 20 42031 42.56 MB/sec execute 93 sec latency 31.467 ms 20 42574 43.02 MB/sec execute 94 sec latency 26.150 ms 20 42912 43.06 MB/sec execute 95 sec latency 30.042 ms 20 43170 42.69 MB/sec execute 96 sec latency 36.226 ms 20 43465 42.38 MB/sec execute 97 sec latency 29.424 ms 20 43826 42.35 MB/sec execute 98 sec latency 25.639 ms 20 44231 42.40 MB/sec execute 99 sec latency 23.414 ms 20 44584 42.08 MB/sec execute 100 sec latency 24.753 ms 20 45024 42.03 MB/sec execute 101 sec latency 20.075 ms 20 45525 42.44 MB/sec execute 102 sec latency 24.570 ms 20 46126 42.99 MB/sec execute 103 sec latency 23.575 ms 20 46439 42.99 MB/sec execute 104 sec latency 26.012 ms 20 46651 42.66 MB/sec execute 105 sec latency 42.014 ms 20 46919 42.34 MB/sec execute 106 sec latency 28.757 ms 20 47225 42.16 MB/sec execute 107 sec latency 24.957 ms 20 47551 42.22 MB/sec execute 108 sec latency 31.082 ms 20 47790 42.02 MB/sec execute 109 sec latency 30.235 ms 20 48030 41.71 MB/sec execute 110 sec latency 31.356 ms 20 48299 41.44 MB/sec execute 111 sec latency 27.949 ms 20 48598 41.34 MB/sec execute 112 sec latency 32.149 ms 20 48954 41.50 MB/sec execute 113 sec latency 29.491 ms 20 49386 41.79 MB/sec execute 114 sec latency 32.754 ms 20 49709 41.92 MB/sec execute 115 sec latency 38.610 ms 20 49924 41.79 MB/sec execute 116 sec latency 39.381 ms 20 50104 41.53 MB/sec execute 117 sec latency 41.148 ms 20 50272 41.21 MB/sec execute 118 sec latency 55.029 ms 20 50484 40.94 MB/sec execute 119 sec latency 39.736 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 155796 8.728 55.019 Close 114140 2.260 18.446 Rename 6624 11.811 38.730 Unlink 31899 3.001 21.473 Qpathinfo 140856 2.124 32.738 Qfileinfo 24557 0.071 6.212 Qfsinfo 26242 0.035 6.252 Sfileinfo 12663 7.030 39.308 Find 54851 0.454 32.347 WriteX 77217 1.080 20.063 ReadX 246032 0.016 4.331 LockX 520 2.406 9.838 UnlockX 520 2.423 7.483 Flush 11010 8.648 65.834 Throughput 40.9363 MB/sec 20 clients 20 procs max_latency=65.844 ms stopping dbench on /mnt/lustre/d0.oleg146-client.virtnet at Tue Jun 4 23:07:26 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg146-client.virtnet /mnt/lustre/d0.oleg146-client.virtnet /mnt/lustre/d0.oleg146-client.virtnet removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg146-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (150s) == sanity-benchmark test bonnie: bonnie++ ================ 23:07:30 (1717556850) min OST has 3369268kB available, using 5053902kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7532] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4935] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg146-clien 4935M 152893 96 124384 85 339155 62 2044 181 Latency 9086us 61342us 55670us 8397us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg146-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 288 19 8229 37 687 15 442 18 1341 13 804 14 Latency 18737us 13099us 34466us 16513us 8553us 14366us 1.97,1.97,oleg146-client.virtnet,1,1717566515,4935M,,,,152893,96,124384,85,,,339155,62,2044,181,10,,,,,288,19,8229,37,687,15,442,18,1341,13,804,14,,9086us,61342us,,55670us,8397us,18737us,13099us,34466us,16513us,8553us,14366us debug=0x33f0484 PASS bonnie (193s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 23:10:43 (1717557043) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 992 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 992 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x4ac85 truncating to largest ever: 0x266374 truncating to largest ever: 0x34433b truncating to largest ever: 0x4df63b truncating to largest ever: 0x50e05d fallocating to largest ever: 0x51b133 truncating to largest ever: 0x51fb1a truncating to largest ever: 0x5223fd 001000 1717557046.639106 read 0x0818c5 thru 0x08246b (0xba7 bytes) 002000 1717557048.428999 trunc from 0x500555 to 0x233db6 (0x2cc79e bytes) truncating to largest ever: 0x52255e 003000 1717557050.139550 trunc from 0x453c5d to 0x2f48b7 (0x15f3a5 bytes) truncating to largest ever: 0x5229a7 fallocating to largest ever: 0x527d85 fallocating to largest ever: 0x5285e2 008000 1717557060.625354 write 0x066172 thru 0x072469 (0xc2f8 bytes) 009000 1717557062.712397 read 0x2d5684 thru 0x2de1e3 (0x8b60 bytes) 013000 1717557071.025832 mapread 0x18d24c thru 0x191bff (0x49b4 bytes) 017000 1717557079.458134 mapread 0x405ea9 thru 0x407e05 (0x1f5d bytes) 019000 1717557083.988589 write 0x122cc8 thru 0x127db1 (0x50ea bytes) 020000 1717557086.032863 mapwrite 0x36f631 thru 0x376981 (0x7351 bytes) 021000 1717557088.361139 punch from 0x034560 to 0x041919 (0xd3ba bytes) skipping zero size read 022000 1717557090.580783 write 0x1a6d6c thru 0x1b0234 (0x94c9 bytes) 023000 1717557092.583832 mapread 0x025df2 thru 0x026531 (0x740 bytes) 024000 1717557094.513548 write 0x4e39ab thru 0x4ef935 (0xbf8b bytes) 025000 1717557096.501768 punch from 0x3ea3a9 to 0x3f0fc9 (0x6c21 bytes) 027000 1717557100.373800 mapread 0x0ebe96 thru 0x0ed8fd (0x1a68 bytes) 029000 1717557104.901844 mapwrite 0x02bbeb thru 0x031438 (0x584e bytes) 030000 1717557107.052560 punch from 0x045d69 to 0x052057 (0xc2ef bytes) 031000 1717557109.086179 punch from 0x1811a4 to 0x187678 (0x64d5 bytes) 033000 1717557114.009409 read 0x44d8b5 thru 0x44f571 (0x1cbd bytes) 034000 1717557115.705388 punch from 0x300aa0 to 0x30d715 (0xcc76 bytes) 035000 1717557117.878011 trunc from 0x316ed5 to 0x33e38f (0x274bb bytes) 036000 1717557120.207201 fallocate 0x1ec500 thru 0x1ef49c (0x2f9d bytes) 037000 1717557122.439777 read 0x3d7954 thru 0x3e492c (0xcfd9 bytes) 038000 1717557124.571512 punch from 0x27edb1 to 0x28eb67 (0xfdb7 bytes) 041000 1717557131.749193 punch from 0x2364ff to 0x2443cf (0xded1 bytes) 043000 1717557135.586181 punch from 0x1c70db to 0x1cadce (0x3cf4 bytes) skipping zero length punch hole 044000 1717557137.779677 read 0x13f598 thru 0x1492b1 (0x9d1a bytes) 045000 1717557139.530424 write 0x1b51f4 thru 0x1c00bc (0xaec9 bytes) 047000 1717557143.486958 write 0x1af751 thru 0x1b46ce (0x4f7e bytes) 048000 1717557145.426471 punch from 0x31192e to 0x313c80 (0x2353 bytes) 049000 1717557147.349362 trunc from 0x4868a6 to 0x01e47e (0x468427 bytes) 053000 1717557155.148260 write 0x191241 thru 0x1a0e8a (0xfc4a bytes) 054000 1717557156.978505 fallocate 0x3827e1 thru 0x3846d5 (0x1ef5 bytes) 055000 1717557158.692718 trunc from 0x45c591 to 0x1dd198 (0x27f3f8 bytes) 056000 1717557160.540360 trunc from 0x4e2a85 to 0x0f5083 (0x3eda01 bytes) 057000 1717557162.593020 fallocate 0x278003 thru 0x280917 (0x8915 bytes) 058000 1717557164.266148 mapwrite 0x4fd70e thru 0x5053be (0x7cb1 bytes) 060000 1717557168.152436 punch from 0x1f2a22 to 0x20240f (0xf9ee bytes) 062000 1717557172.237749 fallocate 0x251ba3 thru 0x254a6c (0x2eca bytes) 063000 1717557174.203937 write 0x358e32 thru 0x367c79 (0xee48 bytes) 065000 1717557177.714857 mapwrite 0x2abe10 thru 0x2afce7 (0x3ed8 bytes) 068000 1717557183.231504 punch from 0x03252b to 0x03789b (0x5371 bytes) 069000 1717557185.121509 punch from 0x301d94 to 0x303690 (0x18fd bytes) 070000 1717557186.743969 read 0x05f5fc thru 0x065103 (0x5b08 bytes) 071000 1717557188.636864 punch from 0x011057 to 0x01349c (0x2446 bytes) 073000 1717557192.721841 read 0x0d43bb thru 0x0d9542 (0x5188 bytes) 075000 1717557196.382328 punch from 0x16dd94 to 0x170cee (0x2f5b bytes) 076000 1717557198.148602 mapread 0x175c18 thru 0x17d1e8 (0x75d1 bytes) 077000 1717557200.044403 trunc from 0x39f76b to 0x2cd8a9 (0xd1ec1 bytes) 079000 1717557203.763247 punch from 0x25641a to 0x257d62 (0x1949 bytes) 082000 1717557209.584109 mapwrite 0x252f70 thru 0x25d89e (0xa92f bytes) 083000 1717557211.681754 fallocate 0x1d4967 thru 0x1d9c0a (0x52a4 bytes) 085000 1717557216.307484 write 0x246980 thru 0x249263 (0x28e4 bytes) 086000 1717557218.585357 punch from 0x372c39 to 0x378018 (0x53e0 bytes) 088000 1717557222.958383 write 0x0d8bba thru 0x0e4275 (0xb6bc bytes) 089000 1717557225.170377 mapwrite 0x0d8914 thru 0x0dbbc8 (0x32b5 bytes) 092000 1717557231.470114 read 0x0c7f17 thru 0x0c8d52 (0xe3c bytes) 094000 1717557235.496951 mapread 0x29f3c4 thru 0x2a54e7 (0x6124 bytes) 097000 1717557241.071469 write 0x102b3a thru 0x1096ec (0x6bb3 bytes) 098000 1717557243.012774 mapwrite 0x4f4d96 thru 0x4fb6d2 (0x693d bytes) 099000 1717557244.723458 trunc from 0x4e8212 to 0x13acaf (0x3ad562 bytes) 100000 1717557246.625003 fallocate 0x1ac3a6 thru 0x1ad759 (0x13b4 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (204s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 23:14:07 (1717557247) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1717557250.320165 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1717557252.912524 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1717557255.494184 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1717557258.106187 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1717557263.236037 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1717557265.445541 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1717557267.878048 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1717557270.283893 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1717557272.690533 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1717557274.926847 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1717557277.202015 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1717557279.319362 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1717557281.188258 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1717557283.444257 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1717557285.715182 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1717557287.741006 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1717557290.022652 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1717557292.507376 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1717557294.885579 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1717557302.197995 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1717557304.485242 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1717557306.832904 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1717557309.126962 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1717557313.944842 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1717557318.436905 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1717557320.626662 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1717557323.066995 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1717557328.279518 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1717557330.994552 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1717557335.374286 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1717557337.885927 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1717557340.120515 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1717557342.762421 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1717557345.270457 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1717557349.833341 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1717557356.626313 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1717557363.231410 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1717557367.797826 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1717557370.026521 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1717557372.413949 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1717557378.610781 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1717557380.717466 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1717557382.793602 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1717557384.902710 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1717557386.985652 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1717557389.010350 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1717557391.105045 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1717557393.191515 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1717557395.633156 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1717557399.707642 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1717557402.236818 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1717557404.384743 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1717557406.678544 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1717557409.131935 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1717557413.771199 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1717557420.488318 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1717557425.120251 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1717557427.432172 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1717557429.548599 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1717557434.103995 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1717557436.383792 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1717557440.580816 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1717557442.797919 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1717557447.125813 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1717557451.404346 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1717557456.040107 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1717557458.300955 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1717557460.302730 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1717557462.200167 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1717557466.544332 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1717557468.745014 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1717557473.282610 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1717557475.612555 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (229s) == sanity-benchmark test complete, duration 790 sec ====== 23:17:56 (1717557476) === sanity-benchmark: start cleanup 23:17:57 (1717557477) === === sanity-benchmark: finish cleanup 23:17:57 (1717557477) ===