-----============= acceptance-small: sanity-benchmark ============----- Thu Jun 13 18:04:29 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 18:04:33 (1718316273) === oleg334-client.virtnet: executing check_config_client /mnt/lustre oleg334-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg334-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6d1d000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6d1d000.idle_timeout=debug disable quota as required oleg334-server: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 18:04:40 (1718316280) === == sanity-benchmark test dbench: dbench ================== 18:04:40 (1718316280) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7551] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg334-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg334-client.virtnet at Thu Jun 13 18:04:41 EDT 2024 waiting for dbench pid 9746 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 240 183.42 MB/sec warmup 1 sec latency 58.886 ms 20 496 172.56 MB/sec warmup 2 sec latency 39.527 ms 20 825 143.37 MB/sec warmup 3 sec latency 56.136 ms 20 1212 115.25 MB/sec warmup 4 sec latency 18.848 ms 20 1637 104.71 MB/sec warmup 5 sec latency 27.393 ms 20 2034 88.53 MB/sec warmup 6 sec latency 21.993 ms 20 2453 81.06 MB/sec warmup 7 sec latency 23.867 ms 20 2973 83.58 MB/sec warmup 8 sec latency 184.384 ms 20 3655 85.99 MB/sec warmup 9 sec latency 21.662 ms 20 3949 80.11 MB/sec warmup 10 sec latency 24.984 ms 20 4209 73.06 MB/sec warmup 11 sec latency 45.234 ms 20 4504 68.19 MB/sec warmup 12 sec latency 27.244 ms 20 4905 67.24 MB/sec warmup 13 sec latency 22.220 ms 20 5255 64.77 MB/sec warmup 14 sec latency 31.786 ms 20 5636 60.96 MB/sec warmup 15 sec latency 19.912 ms 20 6056 59.65 MB/sec warmup 16 sec latency 27.185 ms 20 6700 62.76 MB/sec warmup 17 sec latency 23.393 ms 20 7284 64.75 MB/sec warmup 18 sec latency 21.459 ms 20 7556 62.29 MB/sec warmup 19 sec latency 21.278 ms 20 7845 59.52 MB/sec warmup 20 sec latency 46.279 ms 20 8162 57.84 MB/sec warmup 21 sec latency 24.354 ms 20 8592 58.44 MB/sec warmup 22 sec latency 24.335 ms 20 8929 56.15 MB/sec warmup 23 sec latency 21.917 ms 20 9829 72.28 MB/sec execute 1 sec latency 21.887 ms 20 10522 91.14 MB/sec execute 2 sec latency 23.532 ms 20 10926 83.30 MB/sec execute 3 sec latency 26.561 ms 20 11180 63.96 MB/sec execute 4 sec latency 46.257 ms 20 11474 53.20 MB/sec execute 5 sec latency 34.791 ms 20 11817 49.84 MB/sec execute 6 sec latency 26.811 ms 20 12213 51.21 MB/sec execute 7 sec latency 22.264 ms 20 12527 45.49 MB/sec execute 8 sec latency 24.006 ms 20 12963 42.93 MB/sec execute 9 sec latency 17.078 ms 20 13463 47.23 MB/sec execute 10 sec latency 26.774 ms 20 14138 53.09 MB/sec execute 11 sec latency 23.649 ms 20 14508 52.84 MB/sec execute 12 sec latency 20.838 ms 20 14769 49.16 MB/sec execute 13 sec latency 44.582 ms 20 14993 46.24 MB/sec execute 14 sec latency 465.479 ms 20 15378 45.27 MB/sec execute 15 sec latency 21.317 ms 20 15802 46.35 MB/sec execute 16 sec latency 24.572 ms 20 16184 44.03 MB/sec execute 17 sec latency 23.834 ms 20 16628 43.51 MB/sec execute 18 sec latency 19.130 ms 20 17248 47.00 MB/sec execute 19 sec latency 23.381 ms 20 17837 49.53 MB/sec execute 20 sec latency 25.400 ms 20 18151 48.55 MB/sec execute 21 sec latency 21.121 ms 20 18439 46.57 MB/sec execute 22 sec latency 48.503 ms 20 18776 45.60 MB/sec execute 23 sec latency 25.694 ms 20 19238 46.63 MB/sec execute 24 sec latency 18.677 ms 20 19612 45.13 MB/sec execute 25 sec latency 20.305 ms 20 20054 44.17 MB/sec execute 26 sec latency 19.336 ms 20 20544 45.61 MB/sec execute 27 sec latency 23.037 ms 20 21252 48.14 MB/sec execute 28 sec latency 22.091 ms 20 21619 48.20 MB/sec execute 29 sec latency 20.794 ms 20 21874 46.80 MB/sec execute 30 sec latency 43.970 ms 20 22155 45.63 MB/sec execute 31 sec latency 42.430 ms 20 22526 45.22 MB/sec execute 32 sec latency 19.266 ms 20 22920 45.67 MB/sec execute 33 sec latency 20.425 ms 20 23266 44.51 MB/sec execute 34 sec latency 22.475 ms 20 23704 44.08 MB/sec execute 35 sec latency 20.082 ms 20 24291 45.76 MB/sec execute 36 sec latency 23.271 ms 20 24928 47.35 MB/sec execute 37 sec latency 20.772 ms 20 25252 46.96 MB/sec execute 38 sec latency 26.063 ms 20 25543 45.89 MB/sec execute 39 sec latency 40.330 ms 20 25861 45.23 MB/sec execute 40 sec latency 21.855 ms 20 26282 45.75 MB/sec execute 41 sec latency 22.690 ms 20 26653 45.07 MB/sec execute 42 sec latency 21.056 ms 20 27098 44.38 MB/sec execute 43 sec latency 16.436 ms 20 27592 45.12 MB/sec execute 44 sec latency 71.504 ms 20 28312 46.75 MB/sec execute 45 sec latency 24.860 ms 20 28705 46.98 MB/sec execute 46 sec latency 22.072 ms 20 28991 46.16 MB/sec execute 47 sec latency 31.605 ms 20 29327 45.52 MB/sec execute 48 sec latency 33.340 ms 20 29703 45.46 MB/sec execute 49 sec latency 24.736 ms 20 30098 45.47 MB/sec execute 50 sec latency 27.158 ms 20 30496 44.77 MB/sec execute 51 sec latency 20.800 ms 20 30934 44.72 MB/sec execute 52 sec latency 19.924 ms 20 31619 46.12 MB/sec execute 53 sec latency 27.156 ms 20 32137 46.92 MB/sec execute 54 sec latency 24.452 ms 20 32431 46.37 MB/sec execute 55 sec latency 21.030 ms 20 32745 45.70 MB/sec execute 56 sec latency 60.317 ms 20 33090 45.40 MB/sec execute 57 sec latency 23.392 ms 20 33500 45.70 MB/sec execute 58 sec latency 23.509 ms 20 33872 45.08 MB/sec execute 59 sec latency 21.470 ms 20 34296 44.75 MB/sec execute 60 sec latency 20.946 ms 20 34806 45.48 MB/sec execute 61 sec latency 28.937 ms 20 35470 46.55 MB/sec execute 62 sec latency 23.593 ms 20 35847 46.51 MB/sec execute 63 sec latency 19.307 ms 20 36127 45.86 MB/sec execute 64 sec latency 37.082 ms 20 36446 45.41 MB/sec execute 65 sec latency 24.609 ms 20 36884 45.71 MB/sec execute 66 sec latency 19.636 ms 20 37253 45.36 MB/sec execute 67 sec latency 19.780 ms 20 37703 44.89 MB/sec execute 68 sec latency 16.597 ms 20 38202 45.32 MB/sec execute 69 sec latency 17.804 ms 20 38898 46.34 MB/sec execute 70 sec latency 29.182 ms 20 39326 46.59 MB/sec execute 71 sec latency 25.488 ms 20 39602 46.06 MB/sec execute 72 sec latency 43.037 ms 20 39921 45.59 MB/sec execute 73 sec latency 49.109 ms 20 40321 45.58 MB/sec execute 74 sec latency 39.537 ms 20 40740 45.61 MB/sec execute 75 sec latency 23.313 ms 20 41149 45.13 MB/sec execute 76 sec latency 16.381 ms 20 41600 45.20 MB/sec execute 77 sec latency 17.796 ms 20 42232 46.03 MB/sec execute 78 sec latency 24.299 ms 20 42769 46.59 MB/sec execute 79 sec latency 21.830 ms 20 43045 46.22 MB/sec execute 80 sec latency 32.112 ms 20 43347 45.74 MB/sec execute 81 sec latency 37.355 ms 20 43676 45.51 MB/sec execute 82 sec latency 23.033 ms 20 44103 45.75 MB/sec execute 83 sec latency 22.203 ms 20 44477 45.32 MB/sec execute 84 sec latency 19.627 ms 20 44942 45.09 MB/sec execute 85 sec latency 20.379 ms 20 45549 45.80 MB/sec execute 86 sec latency 22.958 ms 20 46182 46.46 MB/sec execute 87 sec latency 23.402 ms 20 46521 46.34 MB/sec execute 88 sec latency 21.159 ms 20 46788 45.88 MB/sec execute 89 sec latency 47.756 ms 20 47135 45.61 MB/sec execute 90 sec latency 25.318 ms 20 47588 45.80 MB/sec execute 91 sec latency 16.564 ms 20 47946 45.51 MB/sec execute 92 sec latency 22.101 ms 20 48401 45.23 MB/sec execute 93 sec latency 18.925 ms 20 48966 45.72 MB/sec execute 94 sec latency 19.834 ms 20 49727 46.58 MB/sec execute 95 sec latency 19.501 ms 20 50103 46.47 MB/sec execute 96 sec latency 20.318 ms 20 50429 46.07 MB/sec execute 97 sec latency 32.654 ms 20 50789 45.87 MB/sec execute 98 sec latency 23.817 ms 20 51244 46.12 MB/sec execute 99 sec latency 21.504 ms 20 51651 45.73 MB/sec execute 100 sec latency 20.199 ms 20 52137 45.64 MB/sec execute 101 sec latency 17.342 ms 20 52825 46.39 MB/sec execute 102 sec latency 20.264 ms 20 53429 46.88 MB/sec execute 103 sec latency 22.762 ms 20 53735 46.59 MB/sec execute 104 sec latency 28.438 ms 20 54063 46.24 MB/sec execute 105 sec latency 35.565 ms 20 54455 46.21 MB/sec execute 106 sec latency 21.930 ms 20 54890 46.26 MB/sec execute 107 sec latency 26.759 ms 20 55309 45.91 MB/sec execute 108 sec latency 19.412 ms 20 55800 45.99 MB/sec execute 109 sec latency 21.515 ms 20 56571 46.77 MB/sec execute 110 sec latency 21.879 ms 20 57089 47.04 MB/sec execute 111 sec latency 16.660 ms 20 57404 46.70 MB/sec execute 112 sec latency 37.928 ms 20 57774 46.47 MB/sec execute 113 sec latency 28.345 ms 20 58250 46.67 MB/sec execute 114 sec latency 23.656 ms 20 58651 46.40 MB/sec execute 115 sec latency 22.167 ms 20 59166 46.26 MB/sec execute 116 sec latency 17.367 ms 20 59805 46.82 MB/sec execute 117 sec latency 22.032 ms 20 60410 47.27 MB/sec execute 118 sec latency 20.309 ms 20 60747 47.13 MB/sec execute 119 sec latency 19.081 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 178367 7.711 48.496 Close 130353 1.864 16.409 Rename 7595 10.230 31.033 Unlink 36610 2.812 34.763 Qpathinfo 161423 1.833 38.662 Qfileinfo 28151 0.065 6.620 Qfsinfo 30090 0.028 5.495 Sfileinfo 14396 6.214 38.833 Find 62762 0.421 39.402 WriteX 88121 0.906 17.480 ReadX 282361 0.013 4.109 LockX 600 1.901 6.711 UnlockX 600 1.998 6.382 Flush 12488 7.508 465.446 Throughput 47.1326 MB/sec 20 clients 20 procs max_latency=465.479 ms stopping dbench on /mnt/lustre/d0.oleg334-client.virtnet at Thu Jun 13 18:07:06 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg334-client.virtnet /mnt/lustre/d0.oleg334-client.virtnet /mnt/lustre/d0.oleg334-client.virtnet removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg334-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 18:07:08 (1718316428) min OST has 3352888kB available, using 5029332kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7551] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4911] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg334-clien 4911M 168294 98 130419 94 375046 80 4699 241 Latency 3074us 29749us 42995us 66366us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg334-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 475 17 8123 33 647 13 520 16 1198 12 751 12 Latency 13869us 12341us 30201us 22248us 9069us 18766us 1.97,1.97,oleg334-client.virtnet,1,1718306759,4911M,,,,168294,98,130419,94,,,375046,80,4699,241,10,,,,,475,17,8123,33,647,13,520,16,1198,12,751,12,,3074us,29749us,,42995us,66366us,13869us,12341us,30201us,22248us,9069us,18766us debug=0x33f0484 PASS bonnie (170s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 18:09:58 (1718316598) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 12837 -P /tmp -l 5401026 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 12837 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x3ffe42 fallocating to largest ever: 0x490963 fallocating to largest ever: 0x4f7fbf fallocating to largest ever: 0x512bc8 fallocating to largest ever: 0x517f2c fallocating to largest ever: 0x5269c2 001000 1718316601.844043 mapwrite 0x513b18 thru 0x51a7e7 (0x6cd0 bytes) 002000 1718316603.752959 mapwrite 0x001d9c thru 0x0097e5 (0x7a4a bytes) skipping zero length punch hole 004000 1718316607.351715 trunc from 0x2e40fd to 0x2f2dcb (0xeccf bytes) 006000 1718316611.159229 fallocate 0x2903b9 thru 0x29c1ba (0xbe02 bytes) 010000 1718316618.593277 write 0x4a27f4 thru 0x4a9c5a (0x7467 bytes) 011000 1718316620.877474 punch from 0x0dda5d to 0x0e826e (0xa812 bytes) 012000 1718316622.995864 write 0x4963e9 thru 0x49c7be (0x63d6 bytes) 013000 1718316625.188603 read 0x0ed129 thru 0x0ee8a4 (0x177c bytes) 014000 1718316627.217914 read 0x34f440 thru 0x355bc4 (0x6785 bytes) 015000 1718316629.168913 write 0x0960fc thru 0x0a3c3e (0xdb43 bytes) 016000 1718316631.095674 read 0x379ff9 thru 0x37be0a (0x1e12 bytes) 017000 1718316633.416974 mapread 0x361c50 thru 0x3668e5 (0x4c96 bytes) 018000 1718316635.678840 read 0x161019 thru 0x163e99 (0x2e81 bytes) 019000 1718316637.995603 mapwrite 0x261f9e thru 0x26f48d (0xd4f0 bytes) 020000 1718316640.172107 mapwrite 0x2f170d thru 0x2f2c47 (0x153b bytes) 021000 1718316642.454962 trunc from 0x51ca8e to 0x3be0f4 (0x15e999 bytes) 022000 1718316644.642225 fallocate 0x0ad3b1 thru 0x0b2fe0 (0x5c30 bytes) 023000 1718316647.145344 mapwrite 0x073e59 thru 0x07a0b2 (0x625a bytes) 024000 1718316649.162328 punch from 0x14b226 to 0x14c841 (0x161c bytes) 026000 1718316653.788996 read 0x0207a5 thru 0x02d585 (0xcde1 bytes) 030000 1718316662.517869 mapwrite 0x365e91 thru 0x36b06c (0x51dc bytes) 031000 1718316664.995472 punch from 0x160217 to 0x16b065 (0xae4f bytes) 032000 1718316667.195304 trunc from 0x403103 to 0x1ac14d (0x256fb5 bytes) 035000 1718316673.315248 punch from 0x0c88ed to 0x0cc71e (0x3e32 bytes) 038000 1718316680.207999 mapread 0x2d21c3 thru 0x2de828 (0xc666 bytes) 039000 1718316682.501148 trunc from 0x14ae7c to 0x0b4ce8 (0x96193 bytes) 040000 1718316684.506725 mapwrite 0x1d7f40 thru 0x1e2d9e (0xae5f bytes) 041000 1718316686.357622 read 0x47ddf5 thru 0x48b7f9 (0xda05 bytes) 042000 1718316688.468698 trunc from 0x476386 to 0x4535a0 (0x22de5 bytes) 043000 1718316690.455188 write 0x06a015 thru 0x06e683 (0x466f bytes) 044000 1718316692.512800 read 0x23102e thru 0x2366a8 (0x567b bytes) 045000 1718316694.524691 write 0x1aebda thru 0x1af753 (0xb7a bytes) 047000 1718316699.114670 fallocate 0x24c458 thru 0x25a40e (0xdfb7 bytes) 048000 1718316701.357528 fallocate 0x292a03 thru 0x29f0be (0xc6bc bytes) 049000 1718316703.699894 mapwrite 0x4d5a82 thru 0x4e3522 (0xdaa1 bytes) 050000 1718316705.905989 fallocate 0x27d72b thru 0x284b96 (0x746c bytes) 052000 1718316710.007527 punch from 0x0a7680 to 0x0aa574 (0x2ef5 bytes) 053000 1718316711.976667 write 0x0bbb5c thru 0x0bc1da (0x67f bytes) 054000 1718316713.782602 mapwrite 0x133520 thru 0x141359 (0xde3a bytes) 059000 1718316724.205414 mapread 0x00ca59 thru 0x0101b3 (0x375b bytes) 061000 1718316728.486255 mapread 0x35139b thru 0x35af73 (0x9bd9 bytes) 062000 1718316730.535579 trunc from 0x4de1cf to 0x1ffc18 (0x2de5b6 bytes) 063000 1718316732.556212 read 0x40f960 thru 0x415ac4 (0x6165 bytes) 065000 1718316736.545447 mapread 0x16a150 thru 0x16fe50 (0x5d01 bytes) 066000 1718316738.128230 mapwrite 0x4041ff thru 0x40844f (0x4251 bytes) 069000 1718316744.472094 mapwrite 0x290c9e thru 0x29ec39 (0xdf9c bytes) 070000 1718316746.644047 read 0x34c34f thru 0x34c47b (0x12d bytes) 071000 1718316748.461823 fallocate 0x20599e thru 0x20a06c (0x46cf bytes) 072000 1718316750.660264 trunc from 0x4e6786 to 0x2809dd (0x265da8 bytes) 073000 1718316752.613218 punch from 0x29643a to 0x29b6a6 (0x526d bytes) 074000 1718316754.768465 mapread 0x1411e9 thru 0x147ed2 (0x6cea bytes) 075000 1718316756.708844 mapread 0x105535 thru 0x110faf (0xba7b bytes) 077000 1718316760.980531 mapwrite 0x12302d thru 0x130968 (0xd93c bytes) 078000 1718316763.070844 trunc from 0x518fe4 to 0x1c4c3c (0x3543a7 bytes) 082000 1718316770.611757 trunc from 0x507c53 to 0x134474 (0x3d37de bytes) 083000 1718316772.516600 mapread 0x27a977 thru 0x28885c (0xdee6 bytes) 084000 1718316774.491270 punch from 0x0c0f76 to 0x0cdb00 (0xcb8b bytes) 085000 1718316776.322600 fallocate 0x0df1bc thru 0x0eeac0 (0xf905 bytes) 086000 1718316778.282397 read 0x0936eb thru 0x0a2f9d (0xf8b3 bytes) 087000 1718316780.336745 mapwrite 0x26c3d3 thru 0x26d8cf (0x14fd bytes) 088000 1718316782.265836 mapread 0x0df74d thru 0x0e6897 (0x714b bytes) 089000 1718316784.045046 mapwrite 0x12635f thru 0x12dd4a (0x79ec bytes) 091000 1718316787.912736 mapread 0x05c67d thru 0x068754 (0xc0d8 bytes) 092000 1718316789.805191 punch from 0x063143 to 0x0658cb (0x2789 bytes) 095000 1718316795.813224 fallocate 0x417848 thru 0x4211c2 (0x997b bytes) 096000 1718316797.687521 punch from 0x04cc5c to 0x059899 (0xcc3e bytes) 097000 1718316799.710131 mapread 0x07f629 thru 0x085b11 (0x64e9 bytes) 098000 1718316801.467782 mapread 0x316ce9 thru 0x31a213 (0x352b bytes) 099000 1718316803.271787 punch from 0x2fa560 to 0x304f60 (0xaa01 bytes) 100000 1718316805.272720 mapread 0x052d6b thru 0x0555b5 (0x284b bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (208s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 18:13:26 (1718316806) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1718316809.292871 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1718316811.657290 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1718316814.144320 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1718316816.614311 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1718316821.405725 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1718316823.700147 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1718316826.262250 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1718316828.740468 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1718316831.115647 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1718316833.351505 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1718316835.747690 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1718316838.069274 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1718316840.110798 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1718316842.538130 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1718316844.952381 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1718316847.043590 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1718316849.432416 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1718316851.911224 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1718316854.395329 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1718316862.549212 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1718316865.152749 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1718316867.601676 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1718316869.999865 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1718316874.698080 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1718316879.462817 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1718316881.926369 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1718316884.449274 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1718316890.182812 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1718316893.133718 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1718316897.714905 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1718316900.269757 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1718316902.587767 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1718316905.603135 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1718316908.350794 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1718316913.471965 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1718316920.581483 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1718316927.620063 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1718316932.917662 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1718316935.459324 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1718316938.159420 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1718316944.993908 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1718316947.606655 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1718316950.263734 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1718316952.838772 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1718316955.424620 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1718316957.769707 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1718316960.256725 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1718316963.540733 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1718316966.399151 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1718316971.576956 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1718316974.523359 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1718316976.904318 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1718316979.662622 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1718316982.761927 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1718316987.810856 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1718316995.724039 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1718317002.104193 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1718317005.438834 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1718317008.029169 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1718317013.617923 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1718317016.645762 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1718317022.384508 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1718317025.593294 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1718317031.337445 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1718317037.296417 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1718317044.936006 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1718317049.138307 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1718317051.791938 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1718317054.341954 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1718317059.593395 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1718317062.026086 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1718317073.056365 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1718317079.637143 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (275s) == sanity-benchmark test complete, duration 812 sec ====== 18:18:01 (1718317081) === sanity-benchmark: start cleanup 18:18:02 (1718317082) === === sanity-benchmark: finish cleanup 18:18:02 (1718317082) ===