-----============= acceptance-small: sanity-benchmark ============----- Wed Jul 24 23:55:30 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 23:55:34 (1721879734) === oleg315-client.virtnet: executing check_config_client /mnt/lustre oleg315-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg315-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6e47000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6e47000.idle_timeout=debug disable quota as required oleg315-server: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 23:55:41 (1721879741) === == sanity-benchmark test dbench: dbench ================== 23:55:41 (1721879741) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7555] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg315-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg315-client.virtnet at Wed Jul 24 23:55:41 EDT 2024 waiting for dbench pid 9753 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 270 202.45 MB/sec warmup 1 sec latency 48.765 ms 20 603 201.34 MB/sec warmup 2 sec latency 35.345 ms 20 901 144.69 MB/sec warmup 3 sec latency 51.714 ms 20 1212 115.23 MB/sec warmup 4 sec latency 26.277 ms 20 1593 104.53 MB/sec warmup 5 sec latency 40.867 ms 20 1949 88.16 MB/sec warmup 6 sec latency 26.701 ms 20 2330 79.40 MB/sec warmup 7 sec latency 25.769 ms 20 2543 72.64 MB/sec warmup 8 sec latency 395.032 ms 20 3156 75.97 MB/sec warmup 9 sec latency 27.659 ms 20 3709 77.85 MB/sec warmup 10 sec latency 24.805 ms 20 3977 72.83 MB/sec warmup 11 sec latency 24.527 ms 20 4213 67.01 MB/sec warmup 12 sec latency 56.236 ms 20 4441 62.69 MB/sec warmup 13 sec latency 41.467 ms 20 4732 60.18 MB/sec warmup 14 sec latency 31.277 ms 20 5065 60.23 MB/sec warmup 15 sec latency 35.761 ms 20 5311 56.73 MB/sec warmup 16 sec latency 27.331 ms 20 5593 53.74 MB/sec warmup 17 sec latency 23.817 ms 20 5927 52.20 MB/sec warmup 18 sec latency 27.028 ms 20 6395 53.94 MB/sec warmup 19 sec latency 27.780 ms 20 7035 56.62 MB/sec warmup 20 sec latency 26.333 ms 20 7392 56.10 MB/sec warmup 21 sec latency 20.564 ms 20 7671 53.84 MB/sec warmup 22 sec latency 43.579 ms 20 8001 52.09 MB/sec warmup 23 sec latency 36.520 ms 20 8778 49.40 MB/sec execute 1 sec latency 26.033 ms 20 9165 28.52 MB/sec execute 2 sec latency 19.162 ms 20 9576 31.09 MB/sec execute 3 sec latency 21.636 ms 20 10262 52.34 MB/sec execute 4 sec latency 25.712 ms 20 10852 63.01 MB/sec execute 5 sec latency 16.458 ms 20 11193 54.48 MB/sec execute 6 sec latency 18.994 ms 20 11509 48.45 MB/sec execute 7 sec latency 60.666 ms 20 11903 46.88 MB/sec execute 8 sec latency 19.433 ms 20 12246 47.83 MB/sec execute 9 sec latency 116.050 ms 20 12564 43.58 MB/sec execute 10 sec latency 20.665 ms 20 12994 41.97 MB/sec execute 11 sec latency 16.654 ms 20 13519 46.56 MB/sec execute 12 sec latency 25.024 ms 20 14202 51.60 MB/sec execute 13 sec latency 23.818 ms 20 14551 50.55 MB/sec execute 14 sec latency 19.622 ms 20 14841 47.45 MB/sec execute 15 sec latency 44.682 ms 20 15181 45.66 MB/sec execute 16 sec latency 31.101 ms 20 15627 47.19 MB/sec execute 17 sec latency 24.458 ms 20 15956 45.31 MB/sec execute 18 sec latency 21.658 ms 20 16332 43.40 MB/sec execute 19 sec latency 18.579 ms 20 16730 43.52 MB/sec execute 20 sec latency 22.918 ms 20 17394 46.63 MB/sec execute 21 sec latency 26.784 ms 20 17924 48.88 MB/sec execute 22 sec latency 26.117 ms 20 18228 47.45 MB/sec execute 23 sec latency 18.392 ms 20 18530 45.85 MB/sec execute 24 sec latency 45.917 ms 20 18842 45.13 MB/sec execute 25 sec latency 29.127 ms 20 19218 45.68 MB/sec execute 26 sec latency 27.077 ms 20 19520 44.38 MB/sec execute 27 sec latency 25.691 ms 20 19886 43.08 MB/sec execute 28 sec latency 19.343 ms 20 20258 42.88 MB/sec execute 29 sec latency 19.499 ms 20 20909 45.18 MB/sec execute 30 sec latency 26.495 ms 20 21445 46.80 MB/sec execute 31 sec latency 29.474 ms 20 21742 46.07 MB/sec execute 32 sec latency 20.355 ms 20 22001 44.82 MB/sec execute 33 sec latency 49.262 ms 20 22290 43.95 MB/sec execute 34 sec latency 38.351 ms 20 22710 44.62 MB/sec execute 35 sec latency 28.225 ms 20 23013 43.89 MB/sec execute 36 sec latency 23.349 ms 20 23341 42.88 MB/sec execute 37 sec latency 22.842 ms 20 23743 42.56 MB/sec execute 38 sec latency 18.478 ms 20 24299 44.10 MB/sec execute 39 sec latency 32.550 ms 20 24919 45.53 MB/sec execute 40 sec latency 27.750 ms 20 25245 45.28 MB/sec execute 41 sec latency 18.040 ms 20 25521 44.29 MB/sec execute 42 sec latency 46.669 ms 20 25795 43.57 MB/sec execute 43 sec latency 39.037 ms 20 26159 43.54 MB/sec execute 44 sec latency 26.193 ms 20 26524 43.60 MB/sec execute 45 sec latency 23.694 ms 20 26829 42.77 MB/sec execute 46 sec latency 26.316 ms 20 27231 42.46 MB/sec execute 47 sec latency 18.471 ms 20 27825 43.79 MB/sec execute 48 sec latency 21.379 ms 20 28478 45.04 MB/sec execute 49 sec latency 20.264 ms 20 28780 44.75 MB/sec execute 50 sec latency 19.981 ms 20 29003 43.95 MB/sec execute 51 sec latency 40.795 ms 20 29312 43.34 MB/sec execute 52 sec latency 32.282 ms 20 29674 43.32 MB/sec execute 53 sec latency 20.154 ms 20 30036 43.41 MB/sec execute 54 sec latency 21.786 ms 20 30332 42.71 MB/sec execute 55 sec latency 24.078 ms 20 30724 42.34 MB/sec execute 56 sec latency 19.705 ms 20 31174 42.95 MB/sec execute 57 sec latency 25.678 ms 20 31848 44.13 MB/sec execute 58 sec latency 26.454 ms 20 32231 44.33 MB/sec execute 59 sec latency 22.862 ms 20 32505 43.71 MB/sec execute 60 sec latency 45.986 ms 20 32793 43.16 MB/sec execute 61 sec latency 52.759 ms 20 33145 42.94 MB/sec execute 62 sec latency 24.651 ms 20 33532 43.22 MB/sec execute 63 sec latency 21.524 ms 20 33867 42.67 MB/sec execute 64 sec latency 18.902 ms 20 34284 42.39 MB/sec execute 65 sec latency 24.546 ms 20 34772 43.07 MB/sec execute 66 sec latency 23.943 ms 20 35447 44.10 MB/sec execute 67 sec latency 28.402 ms 20 35816 44.10 MB/sec execute 68 sec latency 21.190 ms 20 36111 43.57 MB/sec execute 69 sec latency 36.624 ms 20 36444 43.20 MB/sec execute 70 sec latency 28.607 ms 20 36861 43.40 MB/sec execute 71 sec latency 22.308 ms 20 37226 43.20 MB/sec execute 72 sec latency 22.263 ms 20 37606 42.71 MB/sec execute 73 sec latency 20.911 ms 20 38025 42.81 MB/sec execute 74 sec latency 36.386 ms 20 38743 43.83 MB/sec execute 75 sec latency 22.537 ms 20 39242 44.33 MB/sec execute 76 sec latency 19.458 ms 20 39562 43.99 MB/sec execute 77 sec latency 34.261 ms 20 39881 43.56 MB/sec execute 78 sec latency 31.795 ms 20 40238 43.41 MB/sec execute 79 sec latency 22.361 ms 20 40635 43.59 MB/sec execute 80 sec latency 23.087 ms 20 40958 43.16 MB/sec execute 81 sec latency 22.160 ms 20 41347 42.89 MB/sec execute 82 sec latency 23.436 ms 20 41862 43.42 MB/sec execute 83 sec latency 24.716 ms 20 42531 44.27 MB/sec execute 84 sec latency 23.748 ms 20 42928 44.28 MB/sec execute 85 sec latency 16.970 ms 20 43245 43.87 MB/sec execute 86 sec latency 40.565 ms 20 43575 43.59 MB/sec execute 87 sec latency 23.028 ms 20 44016 43.88 MB/sec execute 88 sec latency 21.287 ms 20 44362 43.55 MB/sec execute 89 sec latency 19.707 ms 20 44755 43.19 MB/sec execute 90 sec latency 17.610 ms 20 45218 43.41 MB/sec execute 91 sec latency 19.490 ms 20 45925 44.23 MB/sec execute 92 sec latency 24.490 ms 20 46389 44.51 MB/sec execute 93 sec latency 18.166 ms 20 46700 44.17 MB/sec execute 94 sec latency 31.969 ms 20 47000 43.83 MB/sec execute 95 sec latency 31.655 ms 20 47357 43.70 MB/sec execute 96 sec latency 23.189 ms 20 47751 43.84 MB/sec execute 97 sec latency 21.083 ms 20 48101 43.49 MB/sec execute 98 sec latency 20.863 ms 20 48521 43.34 MB/sec execute 99 sec latency 23.115 ms 20 49102 43.95 MB/sec execute 100 sec latency 26.955 ms 20 49734 44.54 MB/sec execute 101 sec latency 21.298 ms 20 50095 44.43 MB/sec execute 102 sec latency 18.967 ms 20 50403 44.08 MB/sec execute 103 sec latency 38.109 ms 20 50733 43.90 MB/sec execute 104 sec latency 30.430 ms 20 51160 44.06 MB/sec execute 105 sec latency 23.478 ms 20 51509 43.79 MB/sec execute 106 sec latency 17.924 ms 20 51905 43.51 MB/sec execute 107 sec latency 20.600 ms 20 52432 43.89 MB/sec execute 108 sec latency 23.102 ms 20 53132 44.57 MB/sec execute 109 sec latency 22.239 ms 20 53525 44.60 MB/sec execute 110 sec latency 20.757 ms 20 53822 44.31 MB/sec execute 111 sec latency 38.108 ms 20 54153 44.06 MB/sec execute 112 sec latency 32.318 ms 20 54530 44.05 MB/sec execute 113 sec latency 28.490 ms 20 54902 44.02 MB/sec execute 114 sec latency 19.816 ms 20 55286 43.73 MB/sec execute 115 sec latency 21.057 ms 20 55717 43.72 MB/sec execute 116 sec latency 23.312 ms 20 56402 44.32 MB/sec execute 117 sec latency 24.757 ms 20 56913 44.69 MB/sec execute 118 sec latency 22.303 ms 20 57233 44.51 MB/sec execute 119 sec latency 20.133 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 170247 8.221 60.660 Close 124797 1.737 31.334 Rename 7117 11.981 34.216 Unlink 34393 2.718 39.471 Qpathinfo 154240 1.990 30.367 Qfileinfo 26928 0.058 8.204 Qfsinfo 28160 0.023 7.029 Sfileinfo 13510 8.153 39.031 Find 59567 0.379 37.119 WriteX 83681 0.866 19.302 ReadX 267386 0.011 3.700 LockX 560 1.887 4.867 UnlockX 560 1.952 6.166 Flush 11783 6.769 116.032 Throughput 44.5097 MB/sec 20 clients 20 procs max_latency=116.050 ms stopping dbench on /mnt/lustre/d0.oleg315-client.virtnet at Wed Jul 24 23:58:06 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg315-client.virtnet /mnt/lustre/d0.oleg315-client.virtnet /mnt/lustre/d0.oleg315-client.virtnet removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg315-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (147s) == sanity-benchmark test bonnie: bonnie++ ================ 23:58:08 (1721879888) min OST has 3362552kB available, using 5043828kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7555] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4925] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg315-clien 4925M 169162 99 137934 93 386488 72 6207 280 Latency 3554us 60454us 57824us 3076us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg315-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 556 17 9748 34 845 13 448 16 1121 12 660 12 Latency 13782us 11250us 20768us 16543us 6429us 15371us 1.97,1.97,oleg315-client.virtnet,1,1721886490,4925M,,,,169162,99,137934,93,,,386488,72,6207,280,10,,,,,556,17,9748,34,845,13,448,16,1121,12,660,12,,3554us,60454us,,57824us,3076us,13782us,11250us,20768us,16543us,6429us,15371us debug=0x33f0484 PASS bonnie (166s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 00:00:55 (1721880055) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 5330 -P /tmp -l 5400786 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 5330 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole fallocating to largest ever: 0x43ffb1 fallocating to largest ever: 0x50ca1c truncating to largest ever: 0x52352e fallocating to largest ever: 0x5268d2 001000 1721880058.536513 punch from 0x0a60a1 to 0x0a97b8 (0x3718 bytes) 002000 1721880060.748741 mapwrite 0x4e9017 thru 0x4f0ac3 (0x7aad bytes) 003000 1721880062.975443 mapread 0x035088 thru 0x043c4a (0xebc3 bytes) 004000 1721880065.037909 punch from 0x45b97f to 0x4650ec (0x976e bytes) 005000 1721880067.097651 read 0x27de57 thru 0x2850f8 (0x72a2 bytes) 006000 1721880069.299151 punch from 0x32db9b to 0x33a50e (0xc974 bytes) 007000 1721880071.323759 read 0x1303d9 thru 0x136290 (0x5eb8 bytes) 008000 1721880073.397444 trunc from 0x372d09 to 0x37243b (0x8cd bytes) 009000 1721880075.512735 fallocate 0x329c8f thru 0x32a99a (0xd0c bytes) skipping zero size write 011000 1721880079.927528 fallocate 0x1163d7 thru 0x11fcef (0x9919 bytes) 012000 1721880082.130049 mapwrite 0x35b34e thru 0x35ced3 (0x1b86 bytes) 013000 1721880083.995401 write 0x3bf1af thru 0x3cec45 (0xfa97 bytes) 015000 1721880088.109237 read 0x0918af thru 0x0939af (0x2101 bytes) 017000 1721880092.427773 read 0x21fc89 thru 0x22e599 (0xe911 bytes) 018000 1721880094.392702 fallocate 0x2680b9 thru 0x26f1e0 (0x7128 bytes) 019000 1721880096.501115 write 0x3ffc68 thru 0x40234e (0x26e7 bytes) 020000 1721880098.680858 read 0x0f0ea8 thru 0x0f3821 (0x297a bytes) 021000 1721880100.535445 write 0x1532cf thru 0x15e409 (0xb13b bytes) 022000 1721880102.959802 trunc from 0x5268d2 to 0x4869a3 (0x9ff2e bytes) 023000 1721880105.078098 read 0x1d461e thru 0x1de43c (0x9e1f bytes) 025000 1721880109.198925 trunc from 0x40ad3b to 0x0c0a66 (0x34a2d4 bytes) 026000 1721880111.171459 write 0x46eea0 thru 0x47ce4c (0xdfad bytes) 027000 1721880113.291038 mapwrite 0x33bc3e thru 0x342cf0 (0x70b3 bytes) 028000 1721880115.277643 fallocate 0x267d99 thru 0x272edf (0xb147 bytes) 030000 1721880119.943985 punch from 0x0ad843 to 0x0b4f4b (0x7709 bytes) 031000 1721880122.173764 write 0x214c81 thru 0x21dd44 (0x90c4 bytes) 035000 1721880130.881582 fallocate 0x4dd217 thru 0x4e8c05 (0xb9ef bytes) 036000 1721880132.912495 fallocate 0x4b4c14 thru 0x4bb713 (0x6b00 bytes) 040000 1721880141.401730 mapwrite 0x1a9594 thru 0x1b5f6e (0xc9db bytes) 042000 1721880145.400007 punch from 0x00ace9 to 0x01787d (0xcb95 bytes) 043000 1721880147.397039 mapread 0x4d08ac thru 0x4d2118 (0x186d bytes) 045000 1721880151.478600 mapread 0x186b68 thru 0x18a255 (0x36ee bytes) 046000 1721880153.633623 write 0x0ca421 thru 0x0d498b (0xa56b bytes) 048000 1721880157.951710 trunc from 0x2cb435 to 0x47f649 (0x1b4215 bytes) 049000 1721880159.828022 read 0x04e00f thru 0x05897c (0xa96e bytes) 051000 1721880163.852273 punch from 0x31e65e to 0x31fb64 (0x1507 bytes) 052000 1721880166.213872 mapwrite 0x39cdce thru 0x3a8fcc (0xc1ff bytes) 053000 1721880168.310921 read 0x2791b4 thru 0x28712a (0xdf77 bytes) 054000 1721880170.333304 read 0x33a392 thru 0x33a72f (0x39e bytes) 055000 1721880172.429773 fallocate 0x0b4e3c thru 0x0bbb24 (0x6ce9 bytes) 056000 1721880174.509145 mapwrite 0x0b9b9a thru 0x0c845a (0xe8c1 bytes) 057000 1721880176.698064 read 0x0032f9 thru 0x00f6bb (0xc3c3 bytes) 059000 1721880180.998439 write 0x3849c0 thru 0x389693 (0x4cd4 bytes) 060000 1721880183.285640 mapread 0x15f924 thru 0x16f23d (0xf91a bytes) skipping zero size write 063000 1721880190.270343 trunc from 0x2f861b to 0x2a19de (0x56c3c bytes) 068000 1721880201.149619 mapread 0x16ba72 thru 0x1730b5 (0x7644 bytes) 069000 1721880203.170443 trunc from 0x4f0d1a to 0x300eb7 (0x1efe62 bytes) 071000 1721880207.254789 trunc from 0x4de3b4 to 0x2a85e9 (0x235dca bytes) 073000 1721880211.477669 read 0x26af37 thru 0x2748a9 (0x9973 bytes) 074000 1721880213.384142 mapread 0x055812 thru 0x058afc (0x32eb bytes) 076000 1721880217.856542 mapwrite 0x26af65 thru 0x2766c7 (0xb763 bytes) 078000 1721880221.842432 fallocate 0x13c234 thru 0x14a071 (0xde3e bytes) 081000 1721880228.297032 mapwrite 0x38021c thru 0x38081a (0x5ff bytes) 082000 1721880230.337755 mapwrite 0x270b6a thru 0x272f46 (0x23dd bytes) 083000 1721880232.606328 fallocate 0x2d2b13 thru 0x2d4179 (0x1667 bytes) 084000 1721880234.732457 punch from 0x02195f to 0x03065f (0xed01 bytes) 085000 1721880236.945634 write 0x1084d8 thru 0x10e458 (0x5f81 bytes) 086000 1721880239.076404 write 0x32f65c thru 0x3342d4 (0x4c79 bytes) 087000 1721880241.128043 read 0x06a2a2 thru 0x077a9e (0xd7fd bytes) 088000 1721880243.075059 write 0x34a77a thru 0x350347 (0x5bce bytes) 089000 1721880245.257705 read 0x213fb7 thru 0x21a4e2 (0x652c bytes) 090000 1721880247.138591 mapwrite 0x174c06 thru 0x17ddae (0x91a9 bytes) 091000 1721880249.399041 write 0x17be7d thru 0x17eea3 (0x3027 bytes) 092000 1721880251.288468 punch from 0x122985 to 0x1270c0 (0x473c bytes) 093000 1721880253.250542 punch from 0x45212c to 0x4597ce (0x76a3 bytes) 094000 1721880255.325004 read 0x0004f8 thru 0x0019ab (0x14b4 bytes) 095000 1721880257.378057 trunc from 0x3d677b to 0x4a6d19 (0xd059f bytes) 096000 1721880259.202304 mapwrite 0x07e0a8 thru 0x080494 (0x23ed bytes) 099000 1721880265.420562 trunc from 0x4ed7ec to 0x4ce5e7 (0x1f204 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (213s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 00:04:28 (1721880268) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1721880271.643538 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1721880274.429425 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1721880277.384080 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1721880280.241447 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1721880285.489411 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1721880288.012272 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1721880290.876110 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1721880293.644545 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1721880296.437429 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1721880298.956006 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1721880301.640344 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1721880304.122802 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1721880306.254150 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1721880308.754237 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1721880311.229139 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1721880313.478517 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1721880316.193339 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1721880318.837279 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1721880321.583703 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1721880330.492139 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1721880333.221706 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1721880335.776344 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1721880338.333745 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1721880343.371968 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1721880348.446080 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1721880351.095190 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1721880353.659028 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1721880359.744758 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1721880363.093181 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1721880368.405723 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1721880371.394573 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1721880373.913712 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1721880377.078616 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1721880380.272269 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1721880385.821911 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1721880393.603108 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1721880402.243246 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1721880407.661824 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1721880410.291892 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1721880412.903741 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1721880419.678905 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1721880422.338298 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1721880424.777639 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1721880427.545063 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1721880430.314607 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1721880432.801255 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1721880435.086088 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1721880437.348560 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1721880439.845596 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1721880444.036890 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1721880446.492281 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1721880448.727641 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1721880450.946322 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1721880453.240718 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1721880457.648524 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1721880464.425968 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1721880469.263521 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1721880471.646295 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1721880473.969451 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1721880478.742894 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1721880481.283584 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1721880486.231022 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1721880488.760711 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1721880493.752802 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1721880498.546847 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1721880503.329079 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1721880505.700316 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1721880507.904856 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1721880510.059450 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1721880514.929272 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1721880517.448289 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1721880522.209838 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1721880524.640684 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (257s) == sanity-benchmark test complete, duration 795 sec ====== 00:08:45 (1721880525) === sanity-benchmark: start cleanup 00:08:45 (1721880525) === === sanity-benchmark: finish cleanup 00:08:46 (1721880526) ===