-----============= acceptance-small: sanity-benchmark ============----- Wed Jul 24 23:37:09 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 23:37:13 (1721878633) === oleg104-client.virtnet: executing check_config_client /mnt/lustre oleg104-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg104-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6032800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6032800.idle_timeout=debug disable quota as required oleg104-server: oleg104-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 23:37:20 (1721878640) === == sanity-benchmark test dbench: dbench ================== 23:37:21 (1721878641) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7535] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg104-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg104-client.virtnet at Wed Jul 24 23:37:21 EDT 2024 waiting for dbench pid 9734 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 246 187.20 MB/sec warmup 1 sec latency 53.900 ms 20 547 187.78 MB/sec warmup 2 sec latency 35.461 ms 20 888 144.45 MB/sec warmup 3 sec latency 36.967 ms 20 1214 115.26 MB/sec warmup 4 sec latency 25.883 ms 20 1605 104.61 MB/sec warmup 5 sec latency 40.551 ms 20 1960 88.16 MB/sec warmup 6 sec latency 24.764 ms 20 2363 79.62 MB/sec warmup 7 sec latency 21.732 ms 20 2833 80.82 MB/sec warmup 8 sec latency 28.398 ms 20 3442 81.99 MB/sec warmup 9 sec latency 30.469 ms 20 3836 79.54 MB/sec warmup 10 sec latency 25.271 ms 20 4115 72.89 MB/sec warmup 11 sec latency 23.894 ms 20 4358 67.54 MB/sec warmup 12 sec latency 49.927 ms 20 4644 64.37 MB/sec warmup 13 sec latency 30.495 ms 20 5003 63.94 MB/sec warmup 14 sec latency 30.593 ms 20 5277 60.48 MB/sec warmup 15 sec latency 24.615 ms 20 5591 57.09 MB/sec warmup 16 sec latency 28.448 ms 20 5970 55.56 MB/sec warmup 17 sec latency 22.591 ms 20 6493 58.01 MB/sec warmup 18 sec latency 26.329 ms 20 7105 60.12 MB/sec warmup 19 sec latency 27.867 ms 20 7443 59.04 MB/sec warmup 20 sec latency 30.822 ms 20 7707 56.43 MB/sec warmup 21 sec latency 43.446 ms 20 7955 54.36 MB/sec warmup 22 sec latency 41.135 ms 20 8269 53.25 MB/sec warmup 23 sec latency 23.418 ms 20 8954 5.17 MB/sec execute 1 sec latency 35.023 ms 20 9400 13.65 MB/sec execute 2 sec latency 18.468 ms 20 9886 37.80 MB/sec execute 3 sec latency 26.529 ms 20 10613 58.46 MB/sec execute 4 sec latency 27.398 ms 20 10971 55.26 MB/sec execute 5 sec latency 23.542 ms 20 11243 46.83 MB/sec execute 6 sec latency 42.088 ms 20 11527 41.85 MB/sec execute 7 sec latency 39.401 ms 20 11861 40.81 MB/sec execute 8 sec latency 22.887 ms 20 12251 42.60 MB/sec execute 9 sec latency 31.163 ms 20 12582 38.92 MB/sec execute 10 sec latency 19.807 ms 20 12984 37.64 MB/sec execute 11 sec latency 21.361 ms 20 13490 41.90 MB/sec execute 12 sec latency 24.201 ms 20 14134 46.91 MB/sec execute 13 sec latency 26.420 ms 20 14479 46.83 MB/sec execute 14 sec latency 29.860 ms 20 14758 44.19 MB/sec execute 15 sec latency 35.643 ms 20 15047 42.11 MB/sec execute 16 sec latency 33.988 ms 20 15395 41.72 MB/sec execute 17 sec latency 25.440 ms 20 15772 42.52 MB/sec execute 18 sec latency 24.844 ms 20 16087 40.57 MB/sec execute 19 sec latency 20.155 ms 20 16482 39.51 MB/sec execute 20 sec latency 23.358 ms 20 16974 41.63 MB/sec execute 21 sec latency 29.468 ms 20 17683 45.34 MB/sec execute 22 sec latency 23.126 ms 20 18052 45.18 MB/sec execute 23 sec latency 20.471 ms 20 18334 43.58 MB/sec execute 24 sec latency 38.974 ms 20 18642 42.38 MB/sec execute 25 sec latency 31.394 ms 20 18994 42.24 MB/sec execute 26 sec latency 28.320 ms 20 19364 42.54 MB/sec execute 27 sec latency 24.896 ms 20 19716 41.24 MB/sec execute 28 sec latency 20.941 ms 20 20099 40.61 MB/sec execute 29 sec latency 25.748 ms 20 20579 42.09 MB/sec execute 30 sec latency 25.451 ms 20 21229 43.93 MB/sec execute 31 sec latency 28.830 ms 20 21612 44.42 MB/sec execute 32 sec latency 22.877 ms 20 21884 43.29 MB/sec execute 33 sec latency 36.841 ms 20 22178 42.35 MB/sec execute 34 sec latency 40.597 ms 20 22525 42.08 MB/sec execute 35 sec latency 24.679 ms 20 22925 42.54 MB/sec execute 36 sec latency 23.252 ms 20 23252 41.55 MB/sec execute 37 sec latency 23.042 ms 20 23635 40.99 MB/sec execute 38 sec latency 19.878 ms 20 24136 42.17 MB/sec execute 39 sec latency 21.562 ms 20 24801 43.83 MB/sec execute 40 sec latency 23.817 ms 20 25167 44.04 MB/sec execute 41 sec latency 25.398 ms 20 25432 43.13 MB/sec execute 42 sec latency 43.498 ms 20 25735 42.38 MB/sec execute 43 sec latency 34.496 ms 20 26072 42.28 MB/sec execute 44 sec latency 30.918 ms 20 26316 42.32 MB/sec execute 45 sec latency 578.253 ms 20 26612 41.66 MB/sec execute 46 sec latency 22.745 ms 20 26957 40.93 MB/sec execute 47 sec latency 21.761 ms 20 27345 40.82 MB/sec execute 48 sec latency 20.078 ms 20 27955 42.25 MB/sec execute 49 sec latency 25.585 ms 20 28510 43.30 MB/sec execute 50 sec latency 24.860 ms 20 28800 42.96 MB/sec execute 51 sec latency 26.631 ms 20 29039 42.22 MB/sec execute 52 sec latency 53.252 ms 20 29334 41.67 MB/sec execute 53 sec latency 31.208 ms 20 29684 41.71 MB/sec execute 54 sec latency 25.829 ms 20 30039 41.76 MB/sec execute 55 sec latency 22.229 ms 20 30333 41.11 MB/sec execute 56 sec latency 22.486 ms 20 30717 40.73 MB/sec execute 57 sec latency 19.770 ms 20 31164 41.30 MB/sec execute 58 sec latency 22.946 ms 20 31856 42.58 MB/sec execute 59 sec latency 25.435 ms 20 32243 42.81 MB/sec execute 60 sec latency 23.046 ms 20 32541 42.23 MB/sec execute 61 sec latency 36.340 ms 20 32816 41.73 MB/sec execute 62 sec latency 35.967 ms 20 33154 41.62 MB/sec execute 63 sec latency 27.290 ms 20 33532 41.85 MB/sec execute 64 sec latency 23.851 ms 20 33844 41.29 MB/sec execute 65 sec latency 23.561 ms 20 34246 40.98 MB/sec execute 66 sec latency 18.943 ms 20 34745 41.59 MB/sec execute 67 sec latency 25.133 ms 20 35432 42.68 MB/sec execute 68 sec latency 27.896 ms 20 35805 42.79 MB/sec execute 69 sec latency 21.240 ms 20 36075 42.27 MB/sec execute 70 sec latency 36.548 ms 20 36350 41.81 MB/sec execute 71 sec latency 48.577 ms 20 36662 41.64 MB/sec execute 72 sec latency 28.724 ms 20 37048 41.92 MB/sec execute 73 sec latency 24.532 ms 20 37347 41.42 MB/sec execute 74 sec latency 23.323 ms 20 37724 41.05 MB/sec execute 75 sec latency 29.557 ms 20 38178 41.47 MB/sec execute 76 sec latency 25.846 ms 20 38846 42.35 MB/sec execute 77 sec latency 24.057 ms 20 39302 42.68 MB/sec execute 78 sec latency 20.254 ms 20 39584 42.28 MB/sec execute 79 sec latency 28.862 ms 20 39888 41.89 MB/sec execute 80 sec latency 56.424 ms 20 40212 41.72 MB/sec execute 81 sec latency 30.683 ms 20 40611 41.99 MB/sec execute 82 sec latency 26.348 ms 20 40922 41.54 MB/sec execute 83 sec latency 23.987 ms 20 41327 41.28 MB/sec execute 84 sec latency 18.344 ms 20 41826 41.73 MB/sec execute 85 sec latency 21.225 ms 20 42479 42.50 MB/sec execute 86 sec latency 23.792 ms 20 42892 42.69 MB/sec execute 87 sec latency 21.902 ms 20 43176 42.32 MB/sec execute 88 sec latency 31.364 ms 20 43474 41.98 MB/sec execute 89 sec latency 28.857 ms 20 43804 41.90 MB/sec execute 90 sec latency 21.777 ms 20 44204 42.04 MB/sec execute 91 sec latency 18.911 ms 20 44527 41.65 MB/sec execute 92 sec latency 23.371 ms 20 44921 41.45 MB/sec execute 93 sec latency 19.594 ms 20 45431 41.91 MB/sec execute 94 sec latency 24.122 ms 20 46058 42.57 MB/sec execute 95 sec latency 26.770 ms 20 46431 42.66 MB/sec execute 96 sec latency 27.284 ms 20 46700 42.33 MB/sec execute 97 sec latency 45.961 ms 20 46994 42.01 MB/sec execute 98 sec latency 26.227 ms 20 47303 41.87 MB/sec execute 99 sec latency 28.406 ms 20 47647 41.94 MB/sec execute 100 sec latency 27.713 ms 20 47954 41.70 MB/sec execute 101 sec latency 22.201 ms 20 48278 41.40 MB/sec execute 102 sec latency 23.431 ms 20 48684 41.49 MB/sec execute 103 sec latency 24.290 ms 20 49279 42.03 MB/sec execute 104 sec latency 28.427 ms 20 49784 42.42 MB/sec execute 105 sec latency 68.920 ms 20 50100 42.31 MB/sec execute 106 sec latency 22.767 ms 20 50358 41.98 MB/sec execute 107 sec latency 37.629 ms 20 50668 41.77 MB/sec execute 108 sec latency 26.774 ms 20 51032 41.86 MB/sec execute 109 sec latency 24.262 ms 20 51370 41.74 MB/sec execute 110 sec latency 26.672 ms 20 51716 41.43 MB/sec execute 111 sec latency 21.908 ms 20 52137 41.38 MB/sec execute 112 sec latency 20.959 ms 20 52737 41.94 MB/sec execute 113 sec latency 29.032 ms 20 53313 42.44 MB/sec execute 114 sec latency 23.258 ms 20 53633 42.32 MB/sec execute 115 sec latency 24.530 ms 20 53891 42.02 MB/sec execute 116 sec latency 42.659 ms 20 54221 41.82 MB/sec execute 117 sec latency 29.018 ms 20 54586 41.91 MB/sec execute 118 sec latency 26.420 ms 20 54925 41.80 MB/sec execute 119 sec latency 24.275 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 161995 8.585 58.419 Close 119154 1.845 15.634 Rename 6780 12.781 43.874 Unlink 32370 2.839 37.749 Qpathinfo 146807 2.100 41.830 Qfileinfo 25587 0.066 11.087 Qfsinfo 26524 0.026 4.055 Sfileinfo 13004 8.587 46.109 Find 56413 0.398 33.459 WriteX 79520 0.911 17.799 ReadX 251964 0.013 3.916 LockX 520 2.048 7.738 UnlockX 520 1.962 5.302 Flush 11266 7.298 578.230 Throughput 41.8022 MB/sec 20 clients 20 procs max_latency=578.253 ms stopping dbench on /mnt/lustre/d0.oleg104-client.virtnet at Wed Jul 24 23:39:46 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg104-client.virtnet /mnt/lustre/d0.oleg104-client.virtnet /mnt/lustre/d0.oleg104-client.virtnet removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg104-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 23:39:48 (1721878788) min OST has 3375704kB available, using 5063556kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7535] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4944] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg104-clien 4944M 159519 98 136459 93 380628 80 6891 297 Latency 3866us 97719us 35826us 3179us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg104-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 448 16 5223 24 480 12 399 16 1118 12 761 12 Latency 18063us 32924us 33003us 17343us 11742us 28007us 1.97,1.97,oleg104-client.virtnet,1,1721885487,4944M,,,,159519,98,136459,93,,,380628,80,6891,297,10,,,,,448,16,5223,24,480,12,399,16,1118,12,761,12,,3866us,97719us,,35826us,3179us,18063us,32924us,33003us,17343us,11742us,28007us debug=0x33f0484 PASS bonnie (184s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 23:42:52 (1721878972) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 29213 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 29213 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole skipping zero length punch hole fallocating to largest ever: 0x4c11cf truncating to largest ever: 0x4c21bf truncating to largest ever: 0x510ee6 fallocating to largest ever: 0x518169 001000 1721878976.028939 read 0x37b3bc thru 0x383056 (0x7c9b bytes) fallocating to largest ever: 0x51e34e fallocating to largest ever: 0x524c40 fallocating to largest ever: 0x527ce4 fallocating to largest ever: 0x5285e2 004000 1721878982.750780 punch from 0x2e678a to 0x2e9513 (0x2d8a bytes) 005000 1721878984.319603 fallocate 0x51dc85 thru 0x520cd1 (0x304d bytes) 006000 1721878986.310086 read 0x244b9c thru 0x249ea3 (0x5308 bytes) 008000 1721878990.259834 write 0x1d6c28 thru 0x1d8f6d (0x2346 bytes) 009000 1721878992.905558 fallocate 0x1ccdb2 thru 0x1dc4fa (0xf749 bytes) 010000 1721878995.056687 punch from 0x2ceb2a to 0x2da21f (0xb6f6 bytes) 011000 1721878997.214090 fallocate 0x523897 thru 0x5285e1 (0x4d4b bytes) 012000 1721878999.380319 punch from 0x186025 to 0x189b5f (0x3b3b bytes) 014000 1721879004.618202 read 0x0afed0 thru 0x0b21d4 (0x2305 bytes) 015000 1721879007.673843 read 0x0a18bf thru 0x0ac9ba (0xb0fc bytes) 017000 1721879014.354901 trunc from 0x3d16d8 to 0x36ff5d (0x6177a bytes) 018000 1721879017.689234 mapread 0x3c684b thru 0x3d17b4 (0xaf6a bytes) 019000 1721879020.674309 read 0x0ee704 thru 0x0f4f48 (0x6845 bytes) 020000 1721879023.857407 mapread 0x1fe103 thru 0x209a3d (0xb93b bytes) 021000 1721879026.914441 mapread 0x1a21b6 thru 0x1aa245 (0x8090 bytes) 022000 1721879030.828744 fallocate 0x478724 thru 0x487116 (0xe9f3 bytes) 023000 1721879037.192462 mapread 0x13b9e1 thru 0x141e9a (0x64ba bytes) 024000 1721879043.272836 mapread 0x0c4f49 thru 0x0c9ff3 (0x50ab bytes) 025000 1721879050.582752 trunc from 0x46bc21 to 0x1a7160 (0x2c4ac0 bytes) 026000 1721879055.352535 fallocate 0x0f666e thru 0x0ffe8f (0x9822 bytes) 028000 1721879064.810963 mapread 0x0492cd thru 0x055f33 (0xcc67 bytes) 029000 1721879068.825790 write 0x0f9c9b thru 0x0fd09f (0x3405 bytes) 030000 1721879072.943605 read 0x1ff760 thru 0x20c6ae (0xcf4f bytes) 032000 1721879081.851501 mapread 0x16fcca thru 0x17049f (0x7d6 bytes) 033000 1721879086.136101 mapwrite 0x0d4986 thru 0x0dc447 (0x7ac2 bytes) 035000 1721879095.606083 mapwrite 0x48c981 thru 0x494bc4 (0x8244 bytes) 038000 1721879109.514201 mapwrite 0x4cb76a thru 0x4cce7d (0x1714 bytes) 039000 1721879113.991701 read 0x2237b1 thru 0x22be2b (0x867b bytes) 040000 1721879118.246071 punch from 0x1d53e0 to 0x1ddf8d (0x8bae bytes) 042000 1721879125.137325 mapread 0x019d38 thru 0x01d077 (0x3340 bytes) 043000 1721879129.265678 trunc from 0x302dfb to 0x14e00b (0x1b4def bytes) 044000 1721879134.170944 write 0x36d561 thru 0x37836b (0xae0b bytes) 046000 1721879142.522801 punch from 0x3070fa to 0x3122ef (0xb1f6 bytes) 047000 1721879146.978479 trunc from 0x2d760d to 0x42f339 (0x157d2d bytes) 048000 1721879151.966676 write 0x3fafeb thru 0x402828 (0x783e bytes) 049000 1721879155.962459 mapwrite 0x2d71cb thru 0x2e606e (0xeea4 bytes) 050000 1721879159.509102 read 0x288ebf thru 0x28a1e0 (0x1322 bytes) 051000 1721879163.099709 write 0x0d32c5 thru 0x0e1b4d (0xe889 bytes) 052000 1721879165.431603 mapwrite 0x09ec1d thru 0x0a2c5e (0x4042 bytes) 053000 1721879167.935715 mapwrite 0x319631 thru 0x319991 (0x361 bytes) 055000 1721879172.285322 punch from 0x068606 to 0x073d98 (0xb793 bytes) 057000 1721879177.417524 fallocate 0x12ba64 thru 0x134fc2 (0x955f bytes) 058000 1721879180.050891 punch from 0x105aba to 0x10b5ca (0x5b11 bytes) 060000 1721879184.452110 read 0x0c5430 thru 0x0c8921 (0x34f2 bytes) 061000 1721879186.952537 trunc from 0x4dae3e to 0x2d6cd7 (0x204166 bytes) 062000 1721879189.730121 write 0x1dd29a thru 0x1e943b (0xc1a2 bytes) 063000 1721879192.609534 fallocate 0x412203 thru 0x414997 (0x2795 bytes) 064000 1721879195.573138 trunc from 0x369d19 to 0x4d5fdb (0x16c2c3 bytes) 065000 1721879198.140681 mapread 0x358011 thru 0x35d091 (0x5081 bytes) 066000 1721879201.507401 fallocate 0x2969d2 thru 0x297364 (0x993 bytes) 067000 1721879204.749873 trunc from 0x418a0c to 0x458ad6 (0x400cb bytes) 069000 1721879210.311321 read 0x195b77 thru 0x1993aa (0x3834 bytes) 070000 1721879212.676679 fallocate 0x3784ca thru 0x380526 (0x805d bytes) 071000 1721879215.300989 read 0x203b9e thru 0x207f64 (0x43c7 bytes) 072000 1721879217.857200 write 0x0ce57c thru 0x0d5870 (0x72f5 bytes) 073000 1721879220.810919 trunc from 0x32be0e to 0x168187 (0x1c3c86 bytes) 074000 1721879223.166103 write 0x3bd7e8 thru 0x3bf643 (0x1e5c bytes) 077000 1721879231.187423 read 0x0eaaaa thru 0x0f0197 (0x56ee bytes) 079000 1721879236.412047 mapwrite 0x1878d4 thru 0x192fbb (0xb6e8 bytes) 080000 1721879239.054738 write 0x3f407f thru 0x3f6d7c (0x2cfe bytes) 082000 1721879244.081841 write 0x0beffb thru 0x0c37ff (0x4805 bytes) 084000 1721879248.087168 trunc from 0x423bb2 to 0x294f3a (0x18ec77 bytes) 085000 1721879250.037412 write 0x2fd2cc thru 0x307acc (0xa801 bytes) 086000 1721879251.870069 write 0x270a67 thru 0x275886 (0x4e20 bytes) 087000 1721879253.600953 trunc from 0x51eba4 to 0x12ef32 (0x3efc71 bytes) 088000 1721879255.623714 write 0x0aafc5 thru 0x0b0c05 (0x5c41 bytes) 089000 1721879257.320995 mapwrite 0x4a7e94 thru 0x4a9a7d (0x1bea bytes) 090000 1721879259.352551 mapread 0x223f81 thru 0x233217 (0xf297 bytes) 091000 1721879261.013662 trunc from 0x38222c to 0x4f6bf6 (0x1749cb bytes) 092000 1721879262.855921 mapwrite 0x2553e4 thru 0x25c104 (0x6d21 bytes) 093000 1721879264.764554 read 0x0dedf9 thru 0x0e3bf6 (0x4dfe bytes) 094000 1721879267.334253 read 0x1a1509 thru 0x1af746 (0xe23e bytes) 096000 1721879272.310589 trunc from 0x1c4827 to 0x1753b9 (0x4f46d bytes) 098000 1721879277.354300 mapwrite 0x4b403f thru 0x4b5fcc (0x1f8e bytes) 099000 1721879279.496007 read 0x1071f8 thru 0x111d65 (0xab6e bytes) skipping zero size read 100000 1721879281.899684 trunc from 0x2e26e5 to 0x36efb8 (0x8c8d4 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (311s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 23:48:03 (1721879283) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1721879286.692480 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1721879289.621369 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1721879292.053181 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1721879295.020040 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1721879300.875187 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1721879304.091042 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1721879307.922219 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1721879311.644661 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1721879315.320066 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1721879318.667823 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1721879322.381296 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1721879325.733870 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1721879328.848916 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1721879332.058145 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1721879335.261629 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1721879338.089211 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1721879340.911211 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1721879343.463883 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1721879346.272714 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1721879355.356979 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1721879358.030615 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1721879360.651581 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1721879363.182800 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1721879368.022658 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1721879372.569006 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1721879374.812263 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1721879377.115009 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1721879382.029478 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1721879384.749538 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1721879389.134776 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1721879391.857709 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1721879394.470182 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1721879397.401806 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1721879400.437429 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1721879406.168117 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1721879414.416665 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1721879421.567093 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1721879426.291644 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1721879428.631310 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1721879431.288890 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1721879437.945577 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1721879440.301062 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1721879442.492046 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1721879444.821214 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1721879447.030256 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1721879449.198911 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1721879451.902103 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1721879454.624340 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1721879457.325713 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1721879461.873870 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1721879464.466234 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1721879466.560609 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1721879468.656061 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1721879471.360864 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1721879476.682439 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1721879484.889967 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1721879490.238643 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1721879492.845940 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1721879495.312768 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1721879501.344803 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1721879504.236177 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1721879509.194321 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1721879511.798794 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1721879517.012625 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1721879522.216015 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1721879527.548254 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1721879530.160560 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1721879532.483500 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1721879534.678576 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1721879539.870551 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1721879542.663998 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1721879548.370260 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1721879551.346064 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (269s) == sanity-benchmark test complete, duration 923 sec ====== 23:52:32 (1721879552) === sanity-benchmark: start cleanup 23:52:32 (1721879552) === === sanity-benchmark: finish cleanup 23:52:32 (1721879552) ===