-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:18 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:28 (1734015868) === oleg217-client.virtnet: executing check_config_client /mnt/lustre oleg217-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg217-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b555a800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b555a800.idle_timeout=debug disable quota as required oleg217-server: oleg217-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:49 (1734015889) === == sanity-benchmark test dbench: dbench ================== 10:04:51 (1734015891) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7595] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg217-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg217-client.virtnet at Thu Dec 12 10:04:54 EST 2024 waiting for dbench pid 10293 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 16 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 0 6 0.00 MB/sec warmup 1 sec latency 785.991 ms 20 72 31.64 MB/sec warmup 2 sec latency 174.978 ms 20 139 40.49 MB/sec warmup 3 sec latency 253.962 ms 20 186 37.31 MB/sec warmup 4 sec latency 179.142 ms 20 238 36.41 MB/sec warmup 5 sec latency 153.256 ms 20 286 35.45 MB/sec warmup 6 sec latency 155.976 ms 20 339 34.98 MB/sec warmup 7 sec latency 131.634 ms 20 391 34.66 MB/sec warmup 8 sec latency 149.409 ms 20 437 34.14 MB/sec warmup 9 sec latency 165.433 ms 20 494 34.40 MB/sec warmup 10 sec latency 149.166 ms 20 585 36.33 MB/sec warmup 11 sec latency 155.070 ms 20 658 35.12 MB/sec warmup 12 sec latency 158.606 ms 20 702 32.59 MB/sec warmup 13 sec latency 122.062 ms 20 743 30.41 MB/sec warmup 14 sec latency 148.933 ms 20 784 28.51 MB/sec warmup 15 sec latency 136.234 ms 20 832 26.87 MB/sec warmup 16 sec latency 120.769 ms 20 880 25.45 MB/sec warmup 17 sec latency 128.538 ms 20 908 24.12 MB/sec warmup 18 sec latency 440.932 ms 20 911 22.88 MB/sec warmup 19 sec latency 1441.130 ms 20 913 21.73 MB/sec warmup 20 sec latency 2434.147 ms 20 935 20.71 MB/sec warmup 21 sec latency 3034.122 ms 20 980 19.88 MB/sec warmup 22 sec latency 123.537 ms 20 1057 19.85 MB/sec warmup 23 sec latency 131.922 ms 20 1177 0.84 MB/sec execute 1 sec latency 127.968 ms 20 1226 0.93 MB/sec execute 2 sec latency 95.550 ms 20 1320 8.40 MB/sec execute 3 sec latency 109.525 ms 20 1424 15.14 MB/sec execute 4 sec latency 139.287 ms 20 1479 12.22 MB/sec execute 5 sec latency 106.388 ms 20 1532 10.34 MB/sec execute 6 sec latency 110.496 ms 20 1601 9.06 MB/sec execute 7 sec latency 113.378 ms 20 1658 8.05 MB/sec execute 8 sec latency 119.928 ms 20 1710 7.24 MB/sec execute 9 sec latency 129.562 ms 20 1791 6.65 MB/sec execute 10 sec latency 106.152 ms 20 1852 6.12 MB/sec execute 11 sec latency 95.865 ms 20 1919 5.75 MB/sec execute 12 sec latency 98.000 ms 20 1986 5.37 MB/sec execute 13 sec latency 108.448 ms 20 2034 5.12 MB/sec execute 14 sec latency 111.770 ms 20 2107 4.90 MB/sec execute 15 sec latency 98.191 ms 20 2160 4.66 MB/sec execute 16 sec latency 116.245 ms 20 2212 4.45 MB/sec execute 17 sec latency 128.952 ms 20 2327 5.33 MB/sec execute 18 sec latency 136.480 ms 20 2384 5.24 MB/sec execute 19 sec latency 110.061 ms 20 2432 5.11 MB/sec execute 20 sec latency 108.668 ms 20 2486 5.43 MB/sec execute 21 sec latency 125.811 ms 20 2576 5.42 MB/sec execute 22 sec latency 110.289 ms 20 2715 7.13 MB/sec execute 23 sec latency 128.350 ms 20 2886 7.98 MB/sec execute 24 sec latency 118.358 ms 20 2978 8.39 MB/sec execute 25 sec latency 101.737 ms 20 3115 8.40 MB/sec execute 26 sec latency 110.523 ms 20 3236 8.66 MB/sec execute 27 sec latency 127.476 ms 20 3360 8.85 MB/sec execute 28 sec latency 95.973 ms 20 3517 10.50 MB/sec execute 29 sec latency 104.128 ms 20 3593 10.32 MB/sec execute 30 sec latency 82.621 ms 20 3667 10.13 MB/sec execute 31 sec latency 99.127 ms 20 3725 10.04 MB/sec execute 32 sec latency 103.252 ms 20 3788 10.13 MB/sec execute 33 sec latency 124.424 ms 20 3829 9.86 MB/sec execute 34 sec latency 111.341 ms 20 3876 9.63 MB/sec execute 35 sec latency 108.763 ms 20 3927 9.47 MB/sec execute 36 sec latency 119.302 ms 20 3969 9.22 MB/sec execute 37 sec latency 199.874 ms 20 4001 8.98 MB/sec execute 38 sec latency 129.114 ms 20 4049 8.75 MB/sec execute 39 sec latency 106.365 ms 20 4104 8.54 MB/sec execute 40 sec latency 99.279 ms 20 4192 8.36 MB/sec execute 41 sec latency 94.885 ms 20 4237 8.21 MB/sec execute 42 sec latency 172.523 ms 20 4286 8.07 MB/sec execute 43 sec latency 116.683 ms 20 4348 7.96 MB/sec execute 44 sec latency 95.213 ms 20 4405 7.84 MB/sec execute 45 sec latency 109.917 ms 20 4468 7.74 MB/sec execute 46 sec latency 97.211 ms 20 4525 7.63 MB/sec execute 47 sec latency 87.958 ms 20 4590 7.71 MB/sec execute 48 sec latency 92.253 ms 20 4686 7.79 MB/sec execute 49 sec latency 111.153 ms 20 4756 7.66 MB/sec execute 50 sec latency 86.576 ms 20 4827 7.62 MB/sec execute 51 sec latency 87.600 ms 20 4960 8.45 MB/sec execute 52 sec latency 94.014 ms 20 5022 8.35 MB/sec execute 53 sec latency 121.011 ms 20 5076 8.21 MB/sec execute 54 sec latency 136.083 ms 20 5136 8.09 MB/sec execute 55 sec latency 113.120 ms 20 5190 7.96 MB/sec execute 56 sec latency 98.688 ms 20 5253 7.84 MB/sec execute 57 sec latency 99.563 ms 20 5302 7.72 MB/sec execute 58 sec latency 114.619 ms 20 5355 7.60 MB/sec execute 59 sec latency 110.976 ms 20 5403 7.49 MB/sec execute 60 sec latency 92.323 ms 20 5479 7.39 MB/sec execute 61 sec latency 82.764 ms 20 5564 7.29 MB/sec execute 62 sec latency 89.180 ms 20 5635 7.22 MB/sec execute 63 sec latency 79.219 ms 20 5714 7.13 MB/sec execute 64 sec latency 79.096 ms 20 5781 7.07 MB/sec execute 65 sec latency 96.238 ms 20 5898 7.26 MB/sec execute 66 sec latency 82.410 ms 20 5958 7.20 MB/sec execute 67 sec latency 97.787 ms 20 6016 7.18 MB/sec execute 68 sec latency 100.019 ms 20 6092 7.23 MB/sec execute 69 sec latency 140.696 ms 20 6208 7.43 MB/sec execute 70 sec latency 92.287 ms 20 6385 8.00 MB/sec execute 71 sec latency 102.389 ms 20 6501 8.20 MB/sec execute 72 sec latency 101.228 ms 20 6606 8.17 MB/sec execute 73 sec latency 102.888 ms 20 6786 8.29 MB/sec execute 74 sec latency 101.047 ms 20 6908 8.43 MB/sec execute 75 sec latency 93.418 ms 20 7039 8.85 MB/sec execute 76 sec latency 112.681 ms 20 7140 8.98 MB/sec execute 77 sec latency 72.320 ms 20 7213 8.93 MB/sec execute 78 sec latency 82.587 ms 20 7282 8.93 MB/sec execute 79 sec latency 95.717 ms 20 7340 8.96 MB/sec execute 80 sec latency 151.241 ms 20 7390 8.86 MB/sec execute 81 sec latency 89.289 ms 20 7447 8.79 MB/sec execute 82 sec latency 84.283 ms 20 7506 8.71 MB/sec execute 83 sec latency 88.942 ms 20 7564 8.61 MB/sec execute 84 sec latency 98.998 ms 20 7601 8.51 MB/sec execute 85 sec latency 136.735 ms 20 7682 8.42 MB/sec execute 86 sec latency 106.403 ms 20 7769 8.35 MB/sec execute 87 sec latency 115.863 ms 20 7847 8.30 MB/sec execute 88 sec latency 84.580 ms 20 7918 8.24 MB/sec execute 89 sec latency 113.658 ms 20 7996 8.19 MB/sec execute 90 sec latency 86.220 ms 20 8057 8.15 MB/sec execute 91 sec latency 77.114 ms 20 8131 8.16 MB/sec execute 92 sec latency 83.948 ms 20 8221 8.21 MB/sec execute 93 sec latency 105.500 ms 20 8289 8.14 MB/sec execute 94 sec latency 91.437 ms 20 8370 8.16 MB/sec execute 95 sec latency 99.991 ms 20 8501 8.51 MB/sec execute 96 sec latency 84.486 ms 20 8566 8.50 MB/sec execute 97 sec latency 102.270 ms 20 8642 8.43 MB/sec execute 98 sec latency 65.833 ms 20 8698 8.35 MB/sec execute 99 sec latency 106.139 ms 20 8771 8.28 MB/sec execute 100 sec latency 78.466 ms 20 8833 8.21 MB/sec execute 101 sec latency 110.243 ms 20 8901 8.14 MB/sec execute 102 sec latency 70.686 ms 20 8954 8.07 MB/sec execute 103 sec latency 112.292 ms 20 9051 8.01 MB/sec execute 104 sec latency 74.063 ms 20 9133 7.95 MB/sec execute 105 sec latency 74.428 ms 20 9237 7.91 MB/sec execute 106 sec latency 66.621 ms 20 9310 7.86 MB/sec execute 107 sec latency 100.867 ms 20 9435 7.95 MB/sec execute 108 sec latency 86.137 ms 20 9509 7.94 MB/sec execute 109 sec latency 85.733 ms 20 9600 7.97 MB/sec execute 110 sec latency 73.869 ms 20 9730 8.09 MB/sec execute 111 sec latency 97.497 ms 20 9927 8.48 MB/sec execute 112 sec latency 68.773 ms 20 10077 8.62 MB/sec execute 113 sec latency 102.618 ms 20 10281 8.69 MB/sec execute 114 sec latency 94.659 ms 20 10463 8.87 MB/sec execute 115 sec latency 105.104 ms 20 10619 9.17 MB/sec execute 116 sec latency 69.123 ms 20 10703 9.19 MB/sec execute 117 sec latency 73.934 ms 20 10791 9.16 MB/sec execute 118 sec latency 65.269 ms 20 10867 9.21 MB/sec execute 119 sec latency 110.493 ms 20 cleanup 120 sec 20 cleanup 121 sec 1 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 33001 40.697 199.846 Close 24731 10.380 59.022 Rename 1455 60.102 140.685 Unlink 6159 12.880 59.812 Qpathinfo 30968 10.240 106.186 Qfileinfo 5564 0.199 21.923 Qfsinfo 5450 0.190 29.880 Sfileinfo 2585 41.244 140.007 Find 11830 2.669 111.289 WriteX 16693 5.211 67.162 ReadX 55303 0.029 9.784 LockX 120 10.787 39.841 UnlockX 120 10.768 33.680 Flush 2100 40.292 166.134 Throughput 9.21319 MB/sec 20 clients 20 procs max_latency=199.874 ms stopping dbench on /mnt/lustre/d0.oleg217-client.virtnet at Thu Dec 12 10:07:20 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg217-client.virtnet /mnt/lustre/d0.oleg217-client.virtnet /mnt/lustre/d0.oleg217-client.virtnet removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg217-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:28 (1734016048) min OST has 3542060kB available, using 5313090kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7595] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5188] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg217-clien 5188M 75547 60 51805 47 202256 47 3984 247 Latency 31558us 324ms 188ms 6798us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg217-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 288 18 6011 27 437 13 355 18 785 12 444 12 Latency 25263us 25906us 25049us 14734us 8150us 33403us 1.97,1.97,oleg217-client.virtnet,1,1734004805,5188M,,,,75547,60,51805,47,,,202256,47,3984,247,10,,,,,288,18,6011,27,437,13,355,18,785,12,444,12,,31558us,324ms,,188ms,6798us,25263us,25906us,25049us,14734us,8150us,33403us debug=0x33f0484 PASS bonnie (336s) == sanity-benchmark test iozone: iozone ================== 10:13:04 (1734016384) Waiting for MDT destroys to complete oleg217-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg217-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7595] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:16 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 117873 115708 103829 130848 80005 81858 iozone test complete. Waiting for MDT destroys to complete oleg217-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg217-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg217-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg217-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:02 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 83913 76327 91650 88481 91878 78709 iozone test complete. Waiting for MDT destroys to complete oleg217-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg217-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (749s) == sanity-benchmark test fsx: fsx ======================== 10:25:33 (1734017133) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 3069 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 3069 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole skipping zero size read skipping zero size read fallocating to largest ever: 0x19887f truncating to largest ever: 0x337989 truncating to largest ever: 0x423520 fallocating to largest ever: 0x489171 fallocating to largest ever: 0x49c631 fallocating to largest ever: 0x4d2402 fallocating to largest ever: 0x51c3f3 fallocating to largest ever: 0x5285e2 003000 1734017144.044934 fallocate 0x0cb3af thru 0x0d49e7 (0x9639 bytes) 004000 1734017147.268778 punch from 0x1ccc6f to 0x1d5fef (0x9381 bytes) 005000 1734017150.364841 mapwrite 0x3d66f7 thru 0x3dc358 (0x5c62 bytes) 008000 1734017159.181770 fallocate 0x1c2a1c thru 0x1cd8e0 (0xaec5 bytes) 009000 1734017162.315983 fallocate 0x2540f0 thru 0x25c3c0 (0x82d1 bytes) 010000 1734017165.124893 trunc from 0x4e017e to 0x22becc (0x2b42b1 bytes) 013000 1734017173.949328 trunc from 0x235a32 to 0x4368b6 (0x200e85 bytes) 014000 1734017176.767411 fallocate 0x206c66 thru 0x215ad1 (0xee6c bytes) 015000 1734017179.208765 mapwrite 0x02b8b1 thru 0x034904 (0x9054 bytes) 016000 1734017182.351998 trunc from 0x37fec8 to 0x508589 (0x1886c2 bytes) 018000 1734017188.578275 mapread 0x0e39b3 thru 0x0f0230 (0xc87e bytes) 019000 1734017191.881305 mapread 0x3afdd6 thru 0x3b3cf6 (0x3f21 bytes) 020000 1734017194.762240 fallocate 0x408e1b thru 0x409983 (0xb69 bytes) 022000 1734017200.642767 punch from 0x25902f to 0x25c5d9 (0x35ab bytes) 023000 1734017203.647134 trunc from 0x470847 to 0x4a24bb (0x31c75 bytes) 025000 1734017209.560109 fallocate 0x380739 thru 0x38cf69 (0xc831 bytes) 027000 1734017214.979912 fallocate 0x09aeae thru 0x09e947 (0x3a9a bytes) 028000 1734017217.819178 mapwrite 0x3e549b thru 0x3ee08c (0x8bf2 bytes) 029000 1734017220.449110 write 0x2ccbb3 thru 0x2d016c (0x35ba bytes) 030000 1734017223.358191 mapread 0x157379 thru 0x15838a (0x1012 bytes) 031000 1734017226.206981 write 0x0d4d14 thru 0x0da010 (0x52fd bytes) 032000 1734017228.724936 trunc from 0x3f3550 to 0x0b5295 (0x33e2ba bytes) 033000 1734017231.154712 read 0x16a827 thru 0x1780f5 (0xd8cf bytes) 034000 1734017234.056927 fallocate 0x372749 thru 0x37c59b (0x9e53 bytes) 035000 1734017236.958169 read 0x0bb506 thru 0x0bd739 (0x2234 bytes) 036000 1734017240.238916 trunc from 0x35046e to 0x1503a7 (0x2000c6 bytes) 037000 1734017243.071013 trunc from 0x293008 to 0x00a7d8 (0x28882f bytes) 038000 1734017246.600906 mapread 0x2d6fe7 thru 0x2e5541 (0xe55b bytes) 039000 1734017249.858263 fallocate 0x46f9a1 thru 0x4748cd (0x4f2d bytes) 040000 1734017252.735178 mapread 0x33d789 thru 0x33dce3 (0x55b bytes) 041000 1734017255.567075 fallocate 0x17c74c thru 0x188d31 (0xc5e6 bytes) 042000 1734017258.770934 read 0x24539b thru 0x24d20e (0x7e74 bytes) 043000 1734017262.044870 read 0x14034c thru 0x145d60 (0x5a15 bytes) 044000 1734017265.171900 punch from 0x12f642 to 0x131fa5 (0x2964 bytes) 045000 1734017268.074499 write 0x4e6057 thru 0x4f0ef6 (0xaea0 bytes) 046000 1734017270.963657 mapread 0x407419 thru 0x4172ff (0xfee7 bytes) 047000 1734017273.981289 fallocate 0x278f7b thru 0x2864da (0xd560 bytes) 048000 1734017276.953725 mapwrite 0x3f7609 thru 0x3fe4e9 (0x6ee1 bytes) 049000 1734017279.556696 read 0x267839 thru 0x27141f (0x9be7 bytes) 050000 1734017282.628896 punch from 0x30041b to 0x30efac (0xeb92 bytes) 051000 1734017285.600053 mapread 0x1de482 thru 0x1e84b8 (0xa037 bytes) 052000 1734017288.401816 read 0x07e719 thru 0x08bdad (0xd695 bytes) 054000 1734017294.156728 trunc from 0x4eca11 to 0x3b5df5 (0x136c1b bytes) 055000 1734017296.943642 mapread 0x384f77 thru 0x389cfb (0x4d85 bytes) 057000 1734017302.586899 mapwrite 0x0537b6 thru 0x05ec61 (0xb4ac bytes) 058000 1734017305.501252 read 0x135077 thru 0x13f7df (0xa769 bytes) 059000 1734017308.369550 mapwrite 0x4ca5f1 thru 0x4d5393 (0xada3 bytes) 060000 1734017311.109889 mapwrite 0x50326b thru 0x50a98a (0x7720 bytes) 061000 1734017313.711929 punch from 0x1ad370 to 0x1b104e (0x3cdf bytes) 063000 1734017319.375342 punch from 0x38238d to 0x38a103 (0x7d77 bytes) 065000 1734017324.478449 mapwrite 0x500876 thru 0x5073ba (0x6b45 bytes) 066000 1734017327.617418 trunc from 0x51c708 to 0x38c03a (0x1906cd bytes) 069000 1734017335.766617 punch from 0x4003b5 to 0x40d1f6 (0xce42 bytes) 070000 1734017338.712919 read 0x0cd563 thru 0x0dc9b0 (0xf44e bytes) 073000 1734017347.383202 write 0x4a848d thru 0x4b1139 (0x8cad bytes) 074000 1734017350.193749 mapread 0x34e550 thru 0x357cdf (0x9790 bytes) 075000 1734017353.167848 write 0x13f869 thru 0x14aca3 (0xb43b bytes) 076000 1734017355.899689 write 0x51e1fc thru 0x51f20d (0x1012 bytes) 077000 1734017358.755737 read 0x0d1dcf thru 0x0dfd56 (0xdf88 bytes) 078000 1734017361.690347 fallocate 0x2a1785 thru 0x2b0165 (0xe9e1 bytes) 080000 1734017367.449289 mapread 0x0cf34a thru 0x0dcd0c (0xd9c3 bytes) 081000 1734017370.501029 mapread 0x0a97fe thru 0x0b550e (0xbd11 bytes) 082000 1734017373.063185 mapwrite 0x49f971 thru 0x4a1a4b (0x20db bytes) 083000 1734017376.147851 mapread 0x2095ec thru 0x20ef6f (0x5984 bytes) 084000 1734017378.801592 punch from 0x1310d1 to 0x1329b5 (0x18e5 bytes) 087000 1734017386.576882 mapread 0x00118a thru 0x00c7ee (0xb665 bytes) 088000 1734017389.683428 write 0x4f3977 thru 0x4f55cd (0x1c57 bytes) 089000 1734017392.339201 punch from 0x0ed14d to 0x0f392e (0x67e2 bytes) 090000 1734017395.057756 mapread 0x0fedf0 thru 0x10245d (0x366e bytes) 091000 1734017397.754429 trunc from 0x3816c1 to 0x4b51f9 (0x133b39 bytes) 092000 1734017400.627634 read 0x224920 thru 0x22a783 (0x5e64 bytes) 093000 1734017403.369741 mapwrite 0x062553 thru 0x062f55 (0xa03 bytes) 095000 1734017408.955971 trunc from 0x3e8dcc to 0x326eec (0xc1edf bytes) 097000 1734017414.137525 punch from 0x22a07c to 0x233a15 (0x999a bytes) 098000 1734017416.812915 write 0x5240ce thru 0x5285e1 (0x4514 bytes) 099000 1734017419.622677 mapwrite 0x40b820 thru 0x411224 (0x5a05 bytes) 100000 1734017422.520575 trunc from 0x45802c to 0x471185 (0x1915a bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4657542 (4552 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 1839104.. 1839107: 4: 0000: net 1: 20.. 51: 2892708.. 2892739: 32: 0000: net 2: 52.. 63: 2892628.. 2892639: 12: 0000: net 3: 64.. 91: 2754364.. 2754391: 28: 0000: net 4: 92.. 103: 2754392.. 2754403: 12: 0000: unwritten,net 5: 104.. 123: 2892772.. 2892791: 20: 0000: unwritten,net 6: 124.. 143: 2892792.. 2892811: 20: 0000: net 7: 152.. 191: 1835524.. 1835563: 40: 0000: unwritten,net 8: 408.. 451: 1839696.. 1839739: 44: 0000: net 9: 820.. 875: 1839424.. 1839479: 56: 0000: net 10: 1856.. 1899: 1844180.. 1844223: 44: 0000: net 11: 2044.. 2087: 1844368.. 1844411: 44: 0000: last,net /mnt/lustre/f0.fsxfile: 9 extents found debug=0x33f0484 PASS fsx (290s) == sanity-benchmark test complete, duration 1564 sec ===== 10:30:23 (1734017423) === sanity-benchmark: start cleanup 10:30:24 (1734017424) === === sanity-benchmark: finish cleanup 10:30:24 (1734017424) ===