-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:16 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:27 (1734015867) === oleg233-client.virtnet: executing check_config_client /mnt/lustre oleg233-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg233-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5e7f800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5e7f800.idle_timeout=debug disable quota as required oleg233-server: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:48 (1734015888) === == sanity-benchmark test dbench: dbench ================== 10:04:49 (1734015889) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7594] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg233-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg233-client.virtnet at Thu Dec 12 10:04:51 EST 2024 waiting for dbench pid 10293 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 11 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 1 7 1.04 MB/sec warmup 1 sec latency 876.760 ms 20 83 36.88 MB/sec warmup 2 sec latency 193.869 ms 20 152 42.66 MB/sec warmup 3 sec latency 163.032 ms 20 197 38.95 MB/sec warmup 4 sec latency 227.820 ms 20 248 37.68 MB/sec warmup 5 sec latency 178.887 ms 20 301 36.84 MB/sec warmup 6 sec latency 171.730 ms 20 346 35.52 MB/sec warmup 7 sec latency 145.672 ms 20 397 35.18 MB/sec warmup 8 sec latency 172.323 ms 20 454 35.40 MB/sec warmup 9 sec latency 147.212 ms 20 508 35.41 MB/sec warmup 10 sec latency 201.133 ms 20 592 36.70 MB/sec warmup 11 sec latency 212.182 ms 20 673 35.20 MB/sec warmup 12 sec latency 116.088 ms 20 725 32.68 MB/sec warmup 13 sec latency 118.593 ms 20 769 30.47 MB/sec warmup 14 sec latency 135.325 ms 20 795 28.54 MB/sec warmup 15 sec latency 219.646 ms 20 844 26.89 MB/sec warmup 16 sec latency 150.459 ms 20 885 25.44 MB/sec warmup 17 sec latency 210.080 ms 20 902 24.07 MB/sec warmup 18 sec latency 1008.495 ms 20 908 22.85 MB/sec warmup 19 sec latency 1990.932 ms 20 917 21.72 MB/sec warmup 20 sec latency 2528.880 ms 20 962 20.73 MB/sec warmup 21 sec latency 124.267 ms 20 1013 20.38 MB/sec warmup 22 sec latency 140.314 ms 20 1090 19.83 MB/sec warmup 23 sec latency 114.007 ms 20 1193 0.83 MB/sec execute 1 sec latency 133.789 ms 20 1242 0.82 MB/sec execute 2 sec latency 117.118 ms 20 1355 15.20 MB/sec execute 3 sec latency 135.187 ms 20 1421 13.89 MB/sec execute 4 sec latency 99.339 ms 20 1485 12.17 MB/sec execute 5 sec latency 120.845 ms 20 1537 10.31 MB/sec execute 6 sec latency 108.320 ms 20 1601 9.00 MB/sec execute 7 sec latency 117.795 ms 20 1646 7.99 MB/sec execute 8 sec latency 138.408 ms 20 1683 7.14 MB/sec execute 9 sec latency 193.973 ms 20 1759 6.55 MB/sec execute 10 sec latency 139.420 ms 20 1823 6.07 MB/sec execute 11 sec latency 106.036 ms 20 1883 5.64 MB/sec execute 12 sec latency 101.135 ms 20 1972 5.31 MB/sec execute 13 sec latency 76.858 ms 20 2029 5.09 MB/sec execute 14 sec latency 89.441 ms 20 2090 4.86 MB/sec execute 15 sec latency 97.190 ms 20 2151 4.63 MB/sec execute 16 sec latency 99.749 ms 20 2189 4.41 MB/sec execute 17 sec latency 116.130 ms 20 2277 4.69 MB/sec execute 18 sec latency 123.616 ms 20 2356 5.15 MB/sec execute 19 sec latency 129.281 ms 20 2402 5.00 MB/sec execute 20 sec latency 126.856 ms 20 2440 4.95 MB/sec execute 21 sec latency 136.060 ms 20 2504 5.19 MB/sec execute 22 sec latency 134.094 ms 20 2579 5.17 MB/sec execute 23 sec latency 142.512 ms 20 2714 6.79 MB/sec execute 24 sec latency 163.008 ms 20 2882 7.80 MB/sec execute 25 sec latency 123.120 ms 20 2961 8.02 MB/sec execute 26 sec latency 149.678 ms 20 3062 7.94 MB/sec execute 27 sec latency 108.301 ms 20 3244 8.35 MB/sec execute 28 sec latency 111.612 ms 20 3360 8.58 MB/sec execute 29 sec latency 108.792 ms 20 3517 10.05 MB/sec execute 30 sec latency 98.937 ms 20 3598 9.99 MB/sec execute 31 sec latency 96.136 ms 20 3665 9.79 MB/sec execute 32 sec latency 87.313 ms 20 3715 9.66 MB/sec execute 33 sec latency 118.113 ms 20 3777 9.80 MB/sec execute 34 sec latency 136.619 ms 20 3821 9.57 MB/sec execute 35 sec latency 119.672 ms 20 3864 9.31 MB/sec execute 36 sec latency 101.462 ms 20 3913 9.20 MB/sec execute 37 sec latency 106.718 ms 20 3961 8.97 MB/sec execute 38 sec latency 129.532 ms 20 3993 8.74 MB/sec execute 39 sec latency 136.703 ms 20 4035 8.52 MB/sec execute 40 sec latency 125.303 ms 20 4095 8.32 MB/sec execute 41 sec latency 111.124 ms 20 4178 8.15 MB/sec execute 42 sec latency 107.772 ms 20 4233 8.01 MB/sec execute 43 sec latency 160.140 ms 20 4278 7.88 MB/sec execute 44 sec latency 165.139 ms 20 4336 7.76 MB/sec execute 45 sec latency 94.711 ms 20 4394 7.66 MB/sec execute 46 sec latency 89.130 ms 20 4452 7.56 MB/sec execute 47 sec latency 96.649 ms 20 4502 7.45 MB/sec execute 48 sec latency 98.806 ms 20 4558 7.40 MB/sec execute 49 sec latency 111.624 ms 20 4647 7.58 MB/sec execute 50 sec latency 88.898 ms 20 4728 7.49 MB/sec execute 51 sec latency 102.517 ms 20 4798 7.38 MB/sec execute 52 sec latency 87.391 ms 20 4901 7.82 MB/sec execute 53 sec latency 90.568 ms 20 5005 8.19 MB/sec execute 54 sec latency 109.675 ms 20 5065 8.05 MB/sec execute 55 sec latency 101.553 ms 20 5128 7.93 MB/sec execute 56 sec latency 80.817 ms 20 5177 7.81 MB/sec execute 57 sec latency 89.111 ms 20 5243 7.69 MB/sec execute 58 sec latency 89.114 ms 20 5300 7.58 MB/sec execute 59 sec latency 94.080 ms 20 5356 7.47 MB/sec execute 60 sec latency 89.668 ms 20 5403 7.36 MB/sec execute 61 sec latency 97.561 ms 20 5474 7.26 MB/sec execute 62 sec latency 85.107 ms 20 5560 7.17 MB/sec execute 63 sec latency 82.759 ms 20 5621 7.09 MB/sec execute 64 sec latency 87.019 ms 20 5706 7.01 MB/sec execute 65 sec latency 85.133 ms 20 5777 6.99 MB/sec execute 66 sec latency 88.555 ms 20 5875 7.04 MB/sec execute 67 sec latency 81.440 ms 20 5949 7.08 MB/sec execute 68 sec latency 87.770 ms 20 6000 7.06 MB/sec execute 69 sec latency 111.100 ms 20 6069 7.09 MB/sec execute 70 sec latency 120.626 ms 20 6175 7.23 MB/sec execute 71 sec latency 114.836 ms 20 6304 7.56 MB/sec execute 72 sec latency 109.596 ms 20 6471 7.92 MB/sec execute 73 sec latency 91.749 ms 20 6570 8.03 MB/sec execute 74 sec latency 107.611 ms 20 6704 8.08 MB/sec execute 75 sec latency 108.604 ms 20 6866 8.24 MB/sec execute 76 sec latency 101.942 ms 20 6993 8.50 MB/sec execute 77 sec latency 87.390 ms 20 7123 8.86 MB/sec execute 78 sec latency 78.631 ms 20 7194 8.79 MB/sec execute 79 sec latency 84.655 ms 20 7266 8.79 MB/sec execute 80 sec latency 86.374 ms 20 7325 8.82 MB/sec execute 81 sec latency 137.845 ms 20 7372 8.74 MB/sec execute 82 sec latency 124.527 ms 20 7421 8.66 MB/sec execute 83 sec latency 89.927 ms 20 7478 8.61 MB/sec execute 84 sec latency 84.096 ms 20 7541 8.50 MB/sec execute 85 sec latency 67.778 ms 20 7586 8.41 MB/sec execute 86 sec latency 121.194 ms 20 7640 8.31 MB/sec execute 87 sec latency 130.188 ms 20 7731 8.24 MB/sec execute 88 sec latency 118.985 ms 20 7814 8.19 MB/sec execute 89 sec latency 115.234 ms 20 7886 8.13 MB/sec execute 90 sec latency 77.470 ms 20 7959 8.08 MB/sec execute 91 sec latency 87.327 ms 20 8021 8.03 MB/sec execute 92 sec latency 82.143 ms 20 8084 7.99 MB/sec execute 93 sec latency 87.358 ms 20 8159 8.05 MB/sec execute 94 sec latency 94.333 ms 20 8256 8.04 MB/sec execute 95 sec latency 78.011 ms 20 8325 7.97 MB/sec execute 96 sec latency 127.110 ms 20 8439 8.20 MB/sec execute 97 sec latency 83.356 ms 20 8536 8.41 MB/sec execute 98 sec latency 136.345 ms 20 8608 8.33 MB/sec execute 99 sec latency 81.701 ms 20 8669 8.26 MB/sec execute 100 sec latency 147.209 ms 20 8731 8.19 MB/sec execute 101 sec latency 81.110 ms 20 8795 8.12 MB/sec execute 102 sec latency 96.638 ms 20 8852 8.05 MB/sec execute 103 sec latency 95.856 ms 20 8910 7.98 MB/sec execute 104 sec latency 131.666 ms 20 8977 7.92 MB/sec execute 105 sec latency 93.046 ms 20 9075 7.86 MB/sec execute 106 sec latency 80.868 ms 20 9153 7.81 MB/sec execute 107 sec latency 84.943 ms 20 9244 7.76 MB/sec execute 108 sec latency 76.742 ms 20 9331 7.75 MB/sec execute 109 sec latency 78.089 ms 20 9445 7.81 MB/sec execute 110 sec latency 79.327 ms 20 9525 7.81 MB/sec execute 111 sec latency 81.853 ms 20 9611 7.83 MB/sec execute 112 sec latency 87.137 ms 20 9750 7.99 MB/sec execute 113 sec latency 85.089 ms 20 9945 8.35 MB/sec execute 114 sec latency 96.307 ms 20 10110 8.49 MB/sec execute 115 sec latency 101.968 ms 20 10290 8.55 MB/sec execute 116 sec latency 115.468 ms 20 10471 8.75 MB/sec execute 117 sec latency 88.001 ms 20 10615 9.02 MB/sec execute 118 sec latency 77.855 ms 20 10695 9.03 MB/sec execute 119 sec latency 110.346 ms 20 cleanup 120 sec 20 cleanup 121 sec 19 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 32038 41.594 165.133 Close 24157 10.724 62.740 Rename 1398 63.061 193.948 Unlink 5893 13.128 61.133 Qpathinfo 30273 10.473 123.892 Qfileinfo 5530 0.215 24.869 Qfsinfo 5350 0.169 22.870 Sfileinfo 2527 43.611 161.824 Find 11767 2.754 115.541 WriteX 16241 5.482 85.506 ReadX 54860 0.030 11.437 LockX 120 11.024 27.094 UnlockX 120 10.818 34.942 Flush 2100 41.848 135.726 Throughput 9.0251 MB/sec 20 clients 20 procs max_latency=193.973 ms stopping dbench on /mnt/lustre/d0.oleg233-client.virtnet at Thu Dec 12 10:07:18 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg233-client.virtnet /mnt/lustre/d0.oleg233-client.virtnet /mnt/lustre/d0.oleg233-client.virtnet removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg233-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:26 (1734016046) min OST has 3564880kB available, using 5347320kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7594] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5221] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg233-clien 5221M 76429 60 51155 46 204783 48 3772 252 Latency 25453us 462ms 101ms 18206us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg233-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 289 18 6139 26 433 13 357 18 783 12 377 11 Latency 23805us 22814us 43403us 22183us 6134us 24985us 1.97,1.97,oleg233-client.virtnet,1,1734004801,5221M,,,,76429,60,51155,46,,,204783,48,3772,252,10,,,,,289,18,6139,26,433,13,357,18,783,12,377,11,,25453us,462ms,,101ms,18206us,23805us,22814us,43403us,22183us,6134us,24985us debug=0x33f0484 PASS bonnie (342s) == sanity-benchmark test iozone: iozone ================== 10:13:08 (1734016388) Waiting for MDT destroys to complete oleg233-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg233-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7594] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:21 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 120286 114364 107572 131817 75621 79819 iozone test complete. Waiting for MDT destroys to complete oleg233-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg233-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg233-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg233-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:07 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 80170 76382 91191 88998 91475 82080 iozone test complete. Waiting for MDT destroys to complete oleg233-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg233-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (752s) == sanity-benchmark test fsx: fsx ======================== 10:25:40 (1734017140) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 31664 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 31664 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read fallocating to largest ever: 0x19f6af truncating to largest ever: 0x333dd0 fallocating to largest ever: 0x352d08 fallocating to largest ever: 0x3a8a49 fallocating to largest ever: 0x5285e2 001000 1734017144.224874 read 0x3248ff thru 0x3312b4 (0xc9b6 bytes) 002000 1734017147.394128 trunc from 0x2b9370 to 0x4c39ae (0x20a63f bytes) 003000 1734017150.447232 read 0x359a14 thru 0x359bbc (0x1a9 bytes) 004000 1734017153.310587 trunc from 0x4e3242 to 0x07b8a2 (0x46799f bytes) 005000 1734017156.270123 trunc from 0x384024 to 0x146671 (0x23d9b2 bytes) 006000 1734017159.003352 mapwrite 0x0c6f0b thru 0x0ce040 (0x7136 bytes) 007000 1734017161.822495 write 0x262edd thru 0x26e854 (0xb978 bytes) 008000 1734017164.183803 mapwrite 0x52832d thru 0x5285e1 (0x2b5 bytes) 009000 1734017167.245009 read 0x0471c7 thru 0x0473fb (0x235 bytes) 010000 1734017169.767693 fallocate 0x16c743 thru 0x16e4c1 (0x1d7f bytes) 012000 1734017175.272995 punch from 0x09f96a to 0x0ad051 (0xd6e8 bytes) 013000 1734017177.974692 mapread 0x1b047b thru 0x1bd66f (0xd1f5 bytes) 014000 1734017180.818962 mapread 0x0189fe thru 0x0220fa (0x96fd bytes) 015000 1734017183.658292 mapwrite 0x02c0c5 thru 0x02df86 (0x1ec2 bytes) 016000 1734017186.548107 mapwrite 0x1b6151 thru 0x1b81b1 (0x2061 bytes) 017000 1734017189.245517 read 0x263ea9 thru 0x26bb3f (0x7c97 bytes) 019000 1734017194.981251 write 0x4a3da4 thru 0x4a8deb (0x5048 bytes) 020000 1734017197.588582 read 0x37b5cb thru 0x38a9fe (0xf434 bytes) 022000 1734017203.486645 trunc from 0x2736da to 0x2f12c9 (0x7dbf0 bytes) 023000 1734017206.203678 read 0x36d6ae thru 0x36fe72 (0x27c5 bytes) 025000 1734017212.149013 trunc from 0x2c196a to 0x515745 (0x253ddc bytes) 026000 1734017214.985018 fallocate 0x20d752 thru 0x20dae1 (0x390 bytes) 028000 1734017220.534136 punch from 0x343a6b to 0x34fae4 (0xc07a bytes) 029000 1734017223.322677 punch from 0x1248ff to 0x125e67 (0x1569 bytes) 034000 1734017237.010994 write 0x0d8046 thru 0x0dca3f (0x49fa bytes) 036000 1734017243.240730 mapwrite 0x481408 thru 0x48dfea (0xcbe3 bytes) 037000 1734017246.443537 punch from 0x0be009 to 0x0c1aab (0x3aa3 bytes) 038000 1734017249.576304 mapread 0x0d8d07 thru 0x0dd7b2 (0x4aac bytes) 039000 1734017252.490233 write 0x2aff4f thru 0x2bd03d (0xd0ef bytes) 040000 1734017256.099600 mapread 0x05430d thru 0x057fac (0x3ca0 bytes) 041000 1734017258.916006 trunc from 0x51175e to 0x30e20e (0x20354f bytes) 042000 1734017262.234016 punch from 0x06cd9a to 0x075612 (0x8879 bytes) 043000 1734017265.420996 read 0x028d4c thru 0x02d907 (0x4bbc bytes) 044000 1734017268.397564 read 0x1eedd6 thru 0x1f851a (0x9745 bytes) 045000 1734017271.535029 read 0x0e45a8 thru 0x0ea1aa (0x5c03 bytes) 046000 1734017274.105107 write 0x0dc6d2 thru 0x0e3676 (0x6fa5 bytes) 047000 1734017277.225300 fallocate 0x22f901 thru 0x23925e (0x995e bytes) 048000 1734017280.229833 trunc from 0x20cf8d to 0x42b555 (0x21e5c9 bytes) 049000 1734017283.478943 read 0x14dd77 thru 0x14ebd1 (0xe5b bytes) 053000 1734017294.724115 punch from 0x18d696 to 0x195fce (0x8939 bytes) 054000 1734017297.189043 punch from 0x1d9ab5 to 0x1e7f6b (0xe4b7 bytes) 057000 1734017306.630998 read 0x45fec8 thru 0x46ade4 (0xaf1d bytes) 058000 1734017309.544278 write 0x2c1392 thru 0x2cad7c (0x99eb bytes) 059000 1734017312.403994 mapread 0x001d19 thru 0x00b624 (0x990c bytes) 061000 1734017317.908893 write 0x01aefc thru 0x01af7c (0x81 bytes) 062000 1734017320.732068 trunc from 0x42da3c to 0x091f65 (0x39bad6 bytes) 063000 1734017323.305024 trunc from 0x3c9714 to 0x3bbfeb (0xd728 bytes) 064000 1734017326.492708 punch from 0x06ade8 to 0x06fccd (0x4ee6 bytes) 065000 1734017329.403634 trunc from 0x4761e6 to 0x4478a0 (0x2e945 bytes) 066000 1734017332.165668 mapwrite 0x4be331 thru 0x4c02e6 (0x1fb6 bytes) 067000 1734017335.294260 mapread 0x06531e thru 0x06a995 (0x5678 bytes) 068000 1734017338.191241 fallocate 0x4ebbc3 thru 0x4f2a60 (0x6e9e bytes) 069000 1734017340.720535 mapwrite 0x162dcd thru 0x1728e3 (0xfb17 bytes) 073000 1734017352.813971 mapwrite 0x368320 thru 0x370215 (0x7ef6 bytes) 074000 1734017355.686402 write 0x3fe539 thru 0x407c0c (0x96d4 bytes) 077000 1734017364.289130 mapread 0x054d98 thru 0x056a33 (0x1c9c bytes) 079000 1734017369.321155 read 0x25af80 thru 0x2606c2 (0x5743 bytes) 080000 1734017372.238281 read 0x02d838 thru 0x0323e1 (0x4baa bytes) 081000 1734017375.051749 write 0x1286e1 thru 0x1302d7 (0x7bf7 bytes) 084000 1734017383.141431 write 0x1ed129 thru 0x1fca71 (0xf949 bytes) 086000 1734017388.272323 punch from 0x43c50f to 0x445154 (0x8c46 bytes) 088000 1734017393.822915 fallocate 0x2fe245 thru 0x3005a3 (0x235f bytes) 090000 1734017399.144114 mapread 0x3afa72 thru 0x3b4fed (0x557c bytes) 091000 1734017401.708112 write 0x4814b9 thru 0x48a5c0 (0x9108 bytes) 093000 1734017406.907236 read 0x1d1107 thru 0x1d5372 (0x426c bytes) 094000 1734017409.228165 mapwrite 0x2436f8 thru 0x24bbd5 (0x84de bytes) 096000 1734017414.071233 mapwrite 0x419edb thru 0x426700 (0xc826 bytes) 097000 1734017416.527215 mapread 0x4e8b0a thru 0x4f61a1 (0xd698 bytes) 098000 1734017419.782501 fallocate 0x3ebcaa thru 0x3fad91 (0xf0e8 bytes) 099000 1734017422.176256 trunc from 0x4d9997 to 0x1561fb (0x38379b bytes) 100000 1734017424.573679 mapread 0x48bd5d thru 0x495c6c (0x9f10 bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4807789 (4696 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 3936256.. 3936259: 4: 0000: net 1: 4.. 7: 3938348.. 3938351: 4: 0000: net 2: 12.. 15: 3932892.. 3932895: 4: 0000: net 3: 16.. 19: 4064544.. 4064547: 4: 0000: net 4: 20.. 47: 4064512.. 4064539: 28: 0000: unwritten,net 5: 48.. 55: 4069376.. 4069383: 8: 0000: net 6: 208.. 263: 3933336.. 3933391: 56: 0000: net 7: 332.. 359: 3933460.. 3933487: 28: 0000: net 8: 1148.. 1191: 3934276.. 3934319: 44: 0000: net 9: 1476.. 1499: 3933044.. 3933067: 24: 0000: unwritten,net 10: 1536.. 1583: 3936296.. 3936343: 48: 0000: net 11: 2256.. 2271: 3937016.. 3937031: 16: 0000: net 12: 2320.. 2339: 3932720.. 3932739: 20: 0000: net 13: 2476.. 2531: 3937236.. 3937291: 56: 0000: net 14: 2860.. 2883: 3937620.. 3937643: 24: 0000: unwritten,net 15: 3016.. 3059: 3932992.. 3933035: 44: 0000: unwritten,net 16: 3264.. 3311: 3933136.. 3933183: 48: 0000: unwritten,net 17: 3712.. 3719: 3933984.. 3933991: 8: 0000: net 18: 3720.. 3751: 3938760.. 3938791: 32: 0000: net 19: 3752.. 3775: 3938792.. 3938815: 24: 0000: unwritten,net 20: 3820.. 3879: 3938860.. 3938919: 60: 0000: net 21: 4024.. 4087: 3939064.. 3939127: 64: 0000: net 22: 4372.. 4399: 3932896.. 3932923: 28: 0000: unwritten,net 23: 4672.. 4695: 3933312.. 3933335: 24: 0000: last,net,eof /mnt/lustre/f0.fsxfile: 17 extents found debug=0x33f0484 PASS fsx (285s) == sanity-benchmark test complete, duration 1568 sec ===== 10:30:25 (1734017425) === sanity-benchmark: start cleanup 10:30:26 (1734017426) === === sanity-benchmark: finish cleanup 10:30:26 (1734017426) ===