-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:58 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:06 (1734015846) === oleg319-client.virtnet: executing check_config_client /mnt/lustre oleg319-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg319-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6cff800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6cff800.idle_timeout=debug disable quota as required oleg319-server: oleg319-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:24 (1734015864) === == sanity-benchmark test dbench: dbench ================== 10:04:25 (1734015865) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7583] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg319-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg319-client.virtnet at Thu Dec 12 10:04:27 EST 2024 waiting for dbench pid 10277 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 17 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 7 29 22.00 MB/sec warmup 1 sec latency 281.532 ms 20 133 58.74 MB/sec warmup 2 sec latency 156.519 ms 20 198 52.26 MB/sec warmup 3 sec latency 149.941 ms 20 268 50.35 MB/sec warmup 4 sec latency 141.840 ms 20 335 48.33 MB/sec warmup 5 sec latency 119.420 ms 20 404 47.68 MB/sec warmup 6 sec latency 120.239 ms 20 478 47.74 MB/sec warmup 7 sec latency 104.041 ms 20 580 49.23 MB/sec warmup 8 sec latency 148.457 ms 20 674 46.93 MB/sec warmup 9 sec latency 121.939 ms 20 720 42.45 MB/sec warmup 10 sec latency 105.014 ms 20 774 38.84 MB/sec warmup 11 sec latency 106.301 ms 20 835 35.85 MB/sec warmup 12 sec latency 90.164 ms 20 886 33.29 MB/sec warmup 13 sec latency 120.947 ms 20 938 31.09 MB/sec warmup 14 sec latency 91.436 ms 20 1003 29.62 MB/sec warmup 15 sec latency 118.498 ms 20 1091 28.64 MB/sec warmup 16 sec latency 86.898 ms 20 1150 27.03 MB/sec warmup 17 sec latency 103.849 ms 20 1208 25.58 MB/sec warmup 18 sec latency 109.647 ms 20 1292 25.10 MB/sec warmup 19 sec latency 107.030 ms 20 1417 25.98 MB/sec warmup 20 sec latency 95.937 ms 20 1469 24.77 MB/sec warmup 21 sec latency 146.546 ms 20 1537 23.70 MB/sec warmup 22 sec latency 87.320 ms 20 1609 22.73 MB/sec warmup 23 sec latency 98.046 ms 20 1748 1.21 MB/sec execute 1 sec latency 103.555 ms 20 1827 1.28 MB/sec execute 2 sec latency 89.671 ms 20 1894 1.22 MB/sec execute 3 sec latency 98.819 ms 20 1984 1.30 MB/sec execute 4 sec latency 81.420 ms 20 2053 1.54 MB/sec execute 5 sec latency 80.656 ms 20 2142 1.58 MB/sec execute 6 sec latency 70.704 ms 20 2198 1.55 MB/sec execute 7 sec latency 85.311 ms 20 2315 3.57 MB/sec execute 8 sec latency 106.108 ms 20 2392 3.94 MB/sec execute 9 sec latency 87.949 ms 20 2444 4.10 MB/sec execute 10 sec latency 103.230 ms 20 2507 4.60 MB/sec execute 11 sec latency 539.702 ms 20 2538 4.37 MB/sec execute 12 sec latency 1266.909 ms 20 2680 6.15 MB/sec execute 13 sec latency 107.925 ms 20 2851 9.11 MB/sec execute 14 sec latency 96.116 ms 20 2965 9.62 MB/sec execute 15 sec latency 111.287 ms 20 3119 9.80 MB/sec execute 16 sec latency 107.644 ms 20 3302 10.43 MB/sec execute 17 sec latency 93.104 ms 20 3453 11.65 MB/sec execute 18 sec latency 87.373 ms 20 3590 12.92 MB/sec execute 19 sec latency 117.015 ms 20 3673 12.49 MB/sec execute 20 sec latency 79.497 ms 20 3754 12.42 MB/sec execute 21 sec latency 79.424 ms 20 3815 12.30 MB/sec execute 22 sec latency 180.485 ms 20 3870 11.86 MB/sec execute 23 sec latency 118.676 ms 20 3931 11.51 MB/sec execute 24 sec latency 79.463 ms 20 3986 11.07 MB/sec execute 25 sec latency 107.960 ms 20 4041 10.65 MB/sec execute 26 sec latency 80.837 ms 20 4104 10.26 MB/sec execute 27 sec latency 109.469 ms 20 4172 9.94 MB/sec execute 28 sec latency 129.151 ms 20 4250 9.69 MB/sec execute 29 sec latency 93.873 ms 20 4306 9.46 MB/sec execute 30 sec latency 112.796 ms 20 4373 9.25 MB/sec execute 31 sec latency 97.667 ms 20 4434 9.06 MB/sec execute 32 sec latency 111.409 ms 20 4495 8.88 MB/sec execute 33 sec latency 98.325 ms 20 4561 8.86 MB/sec execute 34 sec latency 89.153 ms 20 4635 8.92 MB/sec execute 35 sec latency 95.925 ms 20 4728 8.83 MB/sec execute 36 sec latency 76.271 ms 20 4800 8.69 MB/sec execute 37 sec latency 92.205 ms 20 4895 9.09 MB/sec execute 38 sec latency 81.630 ms 20 5006 9.70 MB/sec execute 39 sec latency 120.634 ms 20 5070 9.48 MB/sec execute 40 sec latency 93.503 ms 20 5104 9.26 MB/sec execute 41 sec latency 369.271 ms 20 5139 9.05 MB/sec execute 42 sec latency 886.806 ms 20 5187 8.87 MB/sec execute 43 sec latency 265.520 ms 20 5252 8.69 MB/sec execute 44 sec latency 89.029 ms 20 5312 8.52 MB/sec execute 45 sec latency 94.301 ms 20 5371 8.35 MB/sec execute 46 sec latency 109.382 ms 20 5442 8.20 MB/sec execute 47 sec latency 78.707 ms 20 5517 8.06 MB/sec execute 48 sec latency 91.640 ms 20 5598 7.94 MB/sec execute 49 sec latency 78.264 ms 20 5678 7.82 MB/sec execute 50 sec latency 78.573 ms 20 5762 7.74 MB/sec execute 51 sec latency 72.261 ms 20 5831 7.73 MB/sec execute 52 sec latency 120.682 ms 20 5915 7.82 MB/sec execute 53 sec latency 102.837 ms 20 5982 7.79 MB/sec execute 54 sec latency 87.070 ms 20 6062 7.81 MB/sec execute 55 sec latency 90.230 ms 20 6174 8.11 MB/sec execute 56 sec latency 92.548 ms 20 6328 8.58 MB/sec execute 57 sec latency 95.464 ms 20 6469 8.92 MB/sec execute 58 sec latency 93.771 ms 20 6619 9.03 MB/sec execute 59 sec latency 111.024 ms 20 6783 9.16 MB/sec execute 60 sec latency 93.167 ms 20 6953 9.62 MB/sec execute 61 sec latency 98.917 ms 20 7075 9.88 MB/sec execute 62 sec latency 99.646 ms 20 7177 9.99 MB/sec execute 63 sec latency 63.356 ms 20 7256 9.99 MB/sec execute 64 sec latency 81.208 ms 20 7325 9.98 MB/sec execute 65 sec latency 80.270 ms 20 7379 9.90 MB/sec execute 66 sec latency 143.666 ms 20 7433 9.78 MB/sec execute 67 sec latency 122.184 ms 20 7497 9.69 MB/sec execute 68 sec latency 78.942 ms 20 7553 9.55 MB/sec execute 69 sec latency 84.666 ms 20 7610 9.41 MB/sec execute 70 sec latency 90.085 ms 20 7656 9.29 MB/sec execute 71 sec latency 154.806 ms 20 7712 9.18 MB/sec execute 72 sec latency 140.648 ms 20 7785 9.08 MB/sec execute 73 sec latency 132.190 ms 20 7846 9.00 MB/sec execute 74 sec latency 107.613 ms 20 7907 8.91 MB/sec execute 75 sec latency 92.827 ms 20 7961 8.83 MB/sec execute 76 sec latency 104.801 ms 20 8030 8.76 MB/sec execute 77 sec latency 88.079 ms 20 8092 8.75 MB/sec execute 78 sec latency 85.676 ms 20 8169 8.76 MB/sec execute 79 sec latency 93.697 ms 20 8255 8.75 MB/sec execute 80 sec latency 70.241 ms 20 8331 8.69 MB/sec execute 81 sec latency 82.350 ms 20 8440 8.89 MB/sec execute 82 sec latency 72.560 ms 20 8538 9.11 MB/sec execute 83 sec latency 100.747 ms 20 8606 9.06 MB/sec execute 84 sec latency 106.257 ms 20 8670 8.96 MB/sec execute 85 sec latency 74.602 ms 20 8726 8.87 MB/sec execute 86 sec latency 101.973 ms 20 8790 8.78 MB/sec execute 87 sec latency 97.533 ms 20 8855 8.70 MB/sec execute 88 sec latency 95.441 ms 20 8920 8.61 MB/sec execute 89 sec latency 76.438 ms 20 9002 8.53 MB/sec execute 90 sec latency 85.239 ms 20 9101 8.46 MB/sec execute 91 sec latency 63.466 ms 20 9188 8.39 MB/sec execute 92 sec latency 73.417 ms 20 9287 8.34 MB/sec execute 93 sec latency 67.511 ms 20 9396 8.36 MB/sec execute 94 sec latency 62.232 ms 20 9509 8.43 MB/sec execute 95 sec latency 65.203 ms 20 9611 8.47 MB/sec execute 96 sec latency 75.457 ms 20 9770 8.71 MB/sec execute 97 sec latency 85.916 ms 20 9955 9.06 MB/sec execute 98 sec latency 67.296 ms 20 10160 9.24 MB/sec execute 99 sec latency 77.880 ms 20 10362 9.37 MB/sec execute 100 sec latency 71.309 ms 20 10542 9.65 MB/sec execute 101 sec latency 115.968 ms 20 10697 9.90 MB/sec execute 102 sec latency 55.138 ms 20 10804 9.92 MB/sec execute 103 sec latency 65.105 ms 20 10906 9.94 MB/sec execute 104 sec latency 62.011 ms 20 10995 9.89 MB/sec execute 105 sec latency 81.190 ms 20 11062 9.82 MB/sec execute 106 sec latency 100.581 ms 20 11152 9.73 MB/sec execute 107 sec latency 48.794 ms 20 11255 9.65 MB/sec execute 108 sec latency 81.780 ms 20 11360 9.60 MB/sec execute 109 sec latency 96.215 ms 20 11459 9.55 MB/sec execute 110 sec latency 62.844 ms 20 11556 9.51 MB/sec execute 111 sec latency 68.039 ms 20 11647 9.51 MB/sec execute 112 sec latency 73.848 ms 20 11759 9.56 MB/sec execute 113 sec latency 69.022 ms 20 11853 9.50 MB/sec execute 114 sec latency 68.190 ms 20 11978 9.66 MB/sec execute 115 sec latency 62.360 ms 20 12093 9.82 MB/sec execute 116 sec latency 98.784 ms 20 12185 9.77 MB/sec execute 117 sec latency 57.087 ms 20 12261 9.70 MB/sec execute 118 sec latency 67.494 ms 20 12352 9.63 MB/sec execute 119 sec latency 73.007 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 37299 36.416 180.479 Close 27502 9.041 51.479 Rename 1574 53.197 157.884 Unlink 7475 11.275 54.875 Qpathinfo 34136 8.746 125.089 Qfileinfo 5880 0.181 15.643 Qfsinfo 6120 0.126 19.863 Sfileinfo 3000 37.265 114.485 Find 12960 2.041 118.651 WriteX 18247 4.444 102.378 ReadX 58091 0.024 7.957 LockX 120 9.431 22.654 UnlockX 120 8.871 26.800 Flush 2580 39.225 1266.899 Throughput 9.63461 MB/sec 20 clients 20 procs max_latency=1266.909 ms stopping dbench on /mnt/lustre/d0.oleg319-client.virtnet at Thu Dec 12 10:06:53 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg319-client.virtnet /mnt/lustre/d0.oleg319-client.virtnet /mnt/lustre/d0.oleg319-client.virtnet removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg319-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (154s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:59 (1734016019) min OST has 3485600kB available, using 5228400kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7583] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5105] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg319-clien 5105M 87570 66 60002 50 173480 37 2189 236 Latency 22485us 189ms 144ms 12460us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg319-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 290 19 7031 30 418 13 364 18 882 12 516 13 Latency 25385us 20292us 35827us 16495us 7892us 22571us 1.97,1.97,oleg319-client.virtnet,1,1734004857,5105M,,,,87570,66,60002,50,,,173480,37,2189,236,10,,,,,290,19,7031,30,418,13,364,18,882,12,516,13,,22485us,189ms,,144ms,12460us,25385us,20292us,35827us,16495us,7892us,22571us debug=0x33f0484 PASS bonnie (310s) == sanity-benchmark test iozone: iozone ================== 10:12:09 (1734016329) Waiting for MDT destroys to complete oleg319-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg319-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg319-client: oleg319-server: ssh exited with exit code 1 pdsh@oleg319-client: oleg319-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7583] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:19 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 264619 182700 140381 162808 59747 156975 iozone test complete. Waiting for MDT destroys to complete oleg319-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg319-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg319-client: oleg319-server: ssh exited with exit code 1 pdsh@oleg319-client: oleg319-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg319-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg319-client: oleg319-server: ssh exited with exit code 1 oleg319-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg319-client: oleg319-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:16:50 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 70305 67240 76837 79114 79884 74261 iozone test complete. Waiting for MDT destroys to complete oleg319-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg319-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg319-client: oleg319-server: ssh exited with exit code 1 pdsh@oleg319-client: oleg319-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (727s) == sanity-benchmark test fsx: fsx ======================== 10:24:16 (1734017056) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 3589 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 3589 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x4f74ae truncating to largest ever: 0x501c22 fallocating to largest ever: 0x510951 001000 1734017060.087963 fallocate 0x2fc047 thru 0x302241 (0x61fb bytes) truncating to largest ever: 0x51e455 fallocating to largest ever: 0x527fcf 002000 1734017062.812739 write 0x0e0953 thru 0x0e7150 (0x67fe bytes) fallocating to largest ever: 0x5285e2 004000 1734017068.537634 mapread 0x36e5f1 thru 0x37090e (0x231e bytes) 006000 1734017075.597798 punch from 0x2018e0 to 0x20f667 (0xdd88 bytes) 007000 1734017079.305792 mapwrite 0x0bbac6 thru 0x0bdd78 (0x22b3 bytes) 009000 1734017085.559134 write 0x4571e5 thru 0x45a316 (0x3132 bytes) 012000 1734017094.526860 mapwrite 0x3436b5 thru 0x3510fe (0xda4a bytes) 014000 1734017100.874287 trunc from 0x37992c to 0x50bd5f (0x192434 bytes) 015000 1734017104.115550 fallocate 0x4b1553 thru 0x4b1883 (0x331 bytes) 016000 1734017107.107731 read 0x09666c thru 0x0a1167 (0xaafc bytes) 017000 1734017109.716840 mapwrite 0x21ebf7 thru 0x22cf48 (0xe352 bytes) 018000 1734017113.167276 trunc from 0x4b6da6 to 0x4aa3f9 (0xc9ac bytes) 019000 1734017116.113825 mapwrite 0x4c7790 thru 0x4cde71 (0x66e2 bytes) 020000 1734017118.859172 read 0x39e4bc thru 0x3aa035 (0xbb7a bytes) 022000 1734017124.299056 trunc from 0x4d3a21 to 0x50cac6 (0x390a6 bytes) 023000 1734017127.026138 write 0x39f3e6 thru 0x3a3dab (0x49c6 bytes) 024000 1734017130.165591 fallocate 0x0fb681 thru 0x10095d (0x52dd bytes) 025000 1734017132.874286 trunc from 0x46d20d to 0x3e4c2c (0x885e0 bytes) 028000 1734017141.375609 mapwrite 0x0b8eb8 thru 0x0bc206 (0x334f bytes) 029000 1734017144.224992 punch from 0x0967c9 to 0x0a03e9 (0x9c21 bytes) 031000 1734017149.952206 mapwrite 0x1d2825 thru 0x1d6113 (0x38ef bytes) 032000 1734017153.300401 trunc from 0x26fadb to 0x307782 (0x97ca8 bytes) 033000 1734017156.199572 write 0x2a2437 thru 0x2b00f3 (0xdcbd bytes) 034000 1734017159.372735 mapwrite 0x108677 thru 0x11154d (0x8ed7 bytes) 035000 1734017162.261801 mapread 0x135100 thru 0x138548 (0x3449 bytes) 036000 1734017165.081057 trunc from 0x1d43d0 to 0x5241be (0x34fdef bytes) 037000 1734017167.958471 trunc from 0x4386c0 to 0x3dc1c2 (0x5c4fd bytes) 041000 1734017179.413889 mapread 0x30ed23 thru 0x30ef3f (0x21d bytes) 042000 1734017181.984739 mapwrite 0x3013bb thru 0x310871 (0xf4b7 bytes) 043000 1734017184.752010 read 0x081dc8 thru 0x0844c9 (0x2702 bytes) 045000 1734017190.315703 mapread 0x340b8d thru 0x348e37 (0x82ab bytes) 046000 1734017193.149449 trunc from 0x108eea to 0x29285f (0x189976 bytes) 047000 1734017195.908415 mapread 0x148e37 thru 0x149d2c (0xef6 bytes) 048000 1734017198.647159 write 0x0655e5 thru 0x0656e8 (0x104 bytes) skipping zero size write 049000 1734017201.223285 read 0x197380 thru 0x19bc33 (0x48b4 bytes) 050000 1734017203.937048 mapread 0x053104 thru 0x05fc55 (0xcb52 bytes) 051000 1734017206.437974 mapwrite 0x1bbd66 thru 0x1c1049 (0x52e4 bytes) 052000 1734017209.301920 punch from 0x424c9e to 0x428d36 (0x4099 bytes) 053000 1734017211.941065 mapwrite 0x123657 thru 0x12cea3 (0x984d bytes) 054000 1734017215.145874 mapwrite 0x1d7929 thru 0x1e67bb (0xee93 bytes) 055000 1734017218.334215 fallocate 0x3b3575 thru 0x3b6449 (0x2ed5 bytes) 056000 1734017221.676442 mapwrite 0x47d127 thru 0x482f75 (0x5e4f bytes) 057000 1734017224.528346 write 0x0305dc thru 0x031aae (0x14d3 bytes) 059000 1734017231.290969 mapwrite 0x318eb9 thru 0x325743 (0xc88b bytes) 060000 1734017234.533325 mapread 0x1884e8 thru 0x18a7ea (0x2303 bytes) 061000 1734017237.893057 read 0x3a6da2 thru 0x3aa8cf (0x3b2e bytes) 062000 1734017241.144325 mapread 0x0fda0e thru 0x107de1 (0xa3d4 bytes) 064000 1734017246.926833 fallocate 0x42ea62 thru 0x436667 (0x7c06 bytes) 067000 1734017255.379106 read 0x157b0b thru 0x159c82 (0x2178 bytes) 068000 1734017257.845471 write 0x04650a thru 0x052323 (0xbe1a bytes) 069000 1734017261.019388 mapwrite 0x3851e3 thru 0x392949 (0xd767 bytes) 073000 1734017273.005911 read 0x412317 thru 0x41cb57 (0xa841 bytes) 074000 1734017275.806675 punch from 0x0f9916 to 0x1037b6 (0x9ea1 bytes) 075000 1734017278.455540 mapwrite 0x2f7971 thru 0x305a9a (0xe12a bytes) 076000 1734017281.122962 fallocate 0x47f27e thru 0x4851c1 (0x5f44 bytes) 079000 1734017290.487969 trunc from 0x493619 to 0x3b774d (0xdbecb bytes) 081000 1734017295.904386 trunc from 0x3f3377 to 0x3b677e (0x3cbf8 bytes) 083000 1734017301.917601 write 0x020068 thru 0x02addf (0xad78 bytes) 084000 1734017305.272993 fallocate 0x16dc3c thru 0x178fef (0xb3b4 bytes) 085000 1734017308.545561 trunc from 0x316b0b to 0x30651c (0x105ee bytes) 087000 1734017314.977115 read 0x11fc5b thru 0x121e40 (0x21e6 bytes) 088000 1734017317.555382 write 0x4696c7 thru 0x470186 (0x6ac0 bytes) 089000 1734017320.035923 write 0x07c111 thru 0x081f68 (0x5e58 bytes) 090000 1734017322.601791 trunc from 0x30a790 to 0x42d95c (0x1231cd bytes) 091000 1734017325.041915 punch from 0x1b6418 to 0x1bc56d (0x6156 bytes) 092000 1734017327.560411 punch from 0x001f94 to 0x002186 (0x1f3 bytes) 093000 1734017329.807366 fallocate 0x2f963f thru 0x30346e (0x9e30 bytes) 094000 1734017332.256119 read 0x28bd3e thru 0x2950d9 (0x939c bytes) 095000 1734017334.510239 punch from 0x2cd122 to 0x2ce57d (0x145c bytes) 096000 1734017337.062685 mapread 0x3abe05 thru 0x3bae3b (0xf037 bytes) 097000 1734017339.424853 mapwrite 0x445146 thru 0x451c4e (0xcb09 bytes) 098000 1734017341.946116 fallocate 0x277da5 thru 0x284377 (0xc5d3 bytes) 099000 1734017344.581832 fallocate 0x2155cf thru 0x224f95 (0xf9c7 bytes) 100000 1734017346.912774 fallocate 0x4d4073 thru 0x4df4e8 (0xb476 bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 5108969 (4992 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 2101248.. 2101251: 4: 0000: net 1: 4.. 7: 3284288.. 3284291: 4: 0000: unwritten,net 2: 428.. 483: 3017124.. 3017179: 56: 0000: net 3: 1156.. 1167: 3284340.. 3284351: 12: 0000: net 4: 4944.. 4991: 3284292.. 3284339: 48: 0000: last,unwritten,net,eof /mnt/lustre/f0.fsxfile: 5 extents found debug=0x33f0484 PASS fsx (292s) == sanity-benchmark test complete, duration 1510 sec ===== 10:29:08 (1734017348) === sanity-benchmark: start cleanup 10:29:08 (1734017348) === === sanity-benchmark: finish cleanup 10:29:09 (1734017349) ===