-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:56 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:00 (1734015840) === oleg205-client.virtnet: executing check_config_client /mnt/lustre oleg205-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg205-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a628800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a628800.idle_timeout=debug disable quota as required oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:09 (1734015849) === == sanity-benchmark test dbench: dbench ================== 10:04:10 (1734015850) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6989] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg205-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg205-client.virtnet at Thu Dec 12 10:04:12 EST 2024 waiting for dbench pid 9457 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 54 45.49 MB/sec warmup 1 sec latency 115.929 ms 20 140 61.02 MB/sec warmup 2 sec latency 195.155 ms 20 199 52.47 MB/sec warmup 3 sec latency 144.690 ms 20 257 48.70 MB/sec warmup 4 sec latency 161.252 ms 20 317 46.30 MB/sec warmup 5 sec latency 167.302 ms 20 388 45.90 MB/sec warmup 6 sec latency 116.715 ms 20 465 46.54 MB/sec warmup 7 sec latency 116.555 ms 20 550 47.54 MB/sec warmup 8 sec latency 140.597 ms 20 654 46.84 MB/sec warmup 9 sec latency 266.192 ms 20 688 42.33 MB/sec warmup 10 sec latency 512.041 ms 20 727 38.70 MB/sec warmup 11 sec latency 238.878 ms 20 777 35.57 MB/sec warmup 12 sec latency 129.309 ms 20 802 33.01 MB/sec warmup 13 sec latency 242.907 ms 20 865 30.84 MB/sec warmup 14 sec latency 211.938 ms 20 904 28.92 MB/sec warmup 15 sec latency 260.772 ms 20 944 27.21 MB/sec warmup 16 sec latency 325.387 ms 20 989 25.87 MB/sec warmup 17 sec latency 262.477 ms 20 1074 25.44 MB/sec warmup 18 sec latency 257.767 ms 20 1139 24.19 MB/sec warmup 19 sec latency 113.111 ms 20 1197 23.03 MB/sec warmup 20 sec latency 96.183 ms 20 1247 21.98 MB/sec warmup 21 sec latency 106.280 ms 20 1377 23.24 MB/sec warmup 22 sec latency 108.068 ms 20 1441 22.61 MB/sec warmup 23 sec latency 130.141 ms 20 1550 1.25 MB/sec execute 1 sec latency 270.031 ms 20 1605 1.10 MB/sec execute 2 sec latency 155.225 ms 20 1650 0.95 MB/sec execute 3 sec latency 247.079 ms 20 1698 0.94 MB/sec execute 4 sec latency 251.397 ms 20 1756 0.94 MB/sec execute 5 sec latency 124.560 ms 20 1813 0.93 MB/sec execute 6 sec latency 88.096 ms 20 1855 0.88 MB/sec execute 7 sec latency 343.518 ms 20 1904 0.90 MB/sec execute 8 sec latency 285.801 ms 20 1963 0.93 MB/sec execute 9 sec latency 264.332 ms 20 2017 0.97 MB/sec execute 10 sec latency 108.310 ms 20 2066 1.02 MB/sec execute 11 sec latency 114.588 ms 20 2130 1.06 MB/sec execute 12 sec latency 91.122 ms 20 2175 1.04 MB/sec execute 13 sec latency 111.524 ms 20 2211 1.16 MB/sec execute 14 sec latency 153.395 ms 20 2264 1.66 MB/sec execute 15 sec latency 476.073 ms 20 2332 2.10 MB/sec execute 16 sec latency 425.278 ms 20 2382 2.24 MB/sec execute 17 sec latency 341.024 ms 20 2413 2.25 MB/sec execute 18 sec latency 528.026 ms 20 2454 2.43 MB/sec execute 19 sec latency 423.070 ms 20 2483 2.52 MB/sec execute 20 sec latency 986.141 ms 20 2557 2.93 MB/sec execute 21 sec latency 393.631 ms 20 2617 3.08 MB/sec execute 22 sec latency 259.419 ms 20 2726 4.44 MB/sec execute 23 sec latency 367.368 ms 20 2809 5.03 MB/sec execute 24 sec latency 440.993 ms 20 2917 5.70 MB/sec execute 25 sec latency 354.407 ms 20 2993 5.78 MB/sec execute 26 sec latency 419.152 ms 20 3031 5.62 MB/sec execute 27 sec latency 558.919 ms 20 3163 5.83 MB/sec execute 28 sec latency 488.356 ms 20 3249 5.97 MB/sec execute 29 sec latency 518.404 ms 20 3338 6.41 MB/sec execute 30 sec latency 328.274 ms 20 3392 6.34 MB/sec execute 31 sec latency 279.033 ms 20 3490 7.22 MB/sec execute 32 sec latency 150.734 ms 20 3577 7.52 MB/sec execute 33 sec latency 98.914 ms 20 3634 7.41 MB/sec execute 34 sec latency 117.799 ms 20 3675 7.30 MB/sec execute 35 sec latency 184.578 ms 20 3714 7.14 MB/sec execute 36 sec latency 134.720 ms 20 3775 7.36 MB/sec execute 37 sec latency 157.704 ms 20 3815 7.22 MB/sec execute 38 sec latency 139.169 ms 20 3848 7.05 MB/sec execute 39 sec latency 112.642 ms 20 3871 6.87 MB/sec execute 40 sec latency 199.193 ms 20 3902 6.77 MB/sec execute 41 sec latency 136.685 ms 20 3938 6.67 MB/sec execute 42 sec latency 114.657 ms 20 3968 6.51 MB/sec execute 43 sec latency 145.068 ms 20 3995 6.36 MB/sec execute 44 sec latency 155.746 ms 20 4019 6.22 MB/sec execute 45 sec latency 202.487 ms 20 4057 6.09 MB/sec execute 46 sec latency 148.033 ms 20 4095 5.97 MB/sec execute 47 sec latency 286.216 ms 20 4151 5.86 MB/sec execute 48 sec latency 281.624 ms 20 4211 5.76 MB/sec execute 49 sec latency 279.143 ms 20 4242 5.69 MB/sec execute 50 sec latency 671.200 ms 20 4269 5.59 MB/sec execute 51 sec latency 581.419 ms 20 4305 5.53 MB/sec execute 52 sec latency 345.085 ms 20 4329 5.44 MB/sec execute 53 sec latency 228.886 ms 20 4369 5.38 MB/sec execute 54 sec latency 292.580 ms 20 4395 5.31 MB/sec execute 55 sec latency 365.567 ms 20 4447 5.24 MB/sec execute 56 sec latency 236.598 ms 20 4480 5.18 MB/sec execute 57 sec latency 347.867 ms 20 4514 5.18 MB/sec execute 58 sec latency 373.047 ms 20 4556 5.12 MB/sec execute 59 sec latency 385.611 ms 20 4587 5.07 MB/sec execute 60 sec latency 309.813 ms 20 4634 5.14 MB/sec execute 61 sec latency 479.065 ms 20 4702 5.17 MB/sec execute 62 sec latency 89.591 ms 20 4766 5.25 MB/sec execute 63 sec latency 141.548 ms 20 4818 5.22 MB/sec execute 64 sec latency 123.697 ms 20 4858 5.19 MB/sec execute 65 sec latency 296.444 ms 20 4919 5.28 MB/sec execute 66 sec latency 300.114 ms 20 5008 5.70 MB/sec execute 67 sec latency 127.365 ms 20 5049 5.62 MB/sec execute 68 sec latency 225.607 ms 20 5081 5.54 MB/sec execute 69 sec latency 303.362 ms 20 5127 5.48 MB/sec execute 70 sec latency 303.572 ms 20 5170 5.41 MB/sec execute 71 sec latency 173.872 ms 20 5192 5.34 MB/sec execute 72 sec latency 217.157 ms 20 5232 5.27 MB/sec execute 73 sec latency 198.022 ms 20 5272 5.22 MB/sec execute 74 sec latency 256.184 ms 20 5314 5.15 MB/sec execute 75 sec latency 129.989 ms 20 5343 5.09 MB/sec execute 76 sec latency 285.649 ms 20 5389 5.04 MB/sec execute 77 sec latency 202.412 ms 20 5425 4.98 MB/sec execute 78 sec latency 188.034 ms 20 5464 4.93 MB/sec execute 79 sec latency 179.686 ms 20 5512 4.88 MB/sec execute 80 sec latency 210.244 ms 20 5575 4.83 MB/sec execute 81 sec latency 253.096 ms 20 5620 4.79 MB/sec execute 82 sec latency 109.386 ms 20 5675 4.77 MB/sec execute 83 sec latency 113.155 ms 20 5736 4.76 MB/sec execute 84 sec latency 235.547 ms 20 5788 4.72 MB/sec execute 85 sec latency 282.334 ms 20 5833 4.73 MB/sec execute 86 sec latency 208.027 ms 20 5887 4.73 MB/sec execute 87 sec latency 255.228 ms 20 5966 4.82 MB/sec execute 88 sec latency 292.088 ms 20 6010 4.79 MB/sec execute 89 sec latency 311.571 ms 20 6078 4.91 MB/sec execute 90 sec latency 406.276 ms 20 6152 4.98 MB/sec execute 91 sec latency 328.386 ms 20 6241 5.12 MB/sec execute 92 sec latency 387.731 ms 20 6348 5.29 MB/sec execute 93 sec latency 268.159 ms 20 6496 5.55 MB/sec execute 94 sec latency 304.331 ms 20 6599 5.66 MB/sec execute 95 sec latency 277.745 ms 20 6683 5.67 MB/sec execute 96 sec latency 361.210 ms 20 6800 5.81 MB/sec execute 97 sec latency 356.211 ms 20 6917 5.90 MB/sec execute 98 sec latency 392.016 ms 20 7013 6.01 MB/sec execute 99 sec latency 400.502 ms 20 7106 6.17 MB/sec execute 100 sec latency 227.839 ms 20 7196 6.31 MB/sec execute 101 sec latency 94.535 ms 20 7258 6.30 MB/sec execute 102 sec latency 92.402 ms 20 7314 6.30 MB/sec execute 103 sec latency 93.015 ms 20 7365 6.30 MB/sec execute 104 sec latency 126.004 ms 20 7412 6.27 MB/sec execute 105 sec latency 130.490 ms 20 7455 6.22 MB/sec execute 106 sec latency 90.903 ms 20 7501 6.18 MB/sec execute 107 sec latency 101.720 ms 20 7546 6.13 MB/sec execute 108 sec latency 90.406 ms 20 7584 6.08 MB/sec execute 109 sec latency 161.354 ms 20 7618 6.03 MB/sec execute 110 sec latency 388.003 ms 20 7656 5.98 MB/sec execute 111 sec latency 336.282 ms 20 7694 5.93 MB/sec execute 112 sec latency 292.122 ms 20 7743 5.89 MB/sec execute 113 sec latency 362.113 ms 20 7793 5.85 MB/sec execute 114 sec latency 309.499 ms 20 7823 5.81 MB/sec execute 115 sec latency 464.573 ms 20 7851 5.77 MB/sec execute 116 sec latency 309.905 ms 20 7890 5.74 MB/sec execute 117 sec latency 312.214 ms 20 7917 5.70 MB/sec execute 118 sec latency 413.343 ms 20 7951 5.67 MB/sec execute 119 sec latency 464.771 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 22620 55.005 218.775 Close 16367 14.189 75.344 Rename 891 84.885 219.171 Unlink 4703 19.194 88.272 Qpathinfo 20784 12.813 157.769 Qfileinfo 3571 0.186 40.228 Qfsinfo 3722 0.188 27.635 Sfileinfo 1548 49.328 164.495 Find 7906 3.877 138.780 WriteX 11014 4.215 72.012 ReadX 35083 0.030 12.418 LockX 80 19.284 63.096 UnlockX 80 18.331 39.768 Flush 1612 207.463 986.135 Throughput 5.666 MB/sec 20 clients 20 procs max_latency=986.141 ms stopping dbench on /mnt/lustre/d0.oleg205-client.virtnet at Thu Dec 12 10:06:39 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg205-client.virtnet /mnt/lustre/d0.oleg205-client.virtnet /mnt/lustre/d0.oleg205-client.virtnet removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg205-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:46 (1734016006) min OST has 3434496kB available, using 5151744kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6989] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5031] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg205-clien 5031M 78558 60 55024 47 119138 30 429.5 105 Latency 31368us 105ms 84310us 729ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg205-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 242 18 6427 28 369 13 340 18 912 12 509 12 Latency 32577us 20590us 84591us 11274us 5403us 12112us 1.97,1.97,oleg205-client.virtnet,1,1734006052,5031M,,,,78558,60,55024,47,,,119138,30,429.5,105,10,,,,,242,18,6427,28,369,13,340,18,912,12,509,12,,31368us,105ms,,84310us,729ms,32577us,20590us,84591us,11274us,5403us,12112us debug=0x33f0484 PASS bonnie (362s) == sanity-benchmark test iozone: iozone ================== 10:12:48 (1734016368) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6989] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:09 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 114328 100226 103043 137144 73854 83066 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:33 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 27176 27554 112181 108058 97683 35311 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1157s) == sanity-benchmark test fsx: fsx ======================== 10:32:05 (1734017525) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 18363 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 18363 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1f43aa truncating to largest ever: 0x372172 truncating to largest ever: 0x4cc8e1 truncating to largest ever: 0x55b1aa truncating to largest ever: 0x561701 004000 1734017536.639955 write 0x3d430c thru 0x3da95b (0x6650 bytes) 006000 1734017542.322599 trunc from 0x4c4607 to 0x0aadd9 (0x41982d bytes) 007000 1734017544.604467 mapwrite 0x1ae44c thru 0x1b0672 (0x2227 bytes) 008000 1734017547.690691 mapwrite 0x3f6751 thru 0x40208b (0xb93b bytes) 012000 1734017559.606572 read 0x2a07cb thru 0x2a0fd5 (0x80b bytes) 016000 1734017570.219395 write 0x427eaa thru 0x42ce67 (0x4fbe bytes) 017000 1734017572.965441 read 0x096344 thru 0x096f4b (0xc08 bytes) 018000 1734017575.868546 trunc from 0x37ed83 to 0x41fb02 (0xa0d80 bytes) 021000 1734017584.690969 trunc from 0x0c5c11 to 0x54d27f (0x48766f bytes) truncating to largest ever: 0x561799 023000 1734017590.414764 write 0x4b7d9f thru 0x4c781d (0xfa7f bytes) 024000 1734017593.679957 write 0x415c89 thru 0x4221e6 (0xc55e bytes) 025000 1734017596.686244 mapwrite 0x49e0b3 thru 0x4ac41f (0xe36d bytes) truncating to largest ever: 0x561b4f 027000 1734017602.416769 trunc from 0x45626f to 0x2715d3 (0x1e4c9b bytes) 031000 1734017613.513572 write 0x450939 thru 0x450d5e (0x426 bytes) 032000 1734017616.026953 read 0x143328 thru 0x147c97 (0x4970 bytes) 036000 1734017626.824125 read 0x4d0f2d thru 0x4dc8e5 (0xb9b9 bytes) 038000 1734017632.582818 write 0x3405e3 thru 0x343d7d (0x379b bytes) 046000 1734017655.269440 trunc from 0x482860 to 0x2f49a8 (0x18deb7 bytes) 048000 1734017660.745439 mapwrite 0x35f082 thru 0x366ad9 (0x7a58 bytes) 050000 1734017666.164980 mapwrite 0x503a5e thru 0x50fa1c (0xbfbf bytes) 058000 1734017688.106799 read 0x3d9d53 thru 0x3e10c4 (0x7372 bytes) 061000 1734017696.614027 read 0x406cd9 thru 0x40dab7 (0x6ddf bytes) 063000 1734017702.224202 read 0x3725c2 thru 0x3742a9 (0x1ce8 bytes) 064000 1734017705.188086 mapwrite 0x05720b thru 0x05b9e2 (0x47d8 bytes) 065000 1734017707.898000 trunc from 0x426d39 to 0x23805e (0x1eecda bytes) 066000 1734017710.726089 write 0x33556b thru 0x34222b (0xccc1 bytes) 067000 1734017713.714605 trunc from 0x36bd16 to 0x4e5f4f (0x17a23a bytes) 068000 1734017716.461294 mapwrite 0x330fd9 thru 0x331b81 (0xba9 bytes) 070000 1734017722.071196 mapwrite 0x2d124e thru 0x2da633 (0x93e6 bytes) 071000 1734017724.949893 trunc from 0x3f793f to 0x092b41 (0x364dfd bytes) 072000 1734017727.728738 trunc from 0x484cfe to 0x31c1d1 (0x168b2c bytes) 074000 1734017733.454482 mapread 0x394c0a thru 0x3a0685 (0xba7c bytes) 076000 1734017739.281546 trunc from 0x55bb68 to 0x2ee8f4 (0x26d273 bytes) 078000 1734017744.835245 mapread 0x16077d thru 0x1661af (0x5a33 bytes) 083000 1734017758.875154 write 0x17c9a2 thru 0x180561 (0x3bc0 bytes) 085000 1734017763.992636 mapread 0x05b9e1 thru 0x069c6c (0xe28c bytes) 087000 1734017769.514657 trunc from 0x4b3fe9 to 0x1c69b9 (0x2ed62f bytes) 088000 1734017772.197275 mapread 0x02b5d0 thru 0x02e503 (0x2f34 bytes) 089000 1734017774.499324 mapread 0x19be45 thru 0x1a1c5a (0x5e16 bytes) 090000 1734017777.628858 mapwrite 0x1d1407 thru 0x1deb1c (0xd716 bytes) 091000 1734017780.556431 write 0x01a882 thru 0x01cbef (0x236e bytes) 092000 1734017783.565577 mapread 0x1eeec8 thru 0x1f6a90 (0x7bc9 bytes) 094000 1734017788.802756 read 0x16ae19 thru 0x1777fd (0xc9e5 bytes) 096000 1734017794.489439 mapwrite 0x24dda4 thru 0x25687c (0x8ad9 bytes) 097000 1734017797.149877 read 0x2fab7c thru 0x30753d (0xc9c2 bytes) 098000 1734017799.668720 mapread 0x0839a4 thru 0x08ad31 (0x738e bytes) 099000 1734017802.392723 read 0x035cd0 thru 0x03cf1b (0x724c bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 2449063 (2432 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (281s) == sanity-benchmark test complete, duration 1970 sec ===== 10:36:46 (1734017806) === sanity-benchmark: start cleanup 10:36:46 (1734017806) === === sanity-benchmark: finish cleanup 10:36:47 (1734017807) ===