-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:49 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:53 (1734015833) === oleg413-client.virtnet: executing check_config_client /mnt/lustre oleg413-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg413-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6cd6000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6cd6000.idle_timeout=debug disable quota as required oleg413-server: oleg413-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:02 (1734015842) === == sanity-benchmark test dbench: dbench ================== 10:04:03 (1734015843) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6982] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg413-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg413-client.virtnet at Thu Dec 12 10:04:05 EST 2024 waiting for dbench pid 9450 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 77 69.13 MB/sec warmup 1 sec latency 103.865 ms 20 188 75.20 MB/sec warmup 2 sec latency 143.649 ms 20 284 70.68 MB/sec warmup 3 sec latency 81.414 ms 20 383 68.15 MB/sec warmup 4 sec latency 86.155 ms 20 494 68.76 MB/sec warmup 5 sec latency 75.056 ms 20 639 70.10 MB/sec warmup 6 sec latency 125.687 ms 20 695 60.52 MB/sec warmup 7 sec latency 341.511 ms 20 734 53.24 MB/sec warmup 8 sec latency 239.780 ms 20 788 47.56 MB/sec warmup 9 sec latency 185.374 ms 20 833 43.03 MB/sec warmup 10 sec latency 182.411 ms 20 892 39.40 MB/sec warmup 11 sec latency 209.138 ms 20 932 36.37 MB/sec warmup 12 sec latency 270.929 ms 20 985 33.82 MB/sec warmup 13 sec latency 204.203 ms 20 1032 31.97 MB/sec warmup 14 sec latency 423.672 ms 20 1102 30.58 MB/sec warmup 15 sec latency 108.263 ms 20 1156 28.74 MB/sec warmup 16 sec latency 117.355 ms 20 1221 27.44 MB/sec warmup 17 sec latency 143.318 ms 20 1271 26.12 MB/sec warmup 18 sec latency 111.197 ms 20 1324 25.39 MB/sec warmup 19 sec latency 484.402 ms 20 1426 26.00 MB/sec warmup 20 sec latency 335.650 ms 20 1467 24.77 MB/sec warmup 21 sec latency 350.413 ms 20 1506 23.67 MB/sec warmup 22 sec latency 247.220 ms 20 1550 22.68 MB/sec warmup 23 sec latency 289.233 ms 20 1650 0.62 MB/sec execute 1 sec latency 337.020 ms 20 1690 0.68 MB/sec execute 2 sec latency 337.515 ms 20 1744 0.71 MB/sec execute 3 sec latency 127.136 ms 20 1798 0.80 MB/sec execute 4 sec latency 278.982 ms 20 1844 0.78 MB/sec execute 5 sec latency 279.238 ms 20 1885 0.74 MB/sec execute 6 sec latency 213.145 ms 20 1936 0.80 MB/sec execute 7 sec latency 344.494 ms 20 1989 0.84 MB/sec execute 8 sec latency 318.166 ms 20 2029 0.85 MB/sec execute 9 sec latency 142.571 ms 20 2064 0.89 MB/sec execute 10 sec latency 200.883 ms 20 2121 0.96 MB/sec execute 11 sec latency 155.477 ms 20 2172 1.18 MB/sec execute 12 sec latency 262.487 ms 20 2205 1.15 MB/sec execute 13 sec latency 308.332 ms 20 2255 1.36 MB/sec execute 14 sec latency 319.293 ms 20 2291 1.71 MB/sec execute 15 sec latency 672.957 ms 20 2326 1.77 MB/sec execute 16 sec latency 1674.326 ms 20 2379 2.13 MB/sec execute 17 sec latency 1757.433 ms 20 2413 2.16 MB/sec execute 18 sec latency 428.188 ms 20 2460 2.35 MB/sec execute 19 sec latency 414.727 ms 20 2494 2.53 MB/sec execute 20 sec latency 544.566 ms 20 2545 2.93 MB/sec execute 21 sec latency 573.256 ms 20 2626 3.20 MB/sec execute 22 sec latency 562.174 ms 20 2698 3.85 MB/sec execute 23 sec latency 269.662 ms 20 2799 4.89 MB/sec execute 24 sec latency 433.669 ms 20 2908 5.41 MB/sec execute 25 sec latency 393.010 ms 20 2995 5.74 MB/sec execute 26 sec latency 377.828 ms 20 3054 5.68 MB/sec execute 27 sec latency 413.471 ms 20 3160 5.83 MB/sec execute 28 sec latency 365.347 ms 20 3266 6.06 MB/sec execute 29 sec latency 432.512 ms 20 3346 6.39 MB/sec execute 30 sec latency 409.087 ms 20 3423 6.51 MB/sec execute 31 sec latency 269.308 ms 20 3525 7.36 MB/sec execute 32 sec latency 187.710 ms 20 3600 7.55 MB/sec execute 33 sec latency 131.689 ms 20 3652 7.41 MB/sec execute 34 sec latency 144.020 ms 20 3686 7.26 MB/sec execute 35 sec latency 195.921 ms 20 3726 7.15 MB/sec execute 36 sec latency 169.693 ms 20 3775 7.18 MB/sec execute 37 sec latency 129.775 ms 20 3821 7.17 MB/sec execute 38 sec latency 149.570 ms 20 3854 7.00 MB/sec execute 39 sec latency 135.148 ms 20 3876 6.83 MB/sec execute 40 sec latency 168.697 ms 20 3915 6.71 MB/sec execute 41 sec latency 153.740 ms 20 3952 6.61 MB/sec execute 42 sec latency 155.127 ms 20 3984 6.46 MB/sec execute 43 sec latency 149.616 ms 20 4014 6.32 MB/sec execute 44 sec latency 129.074 ms 20 4037 6.18 MB/sec execute 45 sec latency 536.683 ms 20 4066 6.05 MB/sec execute 46 sec latency 738.761 ms 20 4098 5.93 MB/sec execute 47 sec latency 369.297 ms 20 4136 5.82 MB/sec execute 48 sec latency 264.706 ms 20 4189 5.71 MB/sec execute 49 sec latency 464.298 ms 20 4238 5.63 MB/sec execute 50 sec latency 385.960 ms 20 4267 5.56 MB/sec execute 51 sec latency 522.927 ms 20 4298 5.47 MB/sec execute 52 sec latency 310.697 ms 20 4328 5.40 MB/sec execute 53 sec latency 396.676 ms 20 4357 5.32 MB/sec execute 54 sec latency 240.510 ms 20 4390 5.26 MB/sec execute 55 sec latency 334.069 ms 20 4414 5.20 MB/sec execute 56 sec latency 336.073 ms 20 4454 5.15 MB/sec execute 57 sec latency 315.881 ms 20 4494 5.11 MB/sec execute 58 sec latency 329.294 ms 20 4522 5.04 MB/sec execute 59 sec latency 468.743 ms 20 4559 5.03 MB/sec execute 60 sec latency 353.524 ms 20 4598 4.96 MB/sec execute 61 sec latency 287.238 ms 20 4642 5.03 MB/sec execute 62 sec latency 368.676 ms 20 4711 5.19 MB/sec execute 63 sec latency 160.841 ms 20 4752 5.12 MB/sec execute 64 sec latency 180.052 ms 20 4794 5.07 MB/sec execute 65 sec latency 349.195 ms 20 4849 5.12 MB/sec execute 66 sec latency 305.865 ms 20 4897 5.07 MB/sec execute 67 sec latency 140.771 ms 20 4961 5.29 MB/sec execute 68 sec latency 328.413 ms 20 5027 5.50 MB/sec execute 69 sec latency 239.318 ms 20 5070 5.43 MB/sec execute 70 sec latency 296.314 ms 20 5104 5.36 MB/sec execute 71 sec latency 244.290 ms 20 5146 5.30 MB/sec execute 72 sec latency 247.654 ms 20 5179 5.23 MB/sec execute 73 sec latency 142.403 ms 20 5207 5.17 MB/sec execute 74 sec latency 167.813 ms 20 5229 5.10 MB/sec execute 75 sec latency 579.568 ms 20 5265 5.05 MB/sec execute 76 sec latency 579.836 ms 20 5301 4.99 MB/sec execute 77 sec latency 356.015 ms 20 5329 4.93 MB/sec execute 78 sec latency 268.207 ms 20 5367 4.88 MB/sec execute 79 sec latency 143.825 ms 20 5408 4.82 MB/sec execute 80 sec latency 198.194 ms 20 5449 4.78 MB/sec execute 81 sec latency 237.717 ms 20 5484 4.73 MB/sec execute 82 sec latency 166.170 ms 20 5534 4.68 MB/sec execute 83 sec latency 174.955 ms 20 5599 4.65 MB/sec execute 84 sec latency 395.289 ms 20 5648 4.63 MB/sec execute 85 sec latency 209.779 ms 20 5690 4.60 MB/sec execute 86 sec latency 252.944 ms 20 5750 4.56 MB/sec execute 87 sec latency 193.592 ms 20 5804 4.56 MB/sec execute 88 sec latency 271.262 ms 20 5844 4.56 MB/sec execute 89 sec latency 299.920 ms 20 5890 4.57 MB/sec execute 90 sec latency 351.589 ms 20 5951 4.62 MB/sec execute 91 sec latency 404.564 ms 20 5994 4.64 MB/sec execute 92 sec latency 468.314 ms 20 6053 4.69 MB/sec execute 93 sec latency 441.184 ms 20 6097 4.68 MB/sec execute 94 sec latency 439.436 ms 20 6162 4.79 MB/sec execute 95 sec latency 363.590 ms 20 6228 4.83 MB/sec execute 96 sec latency 441.056 ms 20 6304 4.92 MB/sec execute 97 sec latency 458.310 ms 20 6414 5.10 MB/sec execute 98 sec latency 339.823 ms 20 6512 5.27 MB/sec execute 99 sec latency 375.992 ms 20 6599 5.35 MB/sec execute 100 sec latency 527.282 ms 20 6654 5.36 MB/sec execute 101 sec latency 472.415 ms 20 6756 5.44 MB/sec execute 102 sec latency 430.881 ms 20 6862 5.49 MB/sec execute 103 sec latency 425.025 ms 20 6955 5.61 MB/sec execute 104 sec latency 335.184 ms 20 7024 5.70 MB/sec execute 105 sec latency 525.946 ms 20 7105 5.79 MB/sec execute 106 sec latency 709.629 ms 20 7188 5.92 MB/sec execute 107 sec latency 99.897 ms 20 7245 5.91 MB/sec execute 108 sec latency 100.431 ms 20 7300 5.91 MB/sec execute 109 sec latency 107.071 ms 20 7344 5.90 MB/sec execute 110 sec latency 152.361 ms 20 7393 5.90 MB/sec execute 111 sec latency 110.761 ms 20 7435 5.86 MB/sec execute 112 sec latency 105.810 ms 20 7472 5.82 MB/sec execute 113 sec latency 135.605 ms 20 7499 5.77 MB/sec execute 114 sec latency 163.809 ms 20 7521 5.73 MB/sec execute 115 sec latency 431.191 ms 20 7556 5.69 MB/sec execute 116 sec latency 206.051 ms 20 7586 5.65 MB/sec execute 117 sec latency 325.956 ms 20 7625 5.60 MB/sec execute 118 sec latency 171.605 ms 20 7664 5.56 MB/sec execute 119 sec latency 342.240 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 17 cleanup 123 sec 0 cleanup 124 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 21133 60.215 229.915 Close 15279 15.388 86.840 Rename 842 90.612 205.982 Unlink 4313 20.699 78.797 Qpathinfo 19612 14.355 166.973 Qfileinfo 3366 0.231 34.677 Qfsinfo 3481 0.243 26.589 Sfileinfo 1347 58.198 178.102 Find 7421 3.800 156.863 WriteX 10185 4.901 99.387 ReadX 33658 0.034 8.676 LockX 80 21.030 43.122 UnlockX 80 19.982 50.004 Flush 1268 224.256 1757.417 Throughput 5.55812 MB/sec 20 clients 20 procs max_latency=1757.433 ms stopping dbench on /mnt/lustre/d0.oleg413-client.virtnet at Thu Dec 12 10:06:33 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg413-client.virtnet /mnt/lustre/d0.oleg413-client.virtnet /mnt/lustre/d0.oleg413-client.virtnet removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg413-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (158s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:41 (1734016001) min OST has 3462144kB available, using 5193216kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6982] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5071] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg413-clien 5071M 72950 58 48172 43 108654 28 508.7 106 Latency 20540us 101ms 113ms 684ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg413-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 217 18 7310 31 300 13 274 18 787 12 387 13 Latency 29212us 14446us 56291us 18482us 9063us 18151us 1.97,1.97,oleg413-client.virtnet,1,1734006084,5071M,,,,72950,58,48172,43,,,108654,28,508.7,106,10,,,,,217,18,7310,31,300,13,274,18,787,12,387,13,,20540us,101ms,,113ms,684ms,29212us,14446us,56291us,18482us,9063us,18151us debug=0x33f0484 PASS bonnie (411s) == sanity-benchmark test iozone: iozone ================== 10:13:32 (1734016412) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6982] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:53 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 115927 99495 101179 127610 61631 78867 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:20:38 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 23778 24185 95043 95632 94279 31964 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1272s) == sanity-benchmark test fsx: fsx ======================== 10:34:44 (1734017684) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 16105 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 16105 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x141998 truncating to largest ever: 0x3b0eea truncating to largest ever: 0x401aa1 truncating to largest ever: 0x486041 truncating to largest ever: 0x501f39 truncating to largest ever: 0x554cb5 001000 1734017687.133338 mapread 0x3bbba8 thru 0x3c0c88 (0x50e1 bytes) truncating to largest ever: 0x55978f truncating to largest ever: 0x55e9e8 008000 1734017704.862392 trunc from 0x48e7a9 to 0x126525 (0x368283 bytes) truncating to largest ever: 0x55f005 009000 1734017707.675370 mapread 0x084f03 thru 0x08f5c0 (0xa6be bytes) truncating to largest ever: 0x560d9a 012000 1734017716.871143 mapread 0x28f963 thru 0x294e63 (0x5501 bytes) 014000 1734017723.053376 write 0x1a4379 thru 0x1ab48f (0x7117 bytes) skipping zero size read 015000 1734017725.957967 trunc from 0x29ba4c to 0x493673 (0x1f7c28 bytes) 016000 1734017728.641448 mapread 0x277d8e thru 0x27a555 (0x27c8 bytes) 019000 1734017737.627979 mapwrite 0x0622bc thru 0x0687c8 (0x650d bytes) 020000 1734017740.343011 trunc from 0x343872 to 0x4e4aa6 (0x1a1235 bytes) truncating to largest ever: 0x5618c9 021000 1734017743.627007 read 0x052459 thru 0x053c82 (0x182a bytes) 023000 1734017749.919542 write 0x11b13e thru 0x11f2ce (0x4191 bytes) 026000 1734017759.371516 write 0x22b145 thru 0x2355d0 (0xa48c bytes) 027000 1734017762.893037 trunc from 0x4fd0c6 to 0x071335 (0x48bd90 bytes) 028000 1734017765.700977 mapread 0x23b0ef thru 0x23f2a1 (0x41b3 bytes) 029000 1734017768.760798 write 0x00085a thru 0x007705 (0x6eac bytes) 030000 1734017771.638590 mapread 0x01c310 thru 0x0277f9 (0xb4ea bytes) 031000 1734017774.873025 mapread 0x333241 thru 0x33fe99 (0xcc59 bytes) 032000 1734017778.097946 mapread 0x115237 thru 0x11adde (0x5ba8 bytes) 037000 1734017792.869205 trunc from 0x01945f to 0x31d621 (0x3041c3 bytes) 038000 1734017796.080809 mapread 0x47298c thru 0x47fe65 (0xd4da bytes) 041000 1734017805.582289 trunc from 0x45a8a3 to 0x1d238c (0x288516 bytes) truncating to largest ever: 0x56193f 042000 1734017808.854104 mapread 0x1328b2 thru 0x1415dc (0xed2b bytes) 046000 1734017820.597695 trunc from 0x3b3175 to 0x45d0b9 (0xa9f45 bytes) 055000 1734017848.210799 mapread 0x10751e thru 0x10ff97 (0x8a7a bytes) 058000 1734017857.450378 trunc from 0x4dafda to 0x3fbf2f (0xdf0aa bytes) 059000 1734017860.593034 trunc from 0x41a782 to 0x2f7970 (0x122e11 bytes) 061000 1734017866.624943 write 0x3796ea thru 0x37d7c7 (0x40de bytes) 062000 1734017869.258546 trunc from 0x0f2cfb to 0x1ec277 (0xf957d bytes) 063000 1734017872.545968 trunc from 0x467ef5 to 0x1f8f19 (0x26efdb bytes) 065000 1734017879.137175 mapwrite 0x1d3343 thru 0x1d7292 (0x3f50 bytes) 066000 1734017882.120211 read 0x1ab0f8 thru 0x1aebb3 (0x3abc bytes) 069000 1734017891.593240 mapread 0x28fc30 thru 0x29c964 (0xcd35 bytes) 070000 1734017895.413917 trunc from 0x3a6fa7 to 0x2842d9 (0x122ccd bytes) 071000 1734017898.207605 trunc from 0x31ab6d to 0x2b7616 (0x63556 bytes) 072000 1734017901.285477 mapread 0x09aa7a thru 0x09e373 (0x38fa bytes) 073000 1734017904.656384 write 0x0d1839 thru 0x0d938f (0x7b57 bytes) 074000 1734017907.779610 mapwrite 0x000f2e thru 0x00f4c3 (0xe596 bytes) 075000 1734017911.304609 mapwrite 0x311149 thru 0x3198a9 (0x8761 bytes) truncating to largest ever: 0x561bb9 078000 1734017920.495982 mapread 0x006d52 thru 0x007c40 (0xeef bytes) 081000 1734017930.581571 write 0x29e4b6 thru 0x2ab8c1 (0xd40c bytes) 082000 1734017933.640531 mapwrite 0x3d5db9 thru 0x3d8f4c (0x3194 bytes) 084000 1734017939.886771 mapwrite 0x035020 thru 0x03b160 (0x6141 bytes) 089000 1734017955.968768 write 0x53309b thru 0x53b71e (0x8684 bytes) 093000 1734017968.548050 read 0x08c058 thru 0x0948d8 (0x8881 bytes) 094000 1734017971.892313 mapwrite 0x12b42c thru 0x1356dc (0xa2b1 bytes) 095000 1734017974.766491 trunc from 0x55b8ca to 0x139d10 (0x421bb9 bytes) 097000 1734017980.643445 read 0x2181e0 thru 0x224c45 (0xca66 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4975679 (4864 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (306s) == sanity-benchmark test complete, duration 2161 sec ===== 10:39:50 (1734017990) === sanity-benchmark: start cleanup 10:39:51 (1734017991) === === sanity-benchmark: finish cleanup 10:39:51 (1734017991) ===