-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:57 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:03 (1734015843) === oleg415-client.virtnet: executing check_config_client /mnt/lustre oleg415-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg415-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a5bb800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a5bb800.idle_timeout=debug disable quota as required oleg415-server: oleg415-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:16 (1734015856) === == sanity-benchmark test dbench: dbench ================== 10:04:17 (1734015857) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7739] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg415-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg415-client.virtnet at Thu Dec 12 10:04:20 EST 2024 waiting for dbench pid 10325 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 1 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 0 5 0.00 MB/sec warmup 1 sec latency 921.251 ms 13 52 21.78 MB/sec warmup 2 sec latency 215.820 ms 20 116 35.19 MB/sec warmup 3 sec latency 284.003 ms 20 156 32.62 MB/sec warmup 4 sec latency 233.521 ms 20 207 32.43 MB/sec warmup 5 sec latency 149.838 ms 20 270 33.68 MB/sec warmup 6 sec latency 156.084 ms 20 320 33.23 MB/sec warmup 7 sec latency 148.678 ms 20 373 33.20 MB/sec warmup 8 sec latency 183.567 ms 20 427 33.35 MB/sec warmup 9 sec latency 144.650 ms 20 488 33.92 MB/sec warmup 10 sec latency 133.045 ms 20 566 34.94 MB/sec warmup 11 sec latency 150.833 ms 20 648 35.04 MB/sec warmup 12 sec latency 673.632 ms 20 675 32.48 MB/sec warmup 13 sec latency 828.601 ms 20 717 30.28 MB/sec warmup 14 sec latency 325.765 ms 20 738 28.35 MB/sec warmup 15 sec latency 344.493 ms 20 784 26.70 MB/sec warmup 16 sec latency 349.747 ms 20 805 25.20 MB/sec warmup 17 sec latency 408.158 ms 20 871 23.98 MB/sec warmup 18 sec latency 299.336 ms 20 906 22.80 MB/sec warmup 19 sec latency 338.976 ms 20 940 21.73 MB/sec warmup 20 sec latency 343.094 ms 20 976 20.78 MB/sec warmup 21 sec latency 367.333 ms 20 1043 20.76 MB/sec warmup 22 sec latency 549.861 ms 20 1114 19.93 MB/sec warmup 23 sec latency 106.415 ms 20 1208 0.94 MB/sec execute 1 sec latency 132.921 ms 20 1257 0.92 MB/sec execute 2 sec latency 103.255 ms 20 1376 17.44 MB/sec execute 3 sec latency 203.934 ms 20 1437 15.04 MB/sec execute 4 sec latency 111.401 ms 20 1480 12.12 MB/sec execute 5 sec latency 527.489 ms 20 1530 10.28 MB/sec execute 6 sec latency 404.359 ms 20 1606 8.99 MB/sec execute 7 sec latency 89.889 ms 20 1646 7.96 MB/sec execute 8 sec latency 392.845 ms 20 1690 7.14 MB/sec execute 9 sec latency 227.757 ms 20 1759 6.54 MB/sec execute 10 sec latency 111.709 ms 20 1815 6.05 MB/sec execute 11 sec latency 108.521 ms 20 1862 5.58 MB/sec execute 12 sec latency 109.897 ms 20 1891 5.19 MB/sec execute 13 sec latency 598.992 ms 20 1978 4.93 MB/sec execute 14 sec latency 285.537 ms 20 2039 4.76 MB/sec execute 15 sec latency 76.645 ms 20 2110 4.57 MB/sec execute 16 sec latency 96.646 ms 20 2161 4.36 MB/sec execute 17 sec latency 96.183 ms 20 2204 4.17 MB/sec execute 18 sec latency 114.736 ms 20 2273 4.49 MB/sec execute 19 sec latency 156.610 ms 20 2340 4.86 MB/sec execute 20 sec latency 799.370 ms 20 2369 4.69 MB/sec execute 21 sec latency 939.374 ms 20 2407 4.56 MB/sec execute 22 sec latency 472.370 ms 20 2440 4.47 MB/sec execute 23 sec latency 459.061 ms 20 2483 4.75 MB/sec execute 24 sec latency 413.554 ms 20 2577 4.75 MB/sec execute 25 sec latency 405.916 ms 20 2674 5.72 MB/sec execute 26 sec latency 121.050 ms 20 2789 6.65 MB/sec execute 27 sec latency 407.121 ms 20 2916 7.35 MB/sec execute 28 sec latency 412.865 ms 20 2981 7.24 MB/sec execute 29 sec latency 431.688 ms 20 3037 7.07 MB/sec execute 30 sec latency 407.662 ms 20 3203 7.29 MB/sec execute 31 sec latency 343.091 ms 20 3297 7.71 MB/sec execute 32 sec latency 504.674 ms 20 3382 7.81 MB/sec execute 33 sec latency 257.054 ms 20 3511 8.91 MB/sec execute 34 sec latency 112.914 ms 20 3598 8.84 MB/sec execute 35 sec latency 83.348 ms 20 3664 8.70 MB/sec execute 36 sec latency 102.282 ms 20 3717 8.61 MB/sec execute 37 sec latency 119.108 ms 20 3779 8.81 MB/sec execute 38 sec latency 149.008 ms 20 3817 8.58 MB/sec execute 39 sec latency 119.060 ms 20 3855 8.37 MB/sec execute 40 sec latency 114.517 ms 20 3904 8.27 MB/sec execute 41 sec latency 98.878 ms 20 3930 8.11 MB/sec execute 42 sec latency 241.207 ms 20 3970 7.92 MB/sec execute 43 sec latency 155.440 ms 20 4007 7.74 MB/sec execute 44 sec latency 133.370 ms 20 4058 7.57 MB/sec execute 45 sec latency 93.608 ms 20 4115 7.42 MB/sec execute 46 sec latency 145.707 ms 20 4162 7.27 MB/sec execute 47 sec latency 176.534 ms 20 4211 7.14 MB/sec execute 48 sec latency 734.895 ms 20 4237 7.04 MB/sec execute 49 sec latency 762.054 ms 20 4267 6.92 MB/sec execute 50 sec latency 781.382 ms 20 4299 6.82 MB/sec execute 51 sec latency 337.079 ms 20 4344 6.72 MB/sec execute 52 sec latency 227.122 ms 20 4374 6.63 MB/sec execute 53 sec latency 335.625 ms 20 4435 6.56 MB/sec execute 54 sec latency 295.445 ms 20 4469 6.47 MB/sec execute 55 sec latency 400.573 ms 20 4506 6.38 MB/sec execute 56 sec latency 443.934 ms 20 4556 6.34 MB/sec execute 57 sec latency 316.563 ms 20 4629 6.54 MB/sec execute 58 sec latency 374.810 ms 20 4698 6.46 MB/sec execute 59 sec latency 110.970 ms 20 4758 6.37 MB/sec execute 60 sec latency 100.311 ms 20 4829 6.39 MB/sec execute 61 sec latency 79.432 ms 20 4948 6.99 MB/sec execute 62 sec latency 104.796 ms 20 4998 7.02 MB/sec execute 63 sec latency 180.401 ms 20 5042 6.91 MB/sec execute 64 sec latency 376.037 ms 20 5090 6.82 MB/sec execute 65 sec latency 359.652 ms 20 5143 6.73 MB/sec execute 66 sec latency 84.687 ms 20 5181 6.64 MB/sec execute 67 sec latency 392.153 ms 20 5220 6.55 MB/sec execute 68 sec latency 428.174 ms 20 5275 6.47 MB/sec execute 69 sec latency 360.848 ms 20 5326 6.39 MB/sec execute 70 sec latency 101.018 ms 20 5373 6.31 MB/sec execute 71 sec latency 101.419 ms 20 5422 6.24 MB/sec execute 72 sec latency 212.905 ms 20 5473 6.16 MB/sec execute 73 sec latency 379.625 ms 20 5555 6.10 MB/sec execute 74 sec latency 192.719 ms 20 5600 6.04 MB/sec execute 75 sec latency 104.283 ms 20 5679 5.99 MB/sec execute 76 sec latency 90.553 ms 20 5742 5.94 MB/sec execute 77 sec latency 88.268 ms 20 5820 5.95 MB/sec execute 78 sec latency 243.225 ms 20 5905 6.07 MB/sec execute 79 sec latency 548.444 ms 20 5941 6.01 MB/sec execute 80 sec latency 461.990 ms 20 5977 5.97 MB/sec execute 81 sec latency 466.914 ms 20 6022 5.96 MB/sec execute 82 sec latency 407.071 ms 20 6080 6.01 MB/sec execute 83 sec latency 534.012 ms 20 6165 6.02 MB/sec execute 84 sec latency 264.291 ms 20 6299 6.51 MB/sec execute 85 sec latency 424.709 ms 20 6412 6.65 MB/sec execute 86 sec latency 439.283 ms 20 6502 6.80 MB/sec execute 87 sec latency 393.532 ms 20 6563 6.74 MB/sec execute 88 sec latency 424.204 ms 20 6695 6.77 MB/sec execute 89 sec latency 458.608 ms 20 6799 6.83 MB/sec execute 90 sec latency 473.985 ms 20 6910 6.95 MB/sec execute 91 sec latency 285.699 ms 20 7002 7.13 MB/sec execute 92 sec latency 197.076 ms 20 7120 7.42 MB/sec execute 93 sec latency 101.419 ms 20 7188 7.39 MB/sec execute 94 sec latency 111.602 ms 20 7248 7.35 MB/sec execute 95 sec latency 111.648 ms 20 7317 7.45 MB/sec execute 96 sec latency 174.454 ms 20 7361 7.39 MB/sec execute 97 sec latency 119.511 ms 20 7402 7.32 MB/sec execute 98 sec latency 105.037 ms 20 7449 7.29 MB/sec execute 99 sec latency 135.862 ms 20 7490 7.23 MB/sec execute 100 sec latency 112.712 ms 20 7523 7.16 MB/sec execute 101 sec latency 176.788 ms 20 7566 7.09 MB/sec execute 102 sec latency 112.630 ms 20 7610 7.02 MB/sec execute 103 sec latency 105.632 ms 20 7663 6.96 MB/sec execute 104 sec latency 410.221 ms 20 7742 6.90 MB/sec execute 105 sec latency 384.430 ms 20 7782 6.86 MB/sec execute 106 sec latency 554.813 ms 20 7812 6.80 MB/sec execute 107 sec latency 390.577 ms 20 7847 6.76 MB/sec execute 108 sec latency 336.742 ms 20 7887 6.71 MB/sec execute 109 sec latency 535.308 ms 20 7918 6.67 MB/sec execute 110 sec latency 327.825 ms 20 7967 6.63 MB/sec execute 111 sec latency 249.555 ms 20 8014 6.59 MB/sec execute 112 sec latency 286.223 ms 20 8063 6.56 MB/sec execute 113 sec latency 292.322 ms 20 8114 6.55 MB/sec execute 114 sec latency 318.976 ms 20 8199 6.63 MB/sec execute 115 sec latency 282.772 ms 20 8275 6.59 MB/sec execute 116 sec latency 81.620 ms 20 8354 6.59 MB/sec execute 117 sec latency 77.257 ms 20 8476 6.84 MB/sec execute 118 sec latency 105.068 ms 20 8576 6.93 MB/sec execute 119 sec latency 233.913 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 25746 45.876 241.195 Close 18934 12.136 72.922 Rename 1104 68.104 153.772 Unlink 5117 16.216 85.277 Qpathinfo 23845 11.552 153.743 Qfileinfo 4121 0.266 33.258 Qfsinfo 4213 0.221 29.174 Sfileinfo 2195 43.426 183.524 Find 9014 4.045 143.054 WriteX 12647 5.303 92.213 ReadX 40857 0.028 7.794 LockX 80 12.832 46.469 UnlockX 80 11.550 28.083 Flush 1740 202.480 939.361 Throughput 6.92777 MB/sec 20 clients 20 procs max_latency=939.374 ms stopping dbench on /mnt/lustre/d0.oleg415-client.virtnet at Thu Dec 12 10:06:46 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg415-client.virtnet /mnt/lustre/d0.oleg415-client.virtnet /mnt/lustre/d0.oleg415-client.virtnet removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg415-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:53 (1734016013) min OST has 3381248kB available, using 5071872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7739] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4953] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg415-clien 4953M 74239 57 47996 41 107461 26 508.4 108 Latency 37133us 251ms 108ms 764ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg415-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 225 17 6611 28 304 12 278 17 722 12 259 12 Latency 20416us 15871us 62751us 19397us 5771us 38532us 1.97,1.97,oleg415-client.virtnet,1,1734004895,4953M,,,,74239,57,47996,41,,,107461,26,508.4,108,10,,,,,225,17,6611,28,304,12,278,17,722,12,259,12,,37133us,251ms,,108ms,764ms,20416us,15871us,62751us,19397us,5771us,38532us debug=0x33f0484 PASS bonnie (419s) == sanity-benchmark test iozone: iozone ================== 10:13:52 (1734016432) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7739] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:14:10 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 109981 116184 115452 152166 57143 99861 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:20:28 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 22712 23475 92845 98774 99005 31619 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1259s) == sanity-benchmark test fsx: fsx ======================== 10:34:51 (1734017691) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 6237 -P /tmp -l 5641728 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 6237 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x266d64 truncating to largest ever: 0x4b7874 truncating to largest ever: 0x52314c truncating to largest ever: 0x53e9e0 truncating to largest ever: 0x5452e1 truncating to largest ever: 0x55f807 003000 1734017699.957485 mapwrite 0x14a263 thru 0x14f3d5 (0x5173 bytes) 006000 1734017708.397341 write 0x0a3c96 thru 0x0ad6c9 (0x9a34 bytes) 007000 1734017711.582498 trunc from 0x4b42a2 to 0x14fb91 (0x364710 bytes) truncating to largest ever: 0x55fe41 008000 1734017714.842360 trunc from 0x491eb3 to 0x4cda9d (0x3bbeb bytes) truncating to largest ever: 0x560eec 010000 1734017720.251830 mapwrite 0x090c8d thru 0x09c83b (0xbbaf bytes) 011000 1734017723.254976 trunc from 0x4d8399 to 0x323ca7 (0x1b46f1 bytes) 012000 1734017726.062153 mapread 0x027e53 thru 0x034142 (0xc2f0 bytes) 013000 1734017728.777059 trunc from 0x50a3e5 to 0x2edb61 (0x21c883 bytes) 019000 1734017747.507533 write 0x4a0e11 thru 0x4b088a (0xfa7a bytes) 020000 1734017750.798435 mapwrite 0x003fd3 thru 0x00d92b (0x9959 bytes) 021000 1734017753.643351 write 0x1abccc thru 0x1b54ef (0x9824 bytes) truncating to largest ever: 0x561063 026000 1734017768.085469 mapwrite 0x2c86c0 thru 0x2d4fd5 (0xc916 bytes) 028000 1734017773.487938 mapread 0x42f397 thru 0x431158 (0x1dc2 bytes) 029000 1734017776.652566 trunc from 0x1ab584 to 0x24e687 (0xa3104 bytes) 032000 1734017785.676038 write 0x45c3df thru 0x46646a (0xa08c bytes) 033000 1734017788.942464 mapread 0x0abfdb thru 0x0ad248 (0x126e bytes) 034000 1734017792.535575 mapread 0x054ac9 thru 0x05c171 (0x76a9 bytes) 035000 1734017795.337734 mapread 0x403680 thru 0x412a1e (0xf39f bytes) 039000 1734017808.148668 mapwrite 0x42cdf3 thru 0x42f47b (0x2689 bytes) 041000 1734017814.462278 write 0x2e4bf8 thru 0x2e5de3 (0x11ec bytes) 043000 1734017820.465323 read 0x10daa9 thru 0x11c36b (0xe8c3 bytes) 044000 1734017823.480881 write 0x49b30b thru 0x49db77 (0x286d bytes) 045000 1734017826.403286 read 0x29124e thru 0x2942f5 (0x30a8 bytes) 046000 1734017829.661255 mapread 0x04a028 thru 0x058cf7 (0xecd0 bytes) 047000 1734017832.984288 read 0x06d735 thru 0x070139 (0x2a05 bytes) 048000 1734017836.338533 trunc from 0x54a5e5 to 0x503c39 (0x469ab bytes) 049000 1734017839.254672 trunc from 0x2bec3e to 0x3967f5 (0xd7bb8 bytes) 053000 1734017852.606439 mapwrite 0x3cd09e thru 0x3d9bcb (0xcb2e bytes) 055000 1734017859.024858 mapread 0x398996 thru 0x3a276c (0x9dd7 bytes) 059000 1734017871.353265 mapwrite 0x3cd9b0 thru 0x3cea9a (0x10eb bytes) 060000 1734017874.241072 mapread 0x20bf21 thru 0x20de06 (0x1ee6 bytes) 062000 1734017880.238784 trunc from 0x2ef2c7 to 0x2d9c23 (0x156a3 bytes) 063000 1734017882.900204 mapread 0x30e1de thru 0x319a3a (0xb85d bytes) 064000 1734017886.194814 mapread 0x23a0a6 thru 0x244616 (0xa571 bytes) 066000 1734017892.307720 read 0x31d8e4 thru 0x327b95 (0xa2b2 bytes) 067000 1734017895.107223 trunc from 0x2fc7fe to 0x3592f2 (0x5caf5 bytes) 068000 1734017898.180137 read 0x4b6a33 thru 0x4c306d (0xc63b bytes) 069000 1734017901.199128 read 0x1b1cd2 thru 0x1ba6c2 (0x89f1 bytes) 070000 1734017904.369497 write 0x4efa07 thru 0x4f8fe5 (0x95df bytes) 071000 1734017907.410007 read 0x43f6c7 thru 0x44f225 (0xfb5f bytes) 073000 1734017914.082884 mapread 0x08eb2c thru 0x0929f4 (0x3ec9 bytes) 074000 1734017917.132611 mapread 0x23567f thru 0x23a8df (0x5261 bytes) 076000 1734017923.503940 mapwrite 0x30967f thru 0x318cf0 (0xf672 bytes) 081000 1734017938.748743 mapread 0x10e5ff thru 0x11b4f3 (0xcef5 bytes) 082000 1734017941.836196 trunc from 0x207e2b to 0x324eb7 (0x11d08d bytes) 084000 1734017947.720205 mapread 0x0accbd thru 0x0b4f18 (0x825c bytes) 085000 1734017950.662692 mapwrite 0x4ee3b7 thru 0x4f5bc1 (0x780b bytes) truncating to largest ever: 0x56137d 086000 1734017953.597554 read 0x071937 thru 0x07d5e0 (0xbcaa bytes) 087000 1734017957.164248 write 0x42ae6d thru 0x433813 (0x89a7 bytes) 091000 1734017969.386446 mapwrite 0x3c2b2e thru 0x3ceac7 (0xbf9a bytes) 092000 1734017972.759242 read 0x3808c6 thru 0x388812 (0x7f4d bytes) 094000 1734017979.466001 mapwrite 0x38c14d thru 0x399a72 (0xd926 bytes) 095000 1734017982.359284 mapwrite 0x2dc289 thru 0x2e27f4 (0x656c bytes) 096000 1734017985.629226 read 0x23edd1 thru 0x243d48 (0x4f78 bytes) 097000 1734017988.902895 mapwrite 0x2eec7c thru 0x2f28e9 (0x3c6e bytes) 098000 1734017991.849267 read 0x259290 thru 0x259ad4 (0x845 bytes) 100000 1734017996.799106 mapread 0x093b26 thru 0x09e8f8 (0xadd3 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 2802841 (2816 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (306s) == sanity-benchmark test complete, duration 2160 sec ===== 10:39:57 (1734017997) === sanity-benchmark: start cleanup 10:39:58 (1734017998) === === sanity-benchmark: finish cleanup 10:39:59 (1734017999) ===