-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:54 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:59 (1734015839) === oleg457-client.virtnet: executing check_config_client /mnt/lustre oleg457-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg457-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a606000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a606000.idle_timeout=debug disable quota as required oleg457-server: oleg457-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:12 (1734015852) === == sanity-benchmark test dbench: dbench ================== 10:04:13 (1734015853) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7712] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg457-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg457-client.virtnet at Thu Dec 12 10:04:15 EST 2024 waiting for dbench pid 10298 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 3 11 5.33 MB/sec warmup 1 sec latency 919.564 ms 13 56 23.21 MB/sec warmup 2 sec latency 1901.826 ms 20 129 37.57 MB/sec warmup 3 sec latency 213.948 ms 20 182 36.69 MB/sec warmup 4 sec latency 168.629 ms 20 240 36.57 MB/sec warmup 5 sec latency 124.884 ms 20 298 36.54 MB/sec warmup 6 sec latency 137.956 ms 20 349 35.85 MB/sec warmup 7 sec latency 144.371 ms 20 399 35.27 MB/sec warmup 8 sec latency 161.388 ms 20 457 35.58 MB/sec warmup 9 sec latency 169.179 ms 20 528 36.29 MB/sec warmup 10 sec latency 155.371 ms 20 604 36.76 MB/sec warmup 11 sec latency 489.955 ms 20 665 35.18 MB/sec warmup 12 sec latency 428.738 ms 20 692 32.58 MB/sec warmup 13 sec latency 357.580 ms 20 725 30.38 MB/sec warmup 14 sec latency 394.672 ms 20 757 28.44 MB/sec warmup 15 sec latency 374.282 ms 20 793 26.77 MB/sec warmup 16 sec latency 400.312 ms 20 822 25.29 MB/sec warmup 17 sec latency 330.815 ms 20 865 23.99 MB/sec warmup 18 sec latency 410.381 ms 20 902 22.82 MB/sec warmup 19 sec latency 480.773 ms 20 933 21.76 MB/sec warmup 20 sec latency 464.729 ms 20 982 20.96 MB/sec warmup 21 sec latency 355.280 ms 20 1018 20.17 MB/sec warmup 22 sec latency 544.229 ms 20 1086 19.88 MB/sec warmup 23 sec latency 379.888 ms 20 1213 6.56 MB/sec execute 1 sec latency 133.027 ms 20 1286 9.47 MB/sec execute 2 sec latency 102.673 ms 20 1338 9.45 MB/sec execute 3 sec latency 502.052 ms 20 1429 15.06 MB/sec execute 4 sec latency 700.732 ms 20 1475 12.14 MB/sec execute 5 sec latency 425.334 ms 20 1519 10.21 MB/sec execute 6 sec latency 366.754 ms 20 1574 8.91 MB/sec execute 7 sec latency 323.901 ms 20 1634 7.92 MB/sec execute 8 sec latency 263.091 ms 20 1687 7.14 MB/sec execute 9 sec latency 334.589 ms 20 1745 6.51 MB/sec execute 10 sec latency 297.391 ms 20 1801 6.00 MB/sec execute 11 sec latency 421.581 ms 20 1856 5.59 MB/sec execute 12 sec latency 265.706 ms 20 1912 5.22 MB/sec execute 13 sec latency 269.081 ms 20 1965 4.96 MB/sec execute 14 sec latency 397.412 ms 20 2032 4.71 MB/sec execute 15 sec latency 421.656 ms 20 2093 4.55 MB/sec execute 16 sec latency 101.082 ms 20 2173 4.48 MB/sec execute 17 sec latency 84.657 ms 20 2226 4.51 MB/sec execute 18 sec latency 408.597 ms 20 2267 4.43 MB/sec execute 19 sec latency 533.733 ms 20 2307 4.39 MB/sec execute 20 sec latency 831.691 ms 20 2372 4.70 MB/sec execute 21 sec latency 1026.658 ms 20 2406 4.65 MB/sec execute 22 sec latency 394.203 ms 20 2452 4.59 MB/sec execute 23 sec latency 436.725 ms 20 2498 4.56 MB/sec execute 24 sec latency 461.366 ms 20 2573 5.25 MB/sec execute 25 sec latency 526.359 ms 20 2685 5.58 MB/sec execute 26 sec latency 603.478 ms 20 2807 6.75 MB/sec execute 27 sec latency 288.481 ms 20 2885 6.96 MB/sec execute 28 sec latency 565.183 ms 20 2991 7.29 MB/sec execute 29 sec latency 549.310 ms 20 3057 7.16 MB/sec execute 30 sec latency 623.034 ms 20 3138 7.22 MB/sec execute 31 sec latency 531.808 ms 20 3262 7.36 MB/sec execute 32 sec latency 343.341 ms 20 3366 7.94 MB/sec execute 33 sec latency 447.962 ms 20 3452 8.09 MB/sec execute 34 sec latency 380.830 ms 20 3542 8.41 MB/sec execute 35 sec latency 97.399 ms 20 3631 8.67 MB/sec execute 36 sec latency 95.823 ms 20 3697 8.63 MB/sec execute 37 sec latency 108.608 ms 20 3744 8.52 MB/sec execute 38 sec latency 153.345 ms 20 3796 8.51 MB/sec execute 39 sec latency 118.933 ms 20 3847 8.40 MB/sec execute 40 sec latency 125.881 ms 20 3888 8.23 MB/sec execute 41 sec latency 115.688 ms 20 3929 8.06 MB/sec execute 42 sec latency 106.314 ms 20 3968 7.92 MB/sec execute 43 sec latency 164.019 ms 20 4011 7.74 MB/sec execute 44 sec latency 112.224 ms 20 4060 7.57 MB/sec execute 45 sec latency 108.492 ms 20 4114 7.42 MB/sec execute 46 sec latency 349.087 ms 20 4157 7.29 MB/sec execute 47 sec latency 463.647 ms 20 4204 7.15 MB/sec execute 48 sec latency 506.232 ms 20 4247 7.04 MB/sec execute 49 sec latency 454.710 ms 20 4265 6.92 MB/sec execute 50 sec latency 810.595 ms 20 4297 6.81 MB/sec execute 51 sec latency 309.299 ms 20 4329 6.71 MB/sec execute 52 sec latency 325.608 ms 20 4364 6.61 MB/sec execute 53 sec latency 356.548 ms 20 4399 6.53 MB/sec execute 54 sec latency 454.310 ms 20 4446 6.45 MB/sec execute 55 sec latency 316.179 ms 20 4485 6.37 MB/sec execute 56 sec latency 398.533 ms 20 4528 6.32 MB/sec execute 57 sec latency 364.603 ms 20 4581 6.32 MB/sec execute 58 sec latency 460.032 ms 20 4635 6.33 MB/sec execute 59 sec latency 458.536 ms 20 4705 6.36 MB/sec execute 60 sec latency 423.226 ms 20 4780 6.37 MB/sec execute 61 sec latency 99.466 ms 20 4849 6.46 MB/sec execute 62 sec latency 131.551 ms 20 4913 6.57 MB/sec execute 63 sec latency 323.745 ms 20 4986 6.82 MB/sec execute 64 sec latency 307.857 ms 20 5037 6.81 MB/sec execute 65 sec latency 527.743 ms 20 5084 6.71 MB/sec execute 66 sec latency 381.565 ms 20 5129 6.63 MB/sec execute 67 sec latency 316.183 ms 20 5176 6.54 MB/sec execute 68 sec latency 254.800 ms 20 5222 6.46 MB/sec execute 69 sec latency 347.844 ms 20 5270 6.38 MB/sec execute 70 sec latency 282.464 ms 20 5315 6.30 MB/sec execute 71 sec latency 261.970 ms 20 5365 6.22 MB/sec execute 72 sec latency 230.762 ms 20 5407 6.15 MB/sec execute 73 sec latency 248.896 ms 20 5455 6.07 MB/sec execute 74 sec latency 291.919 ms 20 5506 6.01 MB/sec execute 75 sec latency 280.404 ms 20 5582 5.95 MB/sec execute 76 sec latency 258.027 ms 20 5639 5.89 MB/sec execute 77 sec latency 101.163 ms 20 5728 5.87 MB/sec execute 78 sec latency 74.214 ms 20 5788 5.87 MB/sec execute 79 sec latency 377.840 ms 20 5845 5.84 MB/sec execute 80 sec latency 623.378 ms 20 5920 5.91 MB/sec execute 81 sec latency 406.375 ms 20 5962 5.90 MB/sec execute 82 sec latency 492.619 ms 20 6003 5.87 MB/sec execute 83 sec latency 465.233 ms 20 6057 5.86 MB/sec execute 84 sec latency 505.734 ms 20 6135 6.00 MB/sec execute 85 sec latency 404.554 ms 20 6238 6.16 MB/sec execute 86 sec latency 306.364 ms 20 6358 6.47 MB/sec execute 87 sec latency 339.648 ms 20 6461 6.58 MB/sec execute 88 sec latency 436.955 ms 20 6552 6.66 MB/sec execute 89 sec latency 441.538 ms 20 6617 6.65 MB/sec execute 90 sec latency 517.485 ms 20 6724 6.67 MB/sec execute 91 sec latency 419.766 ms 20 6849 6.81 MB/sec execute 92 sec latency 308.735 ms 20 6956 6.96 MB/sec execute 93 sec latency 266.513 ms 20 7051 7.11 MB/sec execute 94 sec latency 281.310 ms 20 7161 7.29 MB/sec execute 95 sec latency 71.226 ms 20 7236 7.28 MB/sec execute 96 sec latency 79.150 ms 20 7293 7.28 MB/sec execute 97 sec latency 115.693 ms 20 7345 7.29 MB/sec execute 98 sec latency 157.202 ms 20 7393 7.25 MB/sec execute 99 sec latency 103.425 ms 20 7446 7.20 MB/sec execute 100 sec latency 88.849 ms 20 7494 7.15 MB/sec execute 101 sec latency 93.934 ms 20 7535 7.08 MB/sec execute 102 sec latency 106.959 ms 20 7569 7.02 MB/sec execute 103 sec latency 127.418 ms 20 7616 6.95 MB/sec execute 104 sec latency 130.317 ms 20 7668 6.89 MB/sec execute 105 sec latency 494.738 ms 20 7733 6.84 MB/sec execute 106 sec latency 364.185 ms 20 7771 6.79 MB/sec execute 107 sec latency 590.467 ms 20 7806 6.74 MB/sec execute 108 sec latency 411.873 ms 20 7843 6.69 MB/sec execute 109 sec latency 251.711 ms 20 7868 6.64 MB/sec execute 110 sec latency 511.468 ms 20 7915 6.60 MB/sec execute 111 sec latency 238.288 ms 20 7949 6.56 MB/sec execute 112 sec latency 289.339 ms 20 7997 6.52 MB/sec execute 113 sec latency 304.757 ms 20 8039 6.48 MB/sec execute 114 sec latency 270.803 ms 20 8092 6.47 MB/sec execute 115 sec latency 281.758 ms 20 8144 6.47 MB/sec execute 116 sec latency 415.023 ms 20 8227 6.52 MB/sec execute 117 sec latency 319.591 ms 20 8301 6.50 MB/sec execute 118 sec latency 85.612 ms 20 8388 6.57 MB/sec execute 119 sec latency 105.937 ms 20 cleanup 120 sec 20 cleanup 121 sec 19 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 25073 45.813 227.567 Close 18494 12.204 84.337 Rename 1116 69.462 239.126 Unlink 5047 15.317 81.501 Qpathinfo 23282 11.710 149.902 Qfileinfo 3978 0.319 52.336 Qfsinfo 4192 0.233 33.807 Sfileinfo 2206 45.161 174.434 Find 8816 3.828 167.451 WriteX 12362 5.225 141.149 ReadX 39890 0.031 9.791 LockX 80 13.020 25.667 UnlockX 80 12.575 37.174 Flush 1721 230.051 1026.652 Throughput 6.57008 MB/sec 20 clients 20 procs max_latency=1026.658 ms stopping dbench on /mnt/lustre/d0.oleg457-client.virtnet at Thu Dec 12 10:06:42 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg457-client.virtnet /mnt/lustre/d0.oleg457-client.virtnet /mnt/lustre/d0.oleg457-client.virtnet removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg457-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:50 (1734016010) min OST has 3575808kB available, using 5363712kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7712] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5238] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg457-clien 5238M 76293 59 48409 42 113675 29 591.5 117 Latency 196ms 120ms 123ms 459ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg457-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 225 17 6548 29 273 11 291 17 722 12 309 12 Latency 17098us 17869us 64475us 18236us 8069us 27951us 1.97,1.97,oleg457-client.virtnet,1,1734004876,5238M,,,,76293,59,48409,42,,,113675,29,591.5,117,10,,,,,225,17,6548,29,273,11,291,17,722,12,309,12,,196ms,120ms,,123ms,459ms,17098us,17869us,64475us,18236us,8069us,27951us debug=0x33f0484 PASS bonnie (419s) == sanity-benchmark test iozone: iozone ================== 10:13:48 (1734016428) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7712] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:14:09 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 101112 105433 104450 151631 63359 78885 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:20:51 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 23403 24345 93803 97383 95950 31842 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1271s) == sanity-benchmark test fsx: fsx ======================== 10:34:59 (1734017699) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 8483 -P /tmp -l 5641728 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 8483 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x4bd034 truncating to largest ever: 0x53adc4 truncating to largest ever: 0x552c4a 001000 1734017702.886610 write 0x3e054f thru 0x3edb45 (0xd5f7 bytes) 002000 1734017706.261700 mapread 0x3cdfe0 thru 0x3dbc88 (0xdca9 bytes) truncating to largest ever: 0x557bc9 003000 1734017709.094430 write 0x43d327 thru 0x4453bc (0x8096 bytes) truncating to largest ever: 0x559223 004000 1734017712.433122 write 0x2a33d1 thru 0x2abbf7 (0x8827 bytes) 006000 1734017718.954862 mapwrite 0x3e2f43 thru 0x3e42c9 (0x1387 bytes) 007000 1734017722.465336 write 0x4f96ca thru 0x4fe17b (0x4ab2 bytes) truncating to largest ever: 0x55c4df 010000 1734017731.597784 write 0x51c21c thru 0x52267b (0x6460 bytes) truncating to largest ever: 0x55f9e2 013000 1734017741.474280 mapwrite 0x4e3578 thru 0x4e6e13 (0x389c bytes) truncating to largest ever: 0x5603a4 truncating to largest ever: 0x561158 018000 1734017757.604644 mapwrite 0x0044ad thru 0x00f999 (0xb4ed bytes) 020000 1734017764.574281 read 0x3fef20 thru 0x4037bd (0x489e bytes) 023000 1734017774.463835 trunc from 0x19916b to 0x3c5c92 (0x22cb28 bytes) 024000 1734017777.529577 read 0x085a8c thru 0x0917c7 (0xbd3c bytes) 025000 1734017781.114173 trunc from 0x257d59 to 0x3c024f (0x1684f7 bytes) 027000 1734017787.853249 read 0x01f9c2 thru 0x01fccc (0x30b bytes) 028000 1734017791.881605 write 0x54fab3 thru 0x550953 (0xea1 bytes) 029000 1734017795.193343 trunc from 0x552bf6 to 0x085e5f (0x4ccd96 bytes) 031000 1734017801.529652 trunc from 0x3e1053 to 0x0f93ec (0x2e7c66 bytes) 034000 1734017811.349029 write 0x19b11f thru 0x1a4136 (0x9018 bytes) 038000 1734017823.546443 mapread 0x3414c6 thru 0x34a57f (0x90ba bytes) 041000 1734017832.632753 trunc from 0x5130cc to 0x46a761 (0xa896a bytes) 044000 1734017842.521901 trunc from 0x0ffc4e to 0x3f9804 (0x2f9bb7 bytes) 046000 1734017848.689264 mapwrite 0x1cb5c6 thru 0x1d89f4 (0xd42f bytes) 048000 1734017854.880363 trunc from 0x52fda1 to 0x3b1a51 (0x17e34f bytes) skipping zero size read 053000 1734017871.253443 trunc from 0x1bd837 to 0x38f372 (0x1d1b3c bytes) 057000 1734017884.067872 mapwrite 0x3ed725 thru 0x3f254e (0x4e2a bytes) 063000 1734017904.382539 trunc from 0x54d075 to 0x4bc1c1 (0x90eb3 bytes) 064000 1734017907.562033 trunc from 0x37c18c to 0x3cfddf (0x53c54 bytes) 066000 1734017914.214734 trunc from 0x35b9d2 to 0x360d28 (0x5357 bytes) 069000 1734017923.590177 write 0x5073ad thru 0x513c34 (0xc888 bytes) truncating to largest ever: 0x561226 070000 1734017926.857322 write 0x256722 thru 0x266660 (0xff3f bytes) 072000 1734017933.215106 mapread 0x17aa39 thru 0x18653a (0xbb02 bytes) 077000 1734017947.884718 mapwrite 0x48444c thru 0x48d2c9 (0x8e7e bytes) 078000 1734017950.860644 write 0x488e50 thru 0x48fea8 (0x7059 bytes) 079000 1734017953.631185 mapwrite 0x203705 thru 0x20e289 (0xab85 bytes) 080000 1734017957.123869 mapread 0x3ac984 thru 0x3b96b5 (0xcd32 bytes) 081000 1734017960.569137 mapwrite 0x2d9c37 thru 0x2e1c2e (0x7ff8 bytes) 084000 1734017970.534842 write 0x02f894 thru 0x03881f (0x8f8c bytes) 088000 1734017983.828653 read 0x270410 thru 0x272a68 (0x2659 bytes) 090000 1734017989.862753 trunc from 0x3cd75b to 0x3c0425 (0xd335 bytes) 091000 1734017992.684494 read 0x087ef6 thru 0x094343 (0xc44e bytes) 092000 1734017995.576591 trunc from 0x4d70ce to 0x2737cc (0x263901 bytes) 095000 1734018003.889321 mapread 0x06eb7d thru 0x07c10b (0xd58f bytes) 097000 1734018008.746936 mapread 0x1aa3e9 thru 0x1b3eef (0x9b07 bytes) 098000 1734018011.048877 write 0x520244 thru 0x522f99 (0x2d56 bytes) 100000 1734018016.351606 read 0x3a83d7 thru 0x3a9939 (0x1563 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4924433 (4864 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (318s) == sanity-benchmark test complete, duration 2182 sec ===== 10:40:17 (1734018017) === sanity-benchmark: start cleanup 10:40:17 (1734018017) === === sanity-benchmark: finish cleanup 10:40:18 (1734018018) ===