-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:51 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:56 (1734015836) === oleg241-client.virtnet: executing check_config_client /mnt/lustre oleg241-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg241-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012b52e000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012b52e000.idle_timeout=debug disable quota as required oleg241-server: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:03 (1734015843) === == sanity-benchmark test dbench: dbench ================== 10:04:04 (1734015844) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6964] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg241-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg241-client.virtnet at Thu Dec 12 10:04:05 EST 2024 waiting for dbench pid 9430 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 139 121.35 MB/sec warmup 1 sec latency 108.266 ms 20 282 105.54 MB/sec warmup 2 sec latency 77.762 ms 20 423 99.58 MB/sec warmup 3 sec latency 93.372 ms 20 599 102.52 MB/sec warmup 4 sec latency 104.409 ms 20 671 84.65 MB/sec warmup 5 sec latency 404.298 ms 20 720 70.95 MB/sec warmup 6 sec latency 198.030 ms 20 770 61.02 MB/sec warmup 7 sec latency 178.359 ms 20 809 53.70 MB/sec warmup 8 sec latency 209.890 ms 20 874 48.11 MB/sec warmup 9 sec latency 195.719 ms 20 915 43.51 MB/sec warmup 10 sec latency 205.693 ms 20 961 39.66 MB/sec warmup 11 sec latency 300.305 ms 20 1020 37.21 MB/sec warmup 12 sec latency 252.357 ms 20 1104 35.30 MB/sec warmup 13 sec latency 112.324 ms 20 1172 32.87 MB/sec warmup 14 sec latency 96.200 ms 20 1229 30.76 MB/sec warmup 15 sec latency 103.179 ms 20 1318 30.11 MB/sec warmup 16 sec latency 89.129 ms 20 1428 30.59 MB/sec warmup 17 sec latency 174.127 ms 20 1491 28.93 MB/sec warmup 18 sec latency 188.662 ms 20 1553 27.47 MB/sec warmup 19 sec latency 222.952 ms 20 1619 26.15 MB/sec warmup 20 sec latency 218.987 ms 20 1667 24.94 MB/sec warmup 21 sec latency 346.740 ms 20 1725 23.85 MB/sec warmup 22 sec latency 230.136 ms 20 1789 22.86 MB/sec warmup 23 sec latency 91.017 ms 20 1895 0.70 MB/sec execute 1 sec latency 178.842 ms 20 1969 1.28 MB/sec execute 2 sec latency 232.209 ms 20 2036 1.32 MB/sec execute 3 sec latency 88.114 ms 20 2096 1.48 MB/sec execute 4 sec latency 87.971 ms 20 2151 1.39 MB/sec execute 5 sec latency 131.679 ms 20 2218 2.33 MB/sec execute 6 sec latency 258.147 ms 20 2291 2.91 MB/sec execute 7 sec latency 260.363 ms 20 2374 3.97 MB/sec execute 8 sec latency 309.815 ms 20 2411 3.84 MB/sec execute 9 sec latency 414.762 ms 20 2463 3.99 MB/sec execute 10 sec latency 301.007 ms 20 2503 4.31 MB/sec execute 11 sec latency 1008.149 ms 20 2588 5.11 MB/sec execute 12 sec latency 1079.595 ms 20 2669 6.09 MB/sec execute 13 sec latency 422.537 ms 20 2781 7.47 MB/sec execute 14 sec latency 321.143 ms 20 2890 8.55 MB/sec execute 15 sec latency 435.859 ms 20 2977 8.68 MB/sec execute 16 sec latency 474.148 ms 20 3067 8.85 MB/sec execute 17 sec latency 363.650 ms 20 3176 8.90 MB/sec execute 18 sec latency 363.294 ms 20 3290 9.40 MB/sec execute 19 sec latency 311.731 ms 20 3390 9.80 MB/sec execute 20 sec latency 265.422 ms 20 3473 9.98 MB/sec execute 21 sec latency 213.951 ms 20 3574 10.76 MB/sec execute 22 sec latency 98.646 ms 20 3656 10.83 MB/sec execute 23 sec latency 95.207 ms 20 3716 10.59 MB/sec execute 24 sec latency 104.650 ms 20 3755 10.30 MB/sec execute 25 sec latency 170.208 ms 20 3795 10.21 MB/sec execute 26 sec latency 216.531 ms 20 3833 9.95 MB/sec execute 27 sec latency 172.307 ms 20 3869 9.64 MB/sec execute 28 sec latency 121.224 ms 20 3900 9.33 MB/sec execute 29 sec latency 111.534 ms 20 3925 9.08 MB/sec execute 30 sec latency 214.058 ms 20 3954 8.82 MB/sec execute 31 sec latency 230.946 ms 20 3982 8.56 MB/sec execute 32 sec latency 136.336 ms 20 4012 8.30 MB/sec execute 33 sec latency 143.127 ms 20 4049 8.06 MB/sec execute 34 sec latency 109.133 ms 20 4082 7.84 MB/sec execute 35 sec latency 351.604 ms 20 4113 7.63 MB/sec execute 36 sec latency 237.040 ms 20 4142 7.44 MB/sec execute 37 sec latency 470.721 ms 20 4176 7.26 MB/sec execute 38 sec latency 693.827 ms 20 4223 7.11 MB/sec execute 39 sec latency 617.328 ms 20 4253 6.96 MB/sec execute 40 sec latency 429.574 ms 20 4275 6.82 MB/sec execute 41 sec latency 513.570 ms 20 4300 6.69 MB/sec execute 42 sec latency 547.959 ms 20 4324 6.56 MB/sec execute 43 sec latency 483.181 ms 20 4352 6.44 MB/sec execute 44 sec latency 368.524 ms 20 4386 6.33 MB/sec execute 45 sec latency 407.649 ms 20 4419 6.23 MB/sec execute 46 sec latency 416.902 ms 20 4456 6.14 MB/sec execute 47 sec latency 415.948 ms 20 4491 6.07 MB/sec execute 48 sec latency 374.586 ms 20 4524 5.99 MB/sec execute 49 sec latency 425.532 ms 20 4561 5.96 MB/sec execute 50 sec latency 352.990 ms 20 4597 5.88 MB/sec execute 51 sec latency 305.654 ms 20 4648 5.93 MB/sec execute 52 sec latency 396.101 ms 20 4716 6.04 MB/sec execute 53 sec latency 114.398 ms 20 4762 5.95 MB/sec execute 54 sec latency 145.935 ms 20 4807 5.87 MB/sec execute 55 sec latency 141.849 ms 20 4871 6.02 MB/sec execute 56 sec latency 377.898 ms 20 4936 6.18 MB/sec execute 57 sec latency 125.206 ms 20 5006 6.47 MB/sec execute 58 sec latency 268.070 ms 20 5047 6.37 MB/sec execute 59 sec latency 237.778 ms 20 5087 6.27 MB/sec execute 60 sec latency 247.590 ms 20 5130 6.18 MB/sec execute 61 sec latency 224.487 ms 20 5166 6.09 MB/sec execute 62 sec latency 259.557 ms 20 5199 6.01 MB/sec execute 63 sec latency 244.437 ms 20 5239 5.92 MB/sec execute 64 sec latency 244.350 ms 20 5284 5.84 MB/sec execute 65 sec latency 215.571 ms 20 5316 5.76 MB/sec execute 66 sec latency 149.485 ms 20 5351 5.69 MB/sec execute 67 sec latency 196.694 ms 20 5391 5.61 MB/sec execute 68 sec latency 135.695 ms 20 5418 5.54 MB/sec execute 69 sec latency 237.331 ms 20 5457 5.47 MB/sec execute 70 sec latency 313.654 ms 20 5501 5.40 MB/sec execute 71 sec latency 258.113 ms 20 5554 5.35 MB/sec execute 72 sec latency 223.038 ms 20 5604 5.29 MB/sec execute 73 sec latency 125.305 ms 20 5650 5.25 MB/sec execute 74 sec latency 150.970 ms 20 5697 5.21 MB/sec execute 75 sec latency 265.200 ms 20 5746 5.16 MB/sec execute 76 sec latency 273.501 ms 20 5789 5.13 MB/sec execute 77 sec latency 322.267 ms 20 5838 5.14 MB/sec execute 78 sec latency 292.544 ms 20 5902 5.18 MB/sec execute 79 sec latency 320.795 ms 20 5959 5.20 MB/sec execute 80 sec latency 397.553 ms 20 5999 5.20 MB/sec execute 81 sec latency 592.750 ms 20 6051 5.24 MB/sec execute 82 sec latency 438.190 ms 20 6118 5.30 MB/sec execute 83 sec latency 464.523 ms 20 6184 5.34 MB/sec execute 84 sec latency 389.343 ms 20 6292 5.59 MB/sec execute 85 sec latency 296.148 ms 20 6398 5.75 MB/sec execute 86 sec latency 325.919 ms 20 6473 5.93 MB/sec execute 87 sec latency 426.771 ms 20 6576 6.01 MB/sec execute 88 sec latency 365.309 ms 20 6646 6.03 MB/sec execute 89 sec latency 366.580 ms 20 6742 6.06 MB/sec execute 90 sec latency 466.391 ms 20 6870 6.20 MB/sec execute 91 sec latency 269.457 ms 20 6939 6.25 MB/sec execute 92 sec latency 380.918 ms 20 7038 6.47 MB/sec execute 93 sec latency 271.345 ms 20 7097 6.48 MB/sec execute 94 sec latency 101.244 ms 20 7188 6.63 MB/sec execute 95 sec latency 106.198 ms 20 7241 6.59 MB/sec execute 96 sec latency 106.919 ms 20 7296 6.60 MB/sec execute 97 sec latency 147.455 ms 20 7347 6.59 MB/sec execute 98 sec latency 114.904 ms 20 7397 6.58 MB/sec execute 99 sec latency 111.236 ms 20 7438 6.52 MB/sec execute 100 sec latency 101.933 ms 20 7488 6.48 MB/sec execute 101 sec latency 120.025 ms 20 7529 6.43 MB/sec execute 102 sec latency 167.329 ms 20 7566 6.37 MB/sec execute 103 sec latency 385.336 ms 20 7609 6.31 MB/sec execute 104 sec latency 237.908 ms 20 7650 6.26 MB/sec execute 105 sec latency 267.970 ms 20 7706 6.20 MB/sec execute 106 sec latency 260.452 ms 20 7763 6.16 MB/sec execute 107 sec latency 268.166 ms 20 7805 6.12 MB/sec execute 108 sec latency 498.225 ms 20 7842 6.08 MB/sec execute 109 sec latency 315.655 ms 20 7878 6.04 MB/sec execute 110 sec latency 255.823 ms 20 7928 6.01 MB/sec execute 111 sec latency 264.634 ms 20 7970 5.99 MB/sec execute 112 sec latency 259.419 ms 20 8021 5.95 MB/sec execute 113 sec latency 313.771 ms 20 8073 5.95 MB/sec execute 114 sec latency 238.536 ms 20 8116 5.92 MB/sec execute 115 sec latency 339.495 ms 20 8168 5.94 MB/sec execute 116 sec latency 314.310 ms 20 8223 5.95 MB/sec execute 117 sec latency 387.842 ms 20 8296 5.98 MB/sec execute 118 sec latency 148.088 ms 20 8353 5.96 MB/sec execute 119 sec latency 263.543 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 22080 55.085 230.933 Close 16238 13.158 98.852 Rename 1001 79.903 210.133 Unlink 4786 18.406 92.449 Qpathinfo 20745 13.297 185.084 Qfileinfo 3484 0.252 33.764 Qfsinfo 4013 0.190 19.780 Sfileinfo 1932 47.546 132.649 Find 8062 3.192 140.634 WriteX 11397 4.090 71.492 ReadX 35725 0.029 6.292 LockX 80 20.060 44.682 UnlockX 80 19.227 40.875 Flush 1657 215.841 1079.587 Throughput 5.96399 MB/sec 20 clients 20 procs max_latency=1079.595 ms stopping dbench on /mnt/lustre/d0.oleg241-client.virtnet at Thu Dec 12 10:06:32 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg241-client.virtnet /mnt/lustre/d0.oleg241-client.virtnet /mnt/lustre/d0.oleg241-client.virtnet removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg241-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:40 (1734016000) min OST has 3510272kB available, using 5265408kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6964] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5142] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg241-clien 5142M 79658 60 56281 47 115687 30 444.0 99 Latency 40022us 158ms 82638us 416ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg241-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 232 17 6679 29 372 13 329 17 910 12 503 13 Latency 23970us 22071us 62268us 18011us 3996us 8961us 1.97,1.97,oleg241-client.virtnet,1,1734006071,5142M,,,,79658,60,56281,47,,,115687,30,444.0,99,10,,,,,232,17,6679,29,372,13,329,17,910,12,503,13,,40022us,158ms,,82638us,416ms,23970us,22071us,62268us,18011us,3996us,8961us debug=0x33f0484 PASS bonnie (369s) == sanity-benchmark test iozone: iozone ================== 10:12:49 (1734016369) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6964] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:06 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 120711 100266 100983 130417 77049 81259 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:29 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 26719 27367 112125 108458 96946 34336 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1164s) == sanity-benchmark test fsx: fsx ======================== 10:32:13 (1734017533) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 15312 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 15312 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x53102a truncating to largest ever: 0x53e830 truncating to largest ever: 0x54a8ce truncating to largest ever: 0x55074b truncating to largest ever: 0x5576d8 003000 1734017542.334742 read 0x106021 thru 0x1080bd (0x209d bytes) truncating to largest ever: 0x55b187 truncating to largest ever: 0x561bb6 006000 1734017551.220090 write 0x3411dd thru 0x350017 (0xee3b bytes) 007000 1734017554.495662 mapwrite 0x35b9b8 thru 0x36adee (0xf437 bytes) 008000 1734017557.488566 write 0x06ae7c thru 0x075e18 (0xaf9d bytes) 013000 1734017571.822854 trunc from 0x3a0db7 to 0x070fec (0x32fdca bytes) 014000 1734017574.558210 write 0x42851d thru 0x4350f4 (0xcbd8 bytes) 018000 1734017585.533426 mapwrite 0x0f2a89 thru 0x0f99fc (0x6f74 bytes) 020000 1734017591.020750 mapwrite 0x3ded29 thru 0x3df72e (0xa06 bytes) 024000 1734017602.948203 read 0x0c23d7 thru 0x0c3945 (0x156f bytes) 029000 1734017617.411121 read 0x0391b5 thru 0x03af33 (0x1d7f bytes) 031000 1734017623.048814 read 0x22ebe3 thru 0x23c15a (0xd578 bytes) 032000 1734017625.919259 read 0x12dbba thru 0x13a8b0 (0xccf7 bytes) 033000 1734017628.947256 write 0x04c175 thru 0x04f593 (0x341f bytes) 035000 1734017635.003176 mapread 0x28ce35 thru 0x295372 (0x853e bytes) 038000 1734017644.109919 trunc from 0x246ade to 0x1b34d0 (0x9360d bytes) 042000 1734017656.306744 mapread 0x301986 thru 0x309a86 (0x8101 bytes) 045000 1734017665.109720 write 0x33e2e1 thru 0x3453ea (0x710a bytes) 046000 1734017668.126215 trunc from 0x3c7c59 to 0x2cc9a0 (0xfb2b8 bytes) 050000 1734017680.063078 mapwrite 0x1beaec thru 0x1ce833 (0xfd48 bytes) 052000 1734017685.345855 mapwrite 0x03a7d0 thru 0x049933 (0xf164 bytes) 057000 1734017700.432719 mapread 0x3bef4d thru 0x3c5e1f (0x6ed3 bytes) 059000 1734017706.339925 write 0x36887c thru 0x36e209 (0x598e bytes) 063000 1734017718.066537 mapread 0x2262c9 thru 0x23010f (0x9e47 bytes) 065000 1734017723.962089 trunc from 0x40d6af to 0x15d678 (0x2b0036 bytes) 066000 1734017726.855386 mapread 0x37a48b thru 0x3847d0 (0xa346 bytes) 068000 1734017732.627111 read 0x051e88 thru 0x05fee0 (0xe059 bytes) 072000 1734017744.853299 write 0x12e849 thru 0x12f015 (0x7cd bytes) 076000 1734017756.042365 mapwrite 0x0fe4b0 thru 0x10713f (0x8c90 bytes) 078000 1734017762.309636 read 0x052dc7 thru 0x05629e (0x34d8 bytes) 079000 1734017765.208377 trunc from 0x0e2e3c to 0x3d4185 (0x2f134a bytes) 081000 1734017771.568567 write 0x46e79b thru 0x472ce7 (0x454d bytes) 083000 1734017777.238590 mapread 0x32a33f thru 0x32c83a (0x24fc bytes) 084000 1734017779.982321 trunc from 0x318e6a to 0x46afea (0x152181 bytes) 087000 1734017788.879647 read 0x02a1da thru 0x02dc23 (0x3a4a bytes) 089000 1734017794.836758 mapwrite 0x03d965 thru 0x0446ca (0x6d66 bytes) 091000 1734017800.273659 mapread 0x1333c1 thru 0x13618b (0x2dcb bytes) 092000 1734017803.016493 mapwrite 0x181d6c thru 0x18bedd (0xa172 bytes) 094000 1734017809.280831 mapread 0x3188ce thru 0x31e4e2 (0x5c15 bytes) 097000 1734017818.823161 write 0x33e28f thru 0x3473cf (0x9141 bytes) 098000 1734017822.566545 trunc from 0x538709 to 0x11e9a1 (0x419d67 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 1106900 (1152 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (300s) == sanity-benchmark test complete, duration 2002 sec ===== 10:37:13 (1734017833) === sanity-benchmark: start cleanup 10:37:13 (1734017833) === === sanity-benchmark: finish cleanup 10:37:14 (1734017834) ===