-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:56 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:02 (1734015842) === oleg410-client.virtnet: executing check_config_client /mnt/lustre oleg410-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg410-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b581c000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b581c000.idle_timeout=debug disable quota as required oleg410-server: oleg410-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:17 (1734015857) === == sanity-benchmark test dbench: dbench ================== 10:04:18 (1734015858) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7718] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg410-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg410-client.virtnet at Thu Dec 12 10:04:20 EST 2024 waiting for dbench pid 10306 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 11 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 1 6 0.98 MB/sec warmup 1 sec latency 919.893 ms 10 36 13.34 MB/sec warmup 2 sec latency 288.109 ms 20 107 32.58 MB/sec warmup 3 sec latency 267.001 ms 20 144 30.98 MB/sec warmup 4 sec latency 293.767 ms 20 191 30.59 MB/sec warmup 5 sec latency 170.351 ms 20 237 30.21 MB/sec warmup 6 sec latency 155.078 ms 20 285 30.35 MB/sec warmup 7 sec latency 169.928 ms 20 329 29.86 MB/sec warmup 8 sec latency 161.136 ms 20 374 29.60 MB/sec warmup 9 sec latency 246.935 ms 20 425 30.00 MB/sec warmup 10 sec latency 159.477 ms 20 471 30.00 MB/sec warmup 11 sec latency 182.100 ms 20 524 30.05 MB/sec warmup 12 sec latency 192.545 ms 20 587 30.72 MB/sec warmup 13 sec latency 521.740 ms 20 655 30.12 MB/sec warmup 14 sec latency 856.373 ms 20 680 28.22 MB/sec warmup 15 sec latency 521.407 ms 20 715 26.53 MB/sec warmup 16 sec latency 251.996 ms 20 741 25.05 MB/sec warmup 17 sec latency 342.048 ms 20 782 23.74 MB/sec warmup 18 sec latency 479.066 ms 20 808 22.59 MB/sec warmup 19 sec latency 490.354 ms 20 865 21.58 MB/sec warmup 20 sec latency 302.656 ms 20 900 20.64 MB/sec warmup 21 sec latency 316.833 ms 20 922 19.77 MB/sec warmup 22 sec latency 574.263 ms 20 968 19.04 MB/sec warmup 23 sec latency 585.298 ms 20 1062 16.00 MB/sec execute 1 sec latency 457.510 ms 20 1119 8.59 MB/sec execute 2 sec latency 100.410 ms 20 1163 6.01 MB/sec execute 3 sec latency 136.434 ms 20 1209 5.42 MB/sec execute 4 sec latency 144.160 ms 20 1249 5.05 MB/sec execute 5 sec latency 187.930 ms 20 1298 5.74 MB/sec execute 6 sec latency 191.949 ms 20 1401 10.73 MB/sec execute 7 sec latency 301.713 ms 20 1447 9.78 MB/sec execute 8 sec latency 148.424 ms 20 1491 8.75 MB/sec execute 9 sec latency 455.084 ms 20 1527 7.92 MB/sec execute 10 sec latency 598.810 ms 20 1571 7.29 MB/sec execute 11 sec latency 422.840 ms 20 1618 6.76 MB/sec execute 12 sec latency 495.913 ms 20 1655 6.27 MB/sec execute 13 sec latency 454.807 ms 20 1689 5.89 MB/sec execute 14 sec latency 446.727 ms 20 1730 5.52 MB/sec execute 15 sec latency 134.255 ms 20 1789 5.23 MB/sec execute 16 sec latency 358.004 ms 20 1841 4.99 MB/sec execute 17 sec latency 241.566 ms 20 1882 4.74 MB/sec execute 18 sec latency 337.463 ms 20 1910 4.51 MB/sec execute 19 sec latency 493.529 ms 20 1922 4.31 MB/sec execute 20 sec latency 1429.599 ms 20 1992 4.18 MB/sec execute 21 sec latency 1440.735 ms 20 2037 4.04 MB/sec execute 22 sec latency 142.382 ms 20 2082 3.93 MB/sec execute 23 sec latency 131.143 ms 20 2144 3.90 MB/sec execute 24 sec latency 203.164 ms 20 2197 3.86 MB/sec execute 25 sec latency 392.054 ms 20 2234 3.80 MB/sec execute 26 sec latency 351.399 ms 20 2297 3.91 MB/sec execute 27 sec latency 428.194 ms 20 2371 4.20 MB/sec execute 28 sec latency 373.641 ms 20 2409 4.14 MB/sec execute 29 sec latency 500.118 ms 20 2453 4.10 MB/sec execute 30 sec latency 329.880 ms 20 2507 4.37 MB/sec execute 31 sec latency 523.789 ms 20 2565 4.61 MB/sec execute 32 sec latency 543.351 ms 20 2632 4.70 MB/sec execute 33 sec latency 439.038 ms 20 2722 5.07 MB/sec execute 34 sec latency 428.071 ms 20 2855 5.93 MB/sec execute 35 sec latency 437.358 ms 20 2951 6.12 MB/sec execute 36 sec latency 456.456 ms 20 3028 6.34 MB/sec execute 37 sec latency 545.386 ms 20 3082 6.24 MB/sec execute 38 sec latency 566.625 ms 20 3160 6.25 MB/sec execute 39 sec latency 464.950 ms 20 3284 6.56 MB/sec execute 40 sec latency 543.323 ms 20 3354 6.69 MB/sec execute 41 sec latency 452.522 ms 20 3434 6.78 MB/sec execute 42 sec latency 333.649 ms 20 3524 7.15 MB/sec execute 43 sec latency 287.573 ms 20 3613 7.53 MB/sec execute 44 sec latency 130.506 ms 20 3666 7.44 MB/sec execute 45 sec latency 140.000 ms 20 3711 7.34 MB/sec execute 46 sec latency 148.023 ms 20 3768 7.33 MB/sec execute 47 sec latency 98.870 ms 20 3818 7.33 MB/sec execute 48 sec latency 137.719 ms 20 3855 7.23 MB/sec execute 49 sec latency 138.910 ms 20 3894 7.10 MB/sec execute 50 sec latency 123.941 ms 20 3932 7.00 MB/sec execute 51 sec latency 118.953 ms 20 3973 6.90 MB/sec execute 52 sec latency 118.605 ms 20 4013 6.77 MB/sec execute 53 sec latency 125.020 ms 20 4053 6.65 MB/sec execute 54 sec latency 135.238 ms 20 4088 6.54 MB/sec execute 55 sec latency 453.309 ms 20 4125 6.43 MB/sec execute 56 sec latency 472.337 ms 20 4159 6.33 MB/sec execute 57 sec latency 574.908 ms 20 4210 6.24 MB/sec execute 58 sec latency 452.713 ms 20 4247 6.16 MB/sec execute 59 sec latency 560.167 ms 20 4274 6.07 MB/sec execute 60 sec latency 422.724 ms 20 4309 6.01 MB/sec execute 61 sec latency 319.707 ms 20 4340 5.93 MB/sec execute 62 sec latency 311.994 ms 20 4378 5.86 MB/sec execute 63 sec latency 377.534 ms 20 4404 5.80 MB/sec execute 64 sec latency 401.323 ms 20 4437 5.73 MB/sec execute 65 sec latency 410.963 ms 20 4479 5.68 MB/sec execute 66 sec latency 371.925 ms 20 4505 5.64 MB/sec execute 67 sec latency 472.279 ms 20 4545 5.61 MB/sec execute 68 sec latency 487.890 ms 20 4593 5.57 MB/sec execute 69 sec latency 374.045 ms 20 4637 5.57 MB/sec execute 70 sec latency 429.452 ms 20 4702 5.66 MB/sec execute 71 sec latency 231.144 ms 20 4768 5.68 MB/sec execute 72 sec latency 109.823 ms 20 4822 5.71 MB/sec execute 73 sec latency 150.442 ms 20 4877 5.71 MB/sec execute 74 sec latency 349.907 ms 20 4927 5.73 MB/sec execute 75 sec latency 365.673 ms 20 5006 6.02 MB/sec execute 76 sec latency 372.640 ms 20 5054 5.99 MB/sec execute 77 sec latency 262.955 ms 20 5090 5.92 MB/sec execute 78 sec latency 298.716 ms 20 5128 5.85 MB/sec execute 79 sec latency 366.676 ms 20 5179 5.79 MB/sec execute 80 sec latency 435.986 ms 20 5211 5.72 MB/sec execute 81 sec latency 232.951 ms 20 5248 5.66 MB/sec execute 82 sec latency 382.505 ms 20 5293 5.60 MB/sec execute 83 sec latency 315.837 ms 20 5335 5.54 MB/sec execute 84 sec latency 261.178 ms 20 5386 5.49 MB/sec execute 85 sec latency 248.547 ms 20 5431 5.43 MB/sec execute 86 sec latency 238.598 ms 20 5482 5.38 MB/sec execute 87 sec latency 266.273 ms 20 5536 5.33 MB/sec execute 88 sec latency 318.402 ms 20 5607 5.29 MB/sec execute 89 sec latency 283.965 ms 20 5665 5.27 MB/sec execute 90 sec latency 215.077 ms 20 5727 5.26 MB/sec execute 91 sec latency 307.549 ms 20 5800 5.27 MB/sec execute 92 sec latency 313.369 ms 20 5841 5.24 MB/sec execute 93 sec latency 399.463 ms 20 5891 5.21 MB/sec execute 94 sec latency 440.504 ms 20 5967 5.29 MB/sec execute 95 sec latency 342.688 ms 20 6018 5.31 MB/sec execute 96 sec latency 530.296 ms 20 6092 5.42 MB/sec execute 97 sec latency 470.710 ms 20 6160 5.44 MB/sec execute 98 sec latency 435.185 ms 20 6225 5.57 MB/sec execute 99 sec latency 370.554 ms 20 6312 5.60 MB/sec execute 100 sec latency 385.467 ms 20 6384 5.65 MB/sec execute 101 sec latency 503.372 ms 20 6499 5.89 MB/sec execute 102 sec latency 450.129 ms 20 6600 5.96 MB/sec execute 103 sec latency 448.798 ms 20 6695 6.05 MB/sec execute 104 sec latency 456.727 ms 20 6769 6.10 MB/sec execute 105 sec latency 430.789 ms 20 6904 6.17 MB/sec execute 106 sec latency 317.109 ms 20 7002 6.34 MB/sec execute 107 sec latency 368.922 ms 20 7075 6.35 MB/sec execute 108 sec latency 290.350 ms 20 7151 6.44 MB/sec execute 109 sec latency 111.248 ms 20 7229 6.54 MB/sec execute 110 sec latency 122.656 ms 20 7291 6.53 MB/sec execute 111 sec latency 121.444 ms 20 7343 6.49 MB/sec execute 112 sec latency 113.961 ms 20 7402 6.52 MB/sec execute 113 sec latency 126.840 ms 20 7446 6.47 MB/sec execute 114 sec latency 112.237 ms 20 7489 6.42 MB/sec execute 115 sec latency 121.296 ms 20 7546 6.39 MB/sec execute 116 sec latency 168.753 ms 20 7594 6.34 MB/sec execute 117 sec latency 338.690 ms 20 7652 6.29 MB/sec execute 118 sec latency 257.241 ms 20 7713 6.25 MB/sec execute 119 sec latency 289.269 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 23343 50.273 247.929 Close 16971 13.707 75.069 Rename 965 78.502 191.907 Unlink 4687 16.510 83.178 Qpathinfo 22004 13.006 175.655 Qfileinfo 3730 0.273 30.299 Qfsinfo 3822 0.289 34.190 Sfileinfo 1706 53.972 187.918 Find 8165 4.774 162.071 WriteX 11267 6.159 148.414 ReadX 37106 0.041 10.798 LockX 80 14.485 56.471 UnlockX 80 13.830 34.758 Flush 1357 258.403 1440.724 Throughput 6.24898 MB/sec 20 clients 20 procs max_latency=1440.735 ms stopping dbench on /mnt/lustre/d0.oleg410-client.virtnet at Thu Dec 12 10:06:46 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg410-client.virtnet /mnt/lustre/d0.oleg410-client.virtnet /mnt/lustre/d0.oleg410-client.virtnet removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg410-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:54 (1734016014) min OST has 3595264kB available, using 5392896kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7718] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5266] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg410-clien 5266M 73501 59 45225 40 116080 29 1098 152 Latency 234ms 416ms 94430us 322ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg410-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 200 18 6519 31 278 13 247 18 433 14 87 9 Latency 32718us 20881us 72291us 21831us 12379us 70979us 1.97,1.97,oleg410-client.virtnet,1,1734004866,5266M,,,,73501,59,45225,40,,,116080,29,1098,152,10,,,,,200,18,6519,31,278,13,247,18,433,14,87,9,,234ms,416ms,,94430us,322ms,32718us,20881us,72291us,21831us,12379us,70979us debug=0x33f0484 PASS bonnie (528s) == sanity-benchmark test iozone: iozone ================== 10:15:43 (1734016543) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7718] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:16:02 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 124841 160222 242046 281304 41805 188834 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:21:30 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 22423 22588 83403 84789 79608 34553 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1239s) == sanity-benchmark test fsx: fsx ======================== 10:36:22 (1734017782) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 32489 -P /tmp -l 5641728 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 32489 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x3f6726 truncating to largest ever: 0x464f86 truncating to largest ever: 0x545582 001000 1734017786.141096 write 0x4cfe27 thru 0x4d3784 (0x395e bytes) truncating to largest ever: 0x558551 truncating to largest ever: 0x55d94b 003000 1734017793.138502 trunc from 0x492cc2 to 0x4b61a1 (0x234e0 bytes) truncating to largest ever: 0x55ded2 006000 1734017803.032146 mapwrite 0x0ff681 thru 0x10b1ac (0xbb2c bytes) 007000 1734017805.985841 read 0x236400 thru 0x23c024 (0x5c25 bytes) 008000 1734017809.017800 mapwrite 0x156bbd thru 0x162f49 (0xc38d bytes) truncating to largest ever: 0x560b43 011000 1734017818.732663 mapwrite 0x03d594 thru 0x03f915 (0x2382 bytes) 012000 1734017821.934193 trunc from 0x1b3230 to 0x51b599 (0x36836a bytes) 014000 1734017829.204813 write 0x198cb3 thru 0x1a4ce8 (0xc036 bytes) 017000 1734017838.909676 read 0x22dabd thru 0x230971 (0x2eb5 bytes) 020000 1734017849.047433 trunc from 0x2d3fb1 to 0x04cb86 (0x28742a bytes) 021000 1734017852.320482 trunc from 0x52de0c to 0x2b763b (0x2767d0 bytes) 023000 1734017859.459676 read 0x3f408e thru 0x3fc098 (0x800b bytes) 025000 1734017865.690070 write 0x1d14c8 thru 0x1df7e6 (0xe31f bytes) 028000 1734017875.631760 write 0x15f1b2 thru 0x166474 (0x72c3 bytes) 029000 1734017879.002672 read 0x407653 thru 0x416610 (0xefbe bytes) 030000 1734017881.854129 read 0x2380ce thru 0x23ae47 (0x2d7a bytes) 031000 1734017884.924139 write 0x1e25a5 thru 0x1ecea9 (0xa905 bytes) 034000 1734017895.027936 read 0x1fd736 thru 0x2076a7 (0x9f72 bytes) 037000 1734017904.580890 write 0x4ff4fc thru 0x50a998 (0xb49d bytes) 038000 1734017907.922315 mapread 0x208e79 thru 0x210fb0 (0x8138 bytes) 040000 1734017914.536138 read 0x19c4e7 thru 0x1a0950 (0x446a bytes) 043000 1734017924.425451 mapwrite 0x2594b6 thru 0x26577a (0xc2c5 bytes) 044000 1734017927.560520 write 0x26f837 thru 0x27eb08 (0xf2d2 bytes) 045000 1734017930.893434 write 0x44f3a8 thru 0x4575da (0x8233 bytes) truncating to largest ever: 0x56126d 047000 1734017937.015788 trunc from 0x519b19 to 0x2e1e13 (0x237d05 bytes) 053000 1734017954.987999 trunc from 0x561600 to 0x3547da (0x20ce25 bytes) 055000 1734017961.289108 write 0x162679 thru 0x16d872 (0xb1fa bytes) 056000 1734017964.273765 read 0x03e110 thru 0x047b42 (0x9a33 bytes) 057000 1734017967.668845 mapwrite 0x26bc20 thru 0x27860c (0xc9ed bytes) 058000 1734017970.935179 read 0x1251c1 thru 0x126be0 (0x1a20 bytes) 061000 1734017981.170470 mapread 0x029ae4 thru 0x02b45b (0x1978 bytes) 063000 1734017987.121757 mapread 0x068fea thru 0x078411 (0xf428 bytes) truncating to largest ever: 0x56128d 064000 1734017990.207976 mapread 0x048f75 thru 0x056526 (0xd5b2 bytes) 065000 1734017993.134717 mapwrite 0x54e027 thru 0x54e65e (0x638 bytes) 066000 1734017995.811047 write 0x417a7b thru 0x41c86b (0x4df1 bytes) 067000 1734017998.644814 write 0x19cbae thru 0x1a3578 (0x69cb bytes) 070000 1734018007.891668 write 0x1ccdee thru 0x1dbada (0xeced bytes) 072000 1734018013.473647 write 0x0ae6d2 thru 0x0bdfac (0xf8db bytes) 074000 1734018019.201587 mapread 0x018a3d thru 0x01a5ba (0x1b7e bytes) 075000 1734018022.640425 trunc from 0x4a8d17 to 0x2191bc (0x28fb5a bytes) 076000 1734018025.390559 mapread 0x06bb38 thru 0x07229d (0x6766 bytes) 078000 1734018033.535215 trunc from 0x31c5c9 to 0x1900e4 (0x18c4e4 bytes) 081000 1734018048.310649 write 0x3fb0ac thru 0x408de4 (0xdd39 bytes) 085000 1734018061.033294 write 0x2c3cde thru 0x2c7ecd (0x41f0 bytes) 087000 1734018066.450131 mapread 0x2433d9 thru 0x251524 (0xe14c bytes) 088000 1734018069.747440 mapread 0x020d5e thru 0x02e8c8 (0xdb6b bytes) truncating to largest ever: 0x56137b 090000 1734018077.710377 mapread 0x1f416c thru 0x1fe7e7 (0xa67c bytes) 091000 1734018080.436971 read 0x132604 thru 0x13ba65 (0x9462 bytes) 095000 1734018091.314619 mapwrite 0x27facb thru 0x28e177 (0xe6ad bytes) 097000 1734018096.832164 mapread 0x005059 thru 0x00dc04 (0x8bac bytes) 100000 1734018105.738402 read 0x3d6b97 thru 0x3e1a09 (0xae73 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4444241 (4352 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (324s) == sanity-benchmark test complete, duration 2270 sec ===== 10:41:46 (1734018106) === sanity-benchmark: start cleanup 10:41:47 (1734018107) === === sanity-benchmark: finish cleanup 10:41:47 (1734018107) ===