-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:54 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:59 (1734015839) === oleg425-client.virtnet: executing check_config_client /mnt/lustre oleg425-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg425-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b588c000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b588c000.idle_timeout=debug disable quota as required oleg425-server: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:12 (1734015852) === == sanity-benchmark test dbench: dbench ================== 10:04:13 (1734015853) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7723] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg425-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg425-client.virtnet at Thu Dec 12 10:04:16 EST 2024 waiting for dbench pid 10308 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 20 of 20 processes prepared for launch 0 sec releasing clients 2 11 5.21 MB/sec warmup 1 sec latency 891.572 ms 20 79 34.22 MB/sec warmup 2 sec latency 146.583 ms 20 139 40.33 MB/sec warmup 3 sec latency 262.648 ms 20 198 39.34 MB/sec warmup 4 sec latency 131.660 ms 20 258 38.92 MB/sec warmup 5 sec latency 189.065 ms 20 310 37.84 MB/sec warmup 6 sec latency 161.445 ms 20 355 36.33 MB/sec warmup 7 sec latency 164.753 ms 20 402 35.58 MB/sec warmup 8 sec latency 159.546 ms 20 447 34.88 MB/sec warmup 9 sec latency 200.966 ms 20 494 34.32 MB/sec warmup 10 sec latency 229.854 ms 20 547 34.04 MB/sec warmup 11 sec latency 355.111 ms 20 639 35.03 MB/sec warmup 12 sec latency 639.944 ms 20 673 32.52 MB/sec warmup 13 sec latency 364.875 ms 20 709 30.28 MB/sec warmup 14 sec latency 209.105 ms 20 734 28.38 MB/sec warmup 15 sec latency 416.835 ms 20 776 26.68 MB/sec warmup 16 sec latency 235.755 ms 20 803 25.24 MB/sec warmup 17 sec latency 439.848 ms 20 834 23.88 MB/sec warmup 18 sec latency 350.124 ms 20 883 22.78 MB/sec warmup 19 sec latency 374.550 ms 20 922 21.75 MB/sec warmup 20 sec latency 295.578 ms 20 969 20.89 MB/sec warmup 21 sec latency 325.093 ms 20 999 20.03 MB/sec warmup 22 sec latency 506.235 ms 20 1069 19.89 MB/sec warmup 23 sec latency 355.083 ms 20 1192 0.79 MB/sec execute 1 sec latency 95.858 ms 20 1257 5.20 MB/sec execute 2 sec latency 96.166 ms 20 1303 4.77 MB/sec execute 3 sec latency 131.918 ms 20 1417 15.10 MB/sec execute 4 sec latency 325.711 ms 20 1475 12.17 MB/sec execute 5 sec latency 102.331 ms 20 1515 10.22 MB/sec execute 6 sec latency 400.312 ms 20 1579 8.95 MB/sec execute 7 sec latency 266.705 ms 20 1639 7.95 MB/sec execute 8 sec latency 284.857 ms 20 1679 7.17 MB/sec execute 9 sec latency 335.978 ms 20 1742 6.55 MB/sec execute 10 sec latency 124.183 ms 20 1802 6.03 MB/sec execute 11 sec latency 383.489 ms 20 1847 5.61 MB/sec execute 12 sec latency 356.347 ms 20 1889 5.20 MB/sec execute 13 sec latency 282.986 ms 20 1922 4.90 MB/sec execute 14 sec latency 545.817 ms 20 2002 4.66 MB/sec execute 15 sec latency 485.101 ms 20 2054 4.49 MB/sec execute 16 sec latency 107.138 ms 20 2129 4.33 MB/sec execute 17 sec latency 82.307 ms 20 2188 4.32 MB/sec execute 18 sec latency 336.965 ms 20 2223 4.14 MB/sec execute 19 sec latency 246.133 ms 20 2257 4.11 MB/sec execute 20 sec latency 903.094 ms 20 2342 4.60 MB/sec execute 21 sec latency 1123.949 ms 20 2382 4.53 MB/sec execute 22 sec latency 655.714 ms 20 2418 4.46 MB/sec execute 23 sec latency 482.916 ms 20 2463 4.45 MB/sec execute 24 sec latency 491.448 ms 20 2524 4.80 MB/sec execute 25 sec latency 512.397 ms 20 2592 4.90 MB/sec execute 26 sec latency 513.657 ms 20 2695 5.61 MB/sec execute 27 sec latency 402.680 ms 20 2814 6.49 MB/sec execute 28 sec latency 371.641 ms 20 2900 6.82 MB/sec execute 29 sec latency 482.395 ms 20 2990 7.07 MB/sec execute 30 sec latency 444.335 ms 20 3057 6.98 MB/sec execute 31 sec latency 424.219 ms 20 3202 7.09 MB/sec execute 32 sec latency 471.367 ms 20 3299 7.39 MB/sec execute 33 sec latency 354.080 ms 20 3380 7.56 MB/sec execute 34 sec latency 326.352 ms 20 3469 8.05 MB/sec execute 35 sec latency 373.493 ms 20 3577 8.61 MB/sec execute 36 sec latency 111.048 ms 20 3640 8.50 MB/sec execute 37 sec latency 139.467 ms 20 3690 8.34 MB/sec execute 38 sec latency 135.815 ms 20 3749 8.36 MB/sec execute 39 sec latency 120.489 ms 20 3790 8.30 MB/sec execute 40 sec latency 194.268 ms 20 3835 8.19 MB/sec execute 41 sec latency 111.974 ms 20 3867 8.00 MB/sec execute 42 sec latency 142.097 ms 20 3908 7.87 MB/sec execute 43 sec latency 113.331 ms 20 3956 7.75 MB/sec execute 44 sec latency 109.747 ms 20 3992 7.58 MB/sec execute 45 sec latency 175.443 ms 20 4042 7.42 MB/sec execute 46 sec latency 107.140 ms 20 4080 7.27 MB/sec execute 47 sec latency 404.022 ms 20 4120 7.12 MB/sec execute 48 sec latency 333.154 ms 20 4172 6.99 MB/sec execute 49 sec latency 588.987 ms 20 4213 6.88 MB/sec execute 50 sec latency 727.989 ms 20 4248 6.78 MB/sec execute 51 sec latency 412.638 ms 20 4284 6.67 MB/sec execute 52 sec latency 244.310 ms 20 4310 6.58 MB/sec execute 53 sec latency 345.290 ms 20 4352 6.49 MB/sec execute 54 sec latency 281.896 ms 20 4380 6.40 MB/sec execute 55 sec latency 354.581 ms 20 4413 6.31 MB/sec execute 56 sec latency 289.775 ms 20 4460 6.24 MB/sec execute 57 sec latency 365.444 ms 20 4493 6.17 MB/sec execute 58 sec latency 420.648 ms 20 4534 6.13 MB/sec execute 59 sec latency 438.244 ms 20 4584 6.10 MB/sec execute 60 sec latency 393.705 ms 20 4637 6.16 MB/sec execute 61 sec latency 329.606 ms 20 4714 6.17 MB/sec execute 62 sec latency 105.263 ms 20 4784 6.17 MB/sec execute 63 sec latency 100.044 ms 20 4852 6.23 MB/sec execute 64 sec latency 145.516 ms 20 4905 6.32 MB/sec execute 65 sec latency 428.917 ms 20 4990 6.70 MB/sec execute 66 sec latency 309.649 ms 20 5031 6.61 MB/sec execute 67 sec latency 285.131 ms 20 5073 6.52 MB/sec execute 68 sec latency 296.769 ms 20 5108 6.43 MB/sec execute 69 sec latency 390.615 ms 20 5153 6.35 MB/sec execute 70 sec latency 272.313 ms 20 5191 6.28 MB/sec execute 71 sec latency 421.891 ms 20 5227 6.19 MB/sec execute 72 sec latency 383.415 ms 20 5260 6.12 MB/sec execute 73 sec latency 591.665 ms 20 5307 6.05 MB/sec execute 74 sec latency 110.310 ms 20 5353 5.98 MB/sec execute 75 sec latency 228.055 ms 20 5397 5.91 MB/sec execute 76 sec latency 234.129 ms 20 5442 5.84 MB/sec execute 77 sec latency 251.138 ms 20 5497 5.78 MB/sec execute 78 sec latency 232.161 ms 20 5564 5.73 MB/sec execute 79 sec latency 278.605 ms 20 5630 5.67 MB/sec execute 80 sec latency 137.929 ms 20 5677 5.64 MB/sec execute 81 sec latency 126.459 ms 20 5739 5.60 MB/sec execute 82 sec latency 455.444 ms 20 5805 5.60 MB/sec execute 83 sec latency 298.828 ms 20 5864 5.60 MB/sec execute 84 sec latency 483.995 ms 20 5937 5.67 MB/sec execute 85 sec latency 458.727 ms 20 5983 5.65 MB/sec execute 86 sec latency 510.681 ms 20 6041 5.69 MB/sec execute 87 sec latency 507.687 ms 20 6106 5.72 MB/sec execute 88 sec latency 377.521 ms 20 6185 5.88 MB/sec execute 89 sec latency 464.834 ms 20 6270 5.94 MB/sec execute 90 sec latency 372.114 ms 20 6344 6.04 MB/sec execute 91 sec latency 418.125 ms 20 6454 6.29 MB/sec execute 92 sec latency 390.958 ms 20 6562 6.37 MB/sec execute 93 sec latency 367.417 ms 20 6638 6.39 MB/sec execute 94 sec latency 378.210 ms 20 6744 6.47 MB/sec execute 95 sec latency 340.737 ms 20 6871 6.57 MB/sec execute 96 sec latency 309.543 ms 20 6983 6.72 MB/sec execute 97 sec latency 298.041 ms 20 7069 6.83 MB/sec execute 98 sec latency 244.524 ms 20 7171 7.03 MB/sec execute 99 sec latency 114.717 ms 20 7245 7.02 MB/sec execute 100 sec latency 107.514 ms 20 7300 7.00 MB/sec execute 101 sec latency 102.452 ms 20 7349 6.99 MB/sec execute 102 sec latency 135.703 ms 20 7407 6.98 MB/sec execute 103 sec latency 105.539 ms 20 7450 6.92 MB/sec execute 104 sec latency 120.685 ms 20 7500 6.88 MB/sec execute 105 sec latency 96.242 ms 20 7545 6.82 MB/sec execute 106 sec latency 148.076 ms 20 7589 6.76 MB/sec execute 107 sec latency 141.123 ms 20 7630 6.70 MB/sec execute 108 sec latency 410.662 ms 20 7681 6.65 MB/sec execute 109 sec latency 211.584 ms 20 7735 6.60 MB/sec execute 110 sec latency 630.392 ms 20 7788 6.55 MB/sec execute 111 sec latency 381.472 ms 20 7818 6.51 MB/sec execute 112 sec latency 381.067 ms 20 7845 6.46 MB/sec execute 113 sec latency 304.304 ms 20 7884 6.42 MB/sec execute 114 sec latency 296.796 ms 20 7921 6.38 MB/sec execute 115 sec latency 267.805 ms 20 7960 6.34 MB/sec execute 116 sec latency 339.614 ms 20 8006 6.32 MB/sec execute 117 sec latency 329.515 ms 20 8058 6.29 MB/sec execute 118 sec latency 314.332 ms 20 8101 6.27 MB/sec execute 119 sec latency 367.436 ms 20 cleanup 120 sec 20 cleanup 121 sec 10 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 24308 47.993 203.787 Close 17788 12.659 68.906 Rename 1024 71.913 174.973 Unlink 4924 16.063 91.786 Qpathinfo 22301 12.079 166.999 Qfileinfo 3841 0.246 40.916 Qfsinfo 3975 0.224 22.864 Sfileinfo 1951 46.801 169.718 Find 8495 4.159 167.683 WriteX 11882 5.463 104.299 ReadX 38107 0.030 10.998 LockX 80 14.883 42.003 UnlockX 80 14.888 39.159 Flush 1710 228.317 1123.941 Throughput 6.26514 MB/sec 20 clients 20 procs max_latency=1123.949 ms stopping dbench on /mnt/lustre/d0.oleg425-client.virtnet at Thu Dec 12 10:06:42 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg425-client.virtnet /mnt/lustre/d0.oleg425-client.virtnet /mnt/lustre/d0.oleg425-client.virtnet removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg425-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:49 (1734016009) min OST has 3592192kB available, using 5388288kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7723] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5262] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg425-clien 5262M 75301 59 47735 42 115897 30 619.8 115 Latency 27929us 261ms 84935us 365ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg425-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 227 17 5281 24 275 12 293 17 685 12 284 11 Latency 27017us 28178us 93883us 15737us 8409us 41429us 1.97,1.97,oleg425-client.virtnet,1,1734004891,5262M,,,,75301,59,47735,42,,,115897,30,619.8,115,10,,,,,227,17,5281,24,275,12,293,17,685,12,284,11,,27929us,261ms,,84935us,365ms,27017us,28178us,93883us,15737us,8409us,41429us debug=0x33f0484 PASS bonnie (424s) == sanity-benchmark test iozone: iozone ================== 10:13:53 (1734016433) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7723] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:14:17 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 100793 105454 108047 167054 60171 84225 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:20:53 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 23239 23935 94349 99048 95290 33246 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1263s) == sanity-benchmark test fsx: fsx ======================== 10:34:56 (1734017696) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 21797 -P /tmp -l 5641728 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 21797 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x314f47 truncating to largest ever: 0x47a36e truncating to largest ever: 0x49f89d truncating to largest ever: 0x4b5c65 truncating to largest ever: 0x508600 truncating to largest ever: 0x5137ba truncating to largest ever: 0x5262e7 truncating to largest ever: 0x5493a8 truncating to largest ever: 0x55c4e5 002000 1734017701.781542 write 0x23fdae thru 0x2418f4 (0x1b47 bytes) truncating to largest ever: 0x55e1a8 005000 1734017710.342359 mapread 0x341cbe thru 0x349614 (0x7957 bytes) truncating to largest ever: 0x56003f 010000 1734017724.475980 trunc from 0x386ccd to 0x1638da (0x2233f2 bytes) 013000 1734017732.818598 read 0x183838 thru 0x1892d5 (0x5a9e bytes) 017000 1734017744.737145 mapread 0x323aef thru 0x326e4b (0x335d bytes) 019000 1734017751.301098 read 0x146a7a thru 0x14e1b6 (0x773d bytes) 020000 1734017754.233061 mapread 0x14a541 thru 0x1585b1 (0xe071 bytes) 022000 1734017760.950616 trunc from 0x384a5b to 0x29a6db (0xea37f bytes) 025000 1734017770.095265 read 0x12ca45 thru 0x139255 (0xc811 bytes) 026000 1734017772.920485 mapread 0x1811d4 thru 0x1854cb (0x42f8 bytes) 028000 1734017778.974712 mapwrite 0x034c6c thru 0x03870d (0x3aa2 bytes) skipping zero size read 030000 1734017785.679531 mapwrite 0x2a039b thru 0x2ada5c (0xd6c2 bytes) 032000 1734017791.971616 mapread 0x2fc568 thru 0x306bab (0xa644 bytes) 034000 1734017797.897389 read 0x1000e2 thru 0x106f22 (0x6e41 bytes) truncating to largest ever: 0x5604c6 037000 1734017807.236629 mapread 0x07fb93 thru 0x08bd13 (0xc181 bytes) truncating to largest ever: 0x561136 040000 1734017816.446048 trunc from 0x2c4d8d to 0x3433d1 (0x7e645 bytes) 041000 1734017819.696511 mapwrite 0x551c91 thru 0x55a2ca (0x863a bytes) truncating to largest ever: 0x56128f 042000 1734017822.913039 write 0x01bf37 thru 0x02b295 (0xf35f bytes) 044000 1734017828.785192 mapwrite 0x3f467f thru 0x3f9911 (0x5293 bytes) 045000 1734017831.611267 read 0x36d03e thru 0x3759fa (0x89bd bytes) 047000 1734017837.660383 mapwrite 0x3e7cf3 thru 0x3ec0cc (0x43da bytes) 048000 1734017840.791094 write 0x2924ae thru 0x297fa5 (0x5af8 bytes) 049000 1734017844.003577 write 0x121a60 thru 0x124094 (0x2635 bytes) 050000 1734017847.197707 mapread 0x16425a thru 0x172a2c (0xe7d3 bytes) 052000 1734017853.665562 mapread 0x22c3b0 thru 0x22f1cd (0x2e1e bytes) 053000 1734017856.562759 mapwrite 0x472490 thru 0x47858f (0x6100 bytes) 054000 1734017859.489687 write 0x233676 thru 0x23820a (0x4b95 bytes) 057000 1734017868.432317 mapwrite 0x33de63 thru 0x34ce14 (0xefb2 bytes) 058000 1734017871.343811 trunc from 0x4b41ed to 0x18efb3 (0x325239 bytes) 061000 1734017880.073070 read 0x1c3b87 thru 0x1cca05 (0x8e7f bytes) 062000 1734017883.176925 read 0x087ed5 thru 0x097132 (0xf25e bytes) 063000 1734017886.042816 trunc from 0x510625 to 0x514cfa (0x46d6 bytes) 064000 1734017889.177165 mapread 0x13d981 thru 0x14a3b7 (0xca37 bytes) 065000 1734017892.746343 read 0x1be043 thru 0x1c80dc (0xa09a bytes) 066000 1734017895.945725 trunc from 0x15d84b to 0x0cd965 (0x8fee5 bytes) 067000 1734017899.146857 read 0x3e7662 thru 0x3ec100 (0x4a9f bytes) 068000 1734017902.340092 write 0x53b3e8 thru 0x53db96 (0x27af bytes) 070000 1734017908.403824 mapread 0x09b99a thru 0x0a262d (0x6c94 bytes) 071000 1734017911.604796 write 0x4c7c82 thru 0x4d7aa7 (0xfe26 bytes) 072000 1734017914.431701 mapwrite 0x1784f8 thru 0x17d1b2 (0x4cbb bytes) 074000 1734017920.725999 mapwrite 0x34d0a9 thru 0x352bcb (0x5b23 bytes) 075000 1734017924.281677 mapread 0x17fc42 thru 0x181a43 (0x1e02 bytes) 078000 1734017933.823887 mapwrite 0x2055cc thru 0x20f99e (0xa3d3 bytes) 079000 1734017937.190045 trunc from 0x3088d5 to 0x475271 (0x16c99d bytes) 082000 1734017946.354537 mapread 0x003b8a thru 0x00adf2 (0x7269 bytes) 083000 1734017949.355289 mapread 0x1c22e3 thru 0x1c90f8 (0x6e16 bytes) 088000 1734017964.012234 mapread 0x147523 thru 0x150b01 (0x95df bytes) 089000 1734017966.933923 trunc from 0x19d544 to 0x3e0f32 (0x2439ef bytes) 091000 1734017973.372267 mapread 0x04bf2b thru 0x0519cc (0x5aa2 bytes) 095000 1734017985.219082 mapwrite 0x3f6b6a thru 0x3feb95 (0x802c bytes) 098000 1734017994.030051 trunc from 0x556007 to 0x06055e (0x4f5aa8 bytes) 099000 1734017996.916802 write 0x0376fa thru 0x03b124 (0x3a2b bytes) 100000 1734017999.437981 read 0x2894a8 thru 0x292c13 (0x976c bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 3329168 (3328 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (304s) == sanity-benchmark test complete, duration 2166 sec ===== 10:40:00 (1734018000) === sanity-benchmark: start cleanup 10:40:00 (1734018000) === === sanity-benchmark: finish cleanup 10:40:01 (1734018001) ===