-----============= acceptance-small: sanity-benchmark ============----- Sun Feb 25 00:27:45 EST 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 00:27:47 (1708838867) === oleg324-client.virtnet: executing check_config_client /mnt/lustre oleg324-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg324-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a630000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a630000.idle_timeout=debug disable quota as required oleg324-server: oleg324-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 00:27:53 (1708838873) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 00:27:54 (1708838874) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6705] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg324-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg324-client.virtnet at Sun Feb 25 00:27:56 EST 2024 waiting for dbench pid 8630 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 212 165.38 MB/sec warmup 1 sec latency 55.433 ms 20 464 162.40 MB/sec warmup 2 sec latency 53.369 ms 20 721 141.87 MB/sec warmup 3 sec latency 184.490 ms 20 916 108.79 MB/sec warmup 4 sec latency 88.200 ms 20 1206 92.17 MB/sec warmup 5 sec latency 102.723 ms 20 1552 86.99 MB/sec warmup 6 sec latency 203.031 ms 20 1850 75.28 MB/sec warmup 7 sec latency 76.115 ms 20 2151 66.72 MB/sec warmup 8 sec latency 85.978 ms 20 2418 62.37 MB/sec warmup 9 sec latency 113.329 ms 20 2810 64.26 MB/sec warmup 10 sec latency 143.380 ms 20 3246 63.24 MB/sec warmup 11 sec latency 152.243 ms 20 3655 64.50 MB/sec warmup 12 sec latency 138.479 ms 20 3897 61.39 MB/sec warmup 13 sec latency 23.567 ms 20 4104 57.26 MB/sec warmup 14 sec latency 175.993 ms 20 4299 53.89 MB/sec warmup 15 sec latency 229.664 ms 20 4476 51.02 MB/sec warmup 16 sec latency 108.556 ms 20 4748 49.74 MB/sec warmup 17 sec latency 97.784 ms 20 5081 50.20 MB/sec warmup 18 sec latency 109.717 ms 20 5330 47.80 MB/sec warmup 19 sec latency 91.171 ms 20 5625 45.79 MB/sec warmup 20 sec latency 98.955 ms 20 5956 45.04 MB/sec warmup 21 sec latency 118.010 ms 20 6275 45.11 MB/sec warmup 22 sec latency 101.379 ms 20 6816 47.01 MB/sec warmup 23 sec latency 132.261 ms 20 7444 21.86 MB/sec execute 1 sec latency 83.174 ms 20 7641 13.06 MB/sec execute 2 sec latency 267.768 ms 20 7838 10.61 MB/sec execute 3 sec latency 133.747 ms 20 8033 10.71 MB/sec execute 4 sec latency 91.867 ms 20 8319 15.13 MB/sec execute 5 sec latency 80.286 ms 20 8644 21.36 MB/sec execute 6 sec latency 126.684 ms 20 8885 18.90 MB/sec execute 7 sec latency 68.698 ms 20 9184 17.53 MB/sec execute 8 sec latency 52.782 ms 20 9483 18.34 MB/sec execute 9 sec latency 148.213 ms 20 9809 22.31 MB/sec execute 10 sec latency 133.983 ms 20 10277 27.27 MB/sec execute 11 sec latency 114.108 ms 20 10722 31.71 MB/sec execute 12 sec latency 76.142 ms 20 10967 31.04 MB/sec execute 13 sec latency 26.104 ms 20 11160 29.16 MB/sec execute 14 sec latency 185.838 ms 20 11367 27.57 MB/sec execute 15 sec latency 230.841 ms 20 11535 26.41 MB/sec execute 16 sec latency 135.117 ms 20 11787 26.36 MB/sec execute 17 sec latency 117.188 ms 20 12120 27.69 MB/sec execute 18 sec latency 129.390 ms 20 12379 27.04 MB/sec execute 19 sec latency 78.496 ms 20 12639 25.93 MB/sec execute 20 sec latency 63.457 ms 20 12948 25.66 MB/sec execute 21 sec latency 96.370 ms 20 13235 26.27 MB/sec execute 22 sec latency 146.699 ms 20 13710 29.01 MB/sec execute 23 sec latency 140.858 ms 20 14159 30.61 MB/sec execute 24 sec latency 99.600 ms 20 14470 31.32 MB/sec execute 25 sec latency 37.705 ms 20 14676 30.40 MB/sec execute 26 sec latency 161.694 ms 20 14894 29.44 MB/sec execute 27 sec latency 119.846 ms 20 15066 28.75 MB/sec execute 28 sec latency 132.795 ms 20 15306 28.55 MB/sec execute 29 sec latency 106.469 ms 20 15631 29.16 MB/sec execute 30 sec latency 70.612 ms 20 15906 28.90 MB/sec execute 31 sec latency 72.849 ms 20 16179 28.21 MB/sec execute 32 sec latency 56.130 ms 20 16494 27.90 MB/sec execute 33 sec latency 76.100 ms 20 16821 28.51 MB/sec execute 34 sec latency 120.078 ms 20 17276 30.07 MB/sec execute 35 sec latency 109.865 ms 20 17703 31.11 MB/sec execute 36 sec latency 154.717 ms 20 18006 31.40 MB/sec execute 37 sec latency 47.059 ms 20 18211 30.86 MB/sec execute 38 sec latency 229.088 ms 20 18414 30.16 MB/sec execute 39 sec latency 207.118 ms 20 18583 29.63 MB/sec execute 40 sec latency 115.932 ms 20 18800 29.39 MB/sec execute 41 sec latency 125.692 ms 20 19089 29.50 MB/sec execute 42 sec latency 88.328 ms 20 19390 29.70 MB/sec execute 43 sec latency 67.531 ms 20 19649 29.15 MB/sec execute 44 sec latency 57.198 ms 20 19954 28.76 MB/sec execute 45 sec latency 60.892 ms 20 20258 28.88 MB/sec execute 46 sec latency 126.411 ms 20 20599 29.47 MB/sec execute 47 sec latency 166.659 ms 20 21058 30.50 MB/sec execute 48 sec latency 101.855 ms 20 21437 31.26 MB/sec execute 49 sec latency 124.978 ms 20 21675 31.05 MB/sec execute 50 sec latency 109.713 ms 20 21859 30.54 MB/sec execute 51 sec latency 209.441 ms 20 22060 30.05 MB/sec execute 52 sec latency 144.078 ms 20 22261 29.79 MB/sec execute 53 sec latency 120.634 ms 20 22531 29.77 MB/sec execute 54 sec latency 118.202 ms 20 22872 30.16 MB/sec execute 55 sec latency 74.789 ms 20 23135 29.74 MB/sec execute 56 sec latency 63.532 ms 20 23428 29.45 MB/sec execute 57 sec latency 57.382 ms 20 23755 29.40 MB/sec execute 58 sec latency 73.495 ms 20 24066 29.72 MB/sec execute 59 sec latency 144.658 ms 20 24510 30.62 MB/sec execute 60 sec latency 101.717 ms 20 24910 31.12 MB/sec execute 61 sec latency 103.617 ms 20 25171 31.15 MB/sec execute 62 sec latency 161.842 ms 20 25361 30.79 MB/sec execute 63 sec latency 104.805 ms 20 25587 30.40 MB/sec execute 64 sec latency 119.521 ms 20 25775 30.14 MB/sec execute 65 sec latency 141.269 ms 20 25990 29.92 MB/sec execute 66 sec latency 90.074 ms 20 26276 29.94 MB/sec execute 67 sec latency 98.587 ms 20 26582 30.09 MB/sec execute 68 sec latency 84.922 ms 20 26816 29.80 MB/sec execute 69 sec latency 72.236 ms 20 27125 29.64 MB/sec execute 70 sec latency 80.696 ms 20 27456 29.75 MB/sec execute 71 sec latency 126.274 ms 20 27798 30.14 MB/sec execute 72 sec latency 128.573 ms 20 28205 30.57 MB/sec execute 73 sec latency 122.511 ms 20 28583 31.05 MB/sec execute 74 sec latency 108.964 ms 20 28813 30.92 MB/sec execute 75 sec latency 95.581 ms 20 29020 30.61 MB/sec execute 76 sec latency 88.147 ms 20 29247 30.37 MB/sec execute 77 sec latency 139.311 ms 20 29441 30.13 MB/sec execute 78 sec latency 112.377 ms 20 29692 30.05 MB/sec execute 79 sec latency 127.351 ms 20 30017 30.25 MB/sec execute 80 sec latency 105.539 ms 20 30297 30.15 MB/sec execute 81 sec latency 69.756 ms 20 30607 30.02 MB/sec execute 82 sec latency 57.966 ms 20 30935 29.97 MB/sec execute 83 sec latency 70.397 ms 20 31258 30.17 MB/sec execute 84 sec latency 109.473 ms 20 31684 30.69 MB/sec execute 85 sec latency 106.623 ms 20 32065 30.92 MB/sec execute 86 sec latency 104.990 ms 20 32351 31.06 MB/sec execute 87 sec latency 78.000 ms 20 32564 30.83 MB/sec execute 88 sec latency 145.596 ms 20 32798 30.59 MB/sec execute 89 sec latency 109.357 ms 20 32999 30.36 MB/sec execute 90 sec latency 140.396 ms 20 33250 30.25 MB/sec execute 91 sec latency 110.786 ms 20 33556 30.35 MB/sec execute 92 sec latency 95.449 ms 20 33865 30.43 MB/sec execute 93 sec latency 60.427 ms 20 34144 30.29 MB/sec execute 94 sec latency 75.963 ms 20 34457 30.24 MB/sec execute 95 sec latency 57.405 ms 20 34747 30.27 MB/sec execute 96 sec latency 98.916 ms 20 35097 30.56 MB/sec execute 97 sec latency 126.641 ms 20 35517 30.87 MB/sec execute 98 sec latency 152.608 ms 20 35809 31.02 MB/sec execute 99 sec latency 105.321 ms 20 36047 30.94 MB/sec execute 100 sec latency 112.325 ms 20 36266 30.73 MB/sec execute 101 sec latency 112.661 ms 20 36487 30.52 MB/sec execute 102 sec latency 144.798 ms 20 36724 30.39 MB/sec execute 103 sec latency 99.938 ms 20 37007 30.42 MB/sec execute 104 sec latency 96.775 ms 20 37359 30.60 MB/sec execute 105 sec latency 81.447 ms 20 37639 30.47 MB/sec execute 106 sec latency 73.090 ms 20 37932 30.41 MB/sec execute 107 sec latency 76.641 ms 20 38229 30.36 MB/sec execute 108 sec latency 107.892 ms 20 38510 30.47 MB/sec execute 109 sec latency 147.369 ms 20 38900 30.81 MB/sec execute 110 sec latency 139.802 ms 20 39251 30.95 MB/sec execute 111 sec latency 127.554 ms 20 39502 30.96 MB/sec execute 112 sec latency 82.008 ms 20 39716 30.82 MB/sec execute 113 sec latency 91.868 ms 20 39935 30.64 MB/sec execute 114 sec latency 141.518 ms 20 40155 30.46 MB/sec execute 115 sec latency 111.782 ms 20 40396 30.39 MB/sec execute 116 sec latency 105.952 ms 20 40713 30.45 MB/sec execute 117 sec latency 86.724 ms 20 41022 30.56 MB/sec execute 118 sec latency 93.357 ms 20 41311 30.47 MB/sec execute 119 sec latency 76.344 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 120468 10.054 42.767 Close 88270 2.419 34.739 Rename 5026 13.188 39.581 Unlink 24372 4.175 34.682 Qpathinfo 108828 2.312 38.744 Qfileinfo 18729 0.083 15.474 Qfsinfo 19576 0.084 5.158 Sfileinfo 9795 6.351 25.941 Find 41502 0.625 34.756 WriteX 58795 0.759 20.705 ReadX 183813 0.014 6.836 LockX 370 2.824 8.783 UnlockX 370 2.778 15.803 Flush 8416 48.720 267.762 Throughput 30.4716 MB/sec 20 clients 20 procs max_latency=267.768 ms stopping dbench on /mnt/lustre/d0.oleg324-client.virtnet at Sun Feb 25 00:30:20 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg324-client.virtnet /mnt/lustre/d0.oleg324-client.virtnet /mnt/lustre/d0.oleg324-client.virtnet removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg324-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 00:30:24 (1708839024) min OST has 3105792kB available, using 4658688kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6705] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4549] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg324-clien 4549M 172129 98 150781 98 371439 96 2670 145 Latency 2504us 18208us 37332us 147ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg324-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 341 25 3513 64 353 35 331 25 616 43 346 33 Latency 9868us 20887us 43234us 13505us 6453us 14847us 1.97,1.97,oleg324-client.virtnet,1,1708848679,4549M,,,,172129,98,150781,98,,,371439,96,2670,145,10,,,,,341,25,3513,64,353,35,331,25,616,43,346,33,,2504us,18208us,,37332us,147ms,9868us,20887us,43234us,13505us,6453us,14847us debug=0x33f0484 PASS bonnie (218s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 00:34:04 (1708839244) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 24529 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 24529 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x16e549 truncating to largest ever: 0x2a8629 truncating to largest ever: 0x440597 truncating to largest ever: 0x462f14 truncating to largest ever: 0x4ada2d truncating to largest ever: 0x4b0750 truncating to largest ever: 0x4bc6b1 truncating to largest ever: 0x4eeab1 truncating to largest ever: 0x52e9a2 truncating to largest ever: 0x54b997 truncating to largest ever: 0x552c9c 003000 1708839255.814964 trunc from 0x3bae7f to 0x227a76 (0x193408 bytes) truncating to largest ever: 0x561ff8 005000 1708839262.931152 mapread 0x1ff563 thru 0x2082c4 (0x8d62 bytes) 006000 1708839265.914644 read 0x0cda2f thru 0x0d931c (0xb8ee bytes) truncating to largest ever: 0x562229 008000 1708839271.757195 write 0x4a1cf4 thru 0x4b1071 (0xf37e bytes) 009000 1708839274.896926 mapread 0x108370 thru 0x116fa1 (0xec32 bytes) 010000 1708839277.977415 mapread 0x2f3457 thru 0x2fac09 (0x77b3 bytes) 011000 1708839280.631734 mapwrite 0x23d9ac thru 0x249a88 (0xc0dd bytes) 013000 1708839287.052219 mapwrite 0x458848 thru 0x46856a (0xfd23 bytes) 016000 1708839296.354490 read 0x4009e7 thru 0x409061 (0x867b bytes) 017000 1708839299.116821 mapread 0x16798e thru 0x16e53a (0x6bad bytes) 019000 1708839305.480316 mapread 0x0e9988 thru 0x0f4439 (0xaab2 bytes) 021000 1708839311.580655 write 0x45568e thru 0x456536 (0xea9 bytes) 022000 1708839314.695415 write 0x11b7fd thru 0x1201d7 (0x49db bytes) 026000 1708839326.850847 mapwrite 0x033649 thru 0x034bc8 (0x1580 bytes) 029000 1708839336.068394 write 0x3bf1e9 thru 0x3cc362 (0xd17a bytes) 031000 1708839342.486392 trunc from 0x438959 to 0x3c8452 (0x70506 bytes) 032000 1708839345.624427 mapwrite 0x2f828d thru 0x2fd842 (0x55b6 bytes) 033000 1708839348.544909 read 0x010198 thru 0x01458b (0x43f4 bytes) 036000 1708839357.770844 read 0x0c8dd9 thru 0x0d59bf (0xcbe7 bytes) 039000 1708839367.309957 mapwrite 0x44c36e thru 0x45467e (0x8311 bytes) 042000 1708839375.933190 trunc from 0x457ee3 to 0x3142d8 (0x143c0a bytes) 043000 1708839378.603465 trunc from 0x42786a to 0x352322 (0xd5547 bytes) 045000 1708839384.234753 write 0x371942 thru 0x378445 (0x6b04 bytes) 046000 1708839387.235447 mapwrite 0x4aae6c thru 0x4b76e2 (0xc877 bytes) 047000 1708839390.215198 mapread 0x125531 thru 0x133c52 (0xe722 bytes) 048000 1708839392.895670 mapread 0x07259b thru 0x079aa9 (0x750f bytes) 049000 1708839395.893472 read 0x50d53e thru 0x51aaae (0xd571 bytes) 050000 1708839398.462402 mapwrite 0x31bb71 thru 0x3272af (0xb73f bytes) 051000 1708839401.142019 trunc from 0x1b2b02 to 0x114761 (0x9e3a0 bytes) 052000 1708839404.279677 trunc from 0x4f0a58 to 0x1d71ff (0x319858 bytes) 053000 1708839407.217600 trunc from 0x520a3d to 0x048805 (0x4d8237 bytes) 054000 1708839410.778205 write 0x51105e thru 0x5125dd (0x1580 bytes) 057000 1708839420.028613 mapwrite 0x10bc65 thru 0x110769 (0x4b05 bytes) 059000 1708839426.157774 mapread 0x17e3d0 thru 0x188a94 (0xa6c5 bytes) 063000 1708839439.195787 trunc from 0x287cea to 0x31bd7f (0x94096 bytes) truncating to largest ever: 0x5624ed 066000 1708839448.448122 mapwrite 0x47b3b9 thru 0x48690e (0xb556 bytes) 068000 1708839454.274875 trunc from 0x2dca50 to 0x137e05 (0x1a4c4a bytes) 070000 1708839461.867730 trunc from 0x3240e8 to 0x0cfd09 (0x2543de bytes) 071000 1708839465.731003 read 0x495886 thru 0x4a4eaa (0xf625 bytes) 072000 1708839469.873861 mapread 0x1c94e2 thru 0x1d28fa (0x9419 bytes) 073000 1708839472.600194 mapread 0x2b414d thru 0x2b577d (0x1631 bytes) 074000 1708839476.376862 mapread 0x1a86dd thru 0x1b06b6 (0x7fda bytes) 077000 1708839489.019416 trunc from 0x1d77d6 to 0x04dc9f (0x189b36 bytes) truncating to largest ever: 0x5628ef 079000 1708839498.217746 mapread 0x2b7c91 thru 0x2bdc4b (0x5fbb bytes) 080000 1708839501.209587 read 0x0ded10 thru 0x0e69f8 (0x7ce9 bytes) 081000 1708839504.898902 mapwrite 0x51de33 thru 0x529a2a (0xbbf8 bytes) 082000 1708839508.252453 read 0x229314 thru 0x23152c (0x8219 bytes) 083000 1708839511.543242 write 0x0cd788 thru 0x0d68ad (0x9126 bytes) 084000 1708839515.189055 mapwrite 0x45e8a0 thru 0x46bf5d (0xd6be bytes) 088000 1708839530.359209 mapwrite 0x013068 thru 0x0196ec (0x6685 bytes) 089000 1708839534.798278 write 0x00d219 thru 0x00e441 (0x1229 bytes) 090000 1708839538.878753 write 0x37226c thru 0x37ce3a (0xabcf bytes) truncating to largest ever: 0x562b77 096000 1708839570.391620 write 0x43d777 thru 0x44cd19 (0xf5a3 bytes) 097000 1708839576.415039 write 0x329019 thru 0x332d40 (0x9d28 bytes) 098000 1708839581.071440 read 0x47178f thru 0x47243d (0xcaf bytes) 099000 1708839585.658862 mapwrite 0x5410f9 thru 0x54f9a4 (0xe8ac bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (347s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 00:39:53 (1708839593) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1708839609.018205 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1708839620.361282 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1708839626.601439 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1708839647.626067 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1708839653.451003 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1708839674.174255 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1708839680.175605 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1708839691.030299 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1708839702.147239 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1708839707.981771 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1708839719.681560 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1708839726.591199 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1708839748.470238 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1708839759.696631 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1708839778.506171 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1708839797.103364 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1708839803.192753 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1708839830.546814 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1708839837.677117 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1708839856.852352 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1708839862.848107 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1708839869.245782 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1708839887.989708 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1708839898.745454 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1708839910.082874 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1708839915.851438 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1708839976.314914 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1708839994.166342 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1708840001.214695 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1708840006.305284 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1708840012.527818 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1708840031.698897 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1708840037.429940 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1708840056.838156 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1708840063.668756 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1708840082.307878 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1708840102.156738 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1708840108.986588 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1708840128.016906 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1708840158.157841 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1708840163.230034 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1708840174.692668 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1708840188.810701 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (604s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1332 sec ===== 00:49:57 (1708840197) === sanity-benchmark: start cleanup 00:49:58 (1708840198) === === sanity-benchmark: finish cleanup 00:49:58 (1708840198) ===