-----============= acceptance-small: sanity-benchmark ============----- Wed May 8 17:13:36 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg359-client.virtnet: executing check_config_client /mnt/lustre oleg359-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg359-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b0090000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b0090000.idle_timeout=debug disable quota as required oleg359-server: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 17:13:45 (1715202825) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6856] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg359-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg359-client.virtnet at Wed May 8 17:13:46 EDT 2024 waiting for dbench pid 8785 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 193 153.46 MB/sec warmup 1 sec latency 108.837 ms 20 382 135.97 MB/sec warmup 2 sec latency 53.488 ms 20 596 136.37 MB/sec warmup 3 sec latency 85.235 ms 20 731 106.51 MB/sec warmup 4 sec latency 207.683 ms 20 881 86.66 MB/sec warmup 5 sec latency 116.509 ms 20 1082 76.39 MB/sec warmup 6 sec latency 152.666 ms 20 1378 72.61 MB/sec warmup 7 sec latency 475.313 ms 20 1515 64.49 MB/sec warmup 8 sec latency 1475.854 ms 20 1598 57.50 MB/sec warmup 9 sec latency 2475.944 ms 20 1698 52.26 MB/sec warmup 10 sec latency 3476.020 ms 20 1837 49.11 MB/sec warmup 11 sec latency 4476.105 ms 20 2010 46.93 MB/sec warmup 12 sec latency 5476.237 ms 20 2187 45.51 MB/sec warmup 13 sec latency 6476.377 ms 20 2311 43.26 MB/sec warmup 14 sec latency 7476.475 ms 20 2426 40.94 MB/sec warmup 15 sec latency 8476.584 ms 20 2522 38.74 MB/sec warmup 16 sec latency 9476.683 ms 20 2616 37.03 MB/sec warmup 17 sec latency 10476.925 ms 20 2714 35.49 MB/sec warmup 18 sec latency 11477.043 ms 20 2814 34.39 MB/sec warmup 19 sec latency 12477.151 ms 20 2903 33.25 MB/sec warmup 20 sec latency 13477.398 ms 20 2993 31.88 MB/sec warmup 21 sec latency 14477.566 ms 20 3059 30.68 MB/sec warmup 22 sec latency 15477.667 ms 20 3141 29.61 MB/sec warmup 23 sec latency 16477.791 ms 20 3410 20.65 MB/sec execute 1 sec latency 18478.206 ms 20 3520 17.21 MB/sec execute 2 sec latency 19478.333 ms 20 3616 15.71 MB/sec execute 3 sec latency 20478.452 ms 20 3689 13.47 MB/sec execute 4 sec latency 21478.585 ms 20 3766 11.54 MB/sec execute 5 sec latency 22478.668 ms 20 3841 10.49 MB/sec execute 6 sec latency 23478.846 ms 20 3921 10.02 MB/sec execute 7 sec latency 24478.938 ms 20 4029 10.69 MB/sec execute 8 sec latency 25479.061 ms 20 4117 10.34 MB/sec execute 9 sec latency 26479.235 ms 20 4224 10.77 MB/sec execute 10 sec latency 27479.345 ms 20 4287 10.05 MB/sec execute 11 sec latency 28479.643 ms 20 4368 9.72 MB/sec execute 12 sec latency 29479.888 ms 20 4464 9.91 MB/sec execute 13 sec latency 30480.135 ms 20 4549 9.83 MB/sec execute 14 sec latency 31480.218 ms 20 4650 9.88 MB/sec execute 15 sec latency 32480.359 ms 20 4745 10.01 MB/sec execute 16 sec latency 33480.489 ms 20 4845 9.91 MB/sec execute 17 sec latency 34480.571 ms 20 4943 10.00 MB/sec execute 18 sec latency 35481.089 ms 20 5034 9.98 MB/sec execute 19 sec latency 36481.646 ms 20 5140 10.25 MB/sec execute 20 sec latency 37481.843 ms 20 5240 10.41 MB/sec execute 21 sec latency 38481.919 ms 20 5323 10.25 MB/sec execute 22 sec latency 39482.045 ms 20 5399 10.21 MB/sec execute 23 sec latency 40482.130 ms 20 5466 9.88 MB/sec execute 24 sec latency 41482.225 ms 20 5547 9.80 MB/sec execute 25 sec latency 42482.406 ms 20 5641 9.90 MB/sec execute 26 sec latency 43482.536 ms 20 5726 10.01 MB/sec execute 27 sec latency 44482.644 ms 20 5817 9.88 MB/sec execute 28 sec latency 45482.722 ms 20 5895 9.81 MB/sec execute 29 sec latency 46482.834 ms 20 5978 9.85 MB/sec execute 30 sec latency 47483.254 ms 20 6055 9.74 MB/sec execute 31 sec latency 48483.508 ms 20 6145 9.85 MB/sec execute 32 sec latency 49483.635 ms 20 6247 9.96 MB/sec execute 33 sec latency 50483.753 ms 20 6330 9.97 MB/sec execute 34 sec latency 51484.088 ms 20 6394 9.79 MB/sec execute 35 sec latency 52484.161 ms 20 6452 9.57 MB/sec execute 36 sec latency 53485.024 ms 20 6509 9.40 MB/sec execute 37 sec latency 54485.237 ms 20 6600 9.45 MB/sec execute 38 sec latency 55485.325 ms 20 6691 9.51 MB/sec execute 39 sec latency 56485.403 ms 20 6757 9.46 MB/sec execute 40 sec latency 57485.716 ms 20 6841 9.45 MB/sec execute 41 sec latency 58485.793 ms 20 6945 9.52 MB/sec execute 42 sec latency 59485.948 ms 20 7016 9.48 MB/sec execute 43 sec latency 60486.072 ms 20 7090 9.43 MB/sec execute 44 sec latency 61486.168 ms 20 7180 9.45 MB/sec execute 45 sec latency 62486.288 ms 20 7263 9.39 MB/sec execute 46 sec latency 63486.378 ms 20 7342 9.34 MB/sec execute 47 sec latency 64486.542 ms 20 7431 9.31 MB/sec execute 48 sec latency 65486.681 ms 20 7518 9.39 MB/sec execute 49 sec latency 66486.816 ms 20 7623 9.43 MB/sec execute 50 sec latency 67486.936 ms 20 7731 9.56 MB/sec execute 51 sec latency 68487.046 ms 20 7833 9.60 MB/sec execute 52 sec latency 69487.140 ms 20 7932 9.59 MB/sec execute 53 sec latency 70487.227 ms 20 8036 9.60 MB/sec execute 54 sec latency 71487.303 ms 20 8147 9.62 MB/sec execute 55 sec latency 72487.374 ms 20 8246 9.62 MB/sec execute 56 sec latency 73487.468 ms 20 8340 9.57 MB/sec execute 57 sec latency 74487.560 ms 20 8474 9.71 MB/sec execute 58 sec latency 75487.724 ms 20 8589 9.80 MB/sec execute 59 sec latency 76487.828 ms 20 8685 9.78 MB/sec execute 60 sec latency 77487.898 ms 20 8782 9.75 MB/sec execute 61 sec latency 78487.992 ms 20 8872 9.65 MB/sec execute 62 sec latency 79488.087 ms 20 8956 9.62 MB/sec execute 63 sec latency 80488.273 ms 20 9092 9.76 MB/sec execute 64 sec latency 81488.370 ms 20 9218 9.85 MB/sec execute 65 sec latency 82488.508 ms 20 9320 9.97 MB/sec execute 66 sec latency 83488.687 ms 20 9399 9.88 MB/sec execute 67 sec latency 84488.764 ms 20 9493 9.86 MB/sec execute 68 sec latency 85489.365 ms 20 9574 9.79 MB/sec execute 69 sec latency 86489.502 ms 20 9678 9.85 MB/sec execute 70 sec latency 87489.706 ms 20 9777 9.93 MB/sec execute 71 sec latency 88489.814 ms 20 9860 9.91 MB/sec execute 72 sec latency 89489.938 ms 20 9932 9.89 MB/sec execute 73 sec latency 90490.182 ms 20 10005 9.79 MB/sec execute 74 sec latency 91490.311 ms 20 10079 9.74 MB/sec execute 75 sec latency 92490.396 ms 20 10162 9.69 MB/sec execute 76 sec latency 93490.498 ms 20 10246 9.69 MB/sec execute 77 sec latency 94490.614 ms 20 10349 9.77 MB/sec execute 78 sec latency 95490.704 ms 20 10436 9.79 MB/sec execute 79 sec latency 96490.809 ms 20 10526 9.80 MB/sec execute 80 sec latency 97491.112 ms 20 10614 9.77 MB/sec execute 81 sec latency 98491.208 ms 20 10699 9.73 MB/sec execute 82 sec latency 99491.286 ms 20 10808 9.79 MB/sec execute 83 sec latency 100491.373 ms 20 10911 9.79 MB/sec execute 84 sec latency 101491.630 ms 20 11011 9.81 MB/sec execute 85 sec latency 102491.746 ms 20 11108 9.78 MB/sec execute 86 sec latency 103491.883 ms 20 11215 9.78 MB/sec execute 87 sec latency 104491.965 ms 20 11317 9.80 MB/sec execute 88 sec latency 105492.059 ms 20 11416 9.80 MB/sec execute 89 sec latency 106492.162 ms 20 11504 9.75 MB/sec execute 90 sec latency 107492.264 ms 20 11641 9.82 MB/sec execute 91 sec latency 108492.503 ms 20 11758 9.88 MB/sec execute 92 sec latency 109492.596 ms 20 11887 10.02 MB/sec execute 93 sec latency 110492.744 ms 20 11994 10.05 MB/sec execute 94 sec latency 111492.827 ms 20 12114 10.08 MB/sec execute 95 sec latency 112492.973 ms 20 12203 10.08 MB/sec execute 96 sec latency 113493.142 ms 20 12292 10.06 MB/sec execute 97 sec latency 114493.434 ms 20 12385 10.08 MB/sec execute 98 sec latency 115493.525 ms 20 12499 10.10 MB/sec execute 99 sec latency 116493.620 ms 20 12595 10.09 MB/sec execute 100 sec latency 117493.844 ms 20 12674 10.05 MB/sec execute 101 sec latency 118493.928 ms 20 12779 10.03 MB/sec execute 102 sec latency 119494.006 ms 20 12893 10.04 MB/sec execute 103 sec latency 120494.098 ms 20 13025 10.08 MB/sec execute 104 sec latency 121494.179 ms 20 13137 10.13 MB/sec execute 105 sec latency 122494.252 ms 20 13259 10.20 MB/sec execute 106 sec latency 123494.321 ms 20 13394 10.26 MB/sec execute 107 sec latency 124494.461 ms 20 13509 10.30 MB/sec execute 108 sec latency 125494.567 ms 20 13597 10.29 MB/sec execute 109 sec latency 126494.709 ms 20 13687 10.26 MB/sec execute 110 sec latency 127494.835 ms 20 13776 10.22 MB/sec execute 111 sec latency 128494.990 ms 20 13870 10.23 MB/sec execute 112 sec latency 129495.080 ms 20 13955 10.20 MB/sec execute 113 sec latency 130495.186 ms 20 14041 10.16 MB/sec execute 114 sec latency 131495.277 ms 20 14141 10.15 MB/sec execute 115 sec latency 132495.564 ms 20 14238 10.16 MB/sec execute 116 sec latency 133495.654 ms 20 14353 10.16 MB/sec execute 117 sec latency 134495.747 ms 20 14508 10.26 MB/sec execute 118 sec latency 135495.831 ms 20 14607 10.29 MB/sec execute 119 sec latency 136495.905 ms 20 cleanup 120 sec 10 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 39580 20.377 138864.180 Close 29110 47.983 139179.522 Rename 1678 17.570 7422.185 Unlink 7973 26.675 139141.346 Qpathinfo 35890 1.150 32.218 Qfileinfo 6275 0.047 2.280 Qfsinfo 6600 0.030 2.073 Sfileinfo 3204 11.190 1131.259 Find 13959 0.245 13.332 WriteX 19564 0.530 11.055 ReadX 62459 0.011 1.472 LockX 130 4.587 127.656 UnlockX 130 5.748 72.534 Flush 2752 26.614 115.040 Throughput 10.2884 MB/sec 20 clients 20 procs max_latency=136495.905 ms stopping dbench on /mnt/lustre/d0.oleg359-client.virtnet at Wed May 8 17:16:12 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg359-client.virtnet /mnt/lustre/d0.oleg359-client.virtnet /mnt/lustre/d0.oleg359-client.virtnet removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg359-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) == sanity-benchmark test bonnie: bonnie++ ================ 17:16:14 (1715202974) min OST has 3382272kB available, using 5073408kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6856] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4954] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg359-clien 4954M 154590 98 136986 98 183145 40 1153 133 Latency 2407us 31694us 86192us 320ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg359-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 283 17 3559 17 658 12 360 18 284 16 454 14 Latency 19619us 8322us 92469us 15518us 13803us 21668us 1.97,1.97,oleg359-client.virtnet,1,1715192735,4954M,,,,154590,98,136986,98,,,183145,40,1153,133,10,,,,,283,17,3559,17,658,12,360,18,284,16,454,14,,2407us,31694us,,86192us,320ms,19619us,8322us,92469us,15518us,13803us,21668us debug=0x33f0484 PASS bonnie (251s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 17:20:26 (1715203226) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 11166 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 11166 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x239b57 truncating to largest ever: 0x482c93 truncating to largest ever: 0x504b94 truncating to largest ever: 0x5113e6 truncating to largest ever: 0x553ed2 truncating to largest ever: 0x5619b7 001000 1715203232.448514 write 0x504db3 thru 0x509d1f (0x4f6d bytes) 003000 1715203242.201569 read 0x19e269 thru 0x1a42f5 (0x608d bytes) 004000 1715203246.251242 mapwrite 0x237c5b thru 0x244211 (0xc5b7 bytes) 006000 1715203255.185151 read 0x0bdbd8 thru 0x0c6973 (0x8d9c bytes) 007000 1715203259.162166 write 0x4cbb1e thru 0x4d9701 (0xdbe4 bytes) 009000 1715203267.194964 read 0x2afb82 thru 0x2b3842 (0x3cc1 bytes) 010000 1715203271.675466 mapwrite 0x0823ac thru 0x08465f (0x22b4 bytes) 011000 1715203276.279333 write 0x281962 thru 0x290204 (0xe8a3 bytes) 014000 1715203289.390122 write 0x130d3f thru 0x1386d3 (0x7995 bytes) 016000 1715203298.553066 mapread 0x0075f9 thru 0x00eeab (0x78b3 bytes) truncating to largest ever: 0x5626f6 017000 1715203302.596460 mapread 0x295dea thru 0x29aa22 (0x4c39 bytes) 018000 1715203307.755797 read 0x0d54d7 thru 0x0d8235 (0x2d5f bytes) truncating to largest ever: 0x562834 024000 1715203332.168173 mapread 0x13bca2 thru 0x1405ad (0x490c bytes) 025000 1715203336.393746 mapread 0x233852 thru 0x236aa9 (0x3258 bytes) truncating to largest ever: 0x562a0b 026000 1715203340.354489 read 0x409c6b thru 0x41972e (0xfac4 bytes) 027000 1715203344.857454 read 0x18e9e6 thru 0x19a8ab (0xbec6 bytes) 028000 1715203349.034263 write 0x425a71 thru 0x4285ab (0x2b3b bytes) 030000 1715203357.710051 mapwrite 0x03043f thru 0x036b9d (0x675f bytes) 033000 1715203370.195877 mapread 0x0bcf77 thru 0x0c4287 (0x7311 bytes) 034000 1715203374.507048 mapwrite 0x53ad39 thru 0x5444c3 (0x978b bytes) 036000 1715203383.974205 write 0x4a211b thru 0x4ab3e2 (0x92c8 bytes) 037000 1715203388.398815 mapread 0x0b136f thru 0x0b619a (0x4e2c bytes) 039000 1715203398.019368 mapread 0x3e098e thru 0x3e83a0 (0x7a13 bytes) 041000 1715203407.383931 write 0x38937c thru 0x38aba5 (0x182a bytes) 042000 1715203410.835643 mapwrite 0x14bed8 thru 0x155951 (0x9a7a bytes) 044000 1715203419.216537 mapwrite 0x4302b4 thru 0x4379a4 (0x76f1 bytes) 049000 1715203438.724937 read 0x094cca thru 0x0984fb (0x3832 bytes) skipping zero size write 052000 1715203450.539627 read 0x12f41c thru 0x137eae (0x8a93 bytes) 053000 1715203454.930248 trunc from 0x4496a5 to 0x307f9c (0x141708 bytes) 054000 1715203458.464903 write 0x3952ed thru 0x3a2877 (0xd58b bytes) 056000 1715203465.662264 trunc from 0x4f4610 to 0x3a55ba (0x14f055 bytes) truncating to largest ever: 0x562d63 058000 1715203473.827797 write 0x3bf677 thru 0x3cba6b (0xc3f5 bytes) 059000 1715203477.706544 read 0x176b6b thru 0x181268 (0xa6fe bytes) 061000 1715203485.526132 trunc from 0x3d2c73 to 0x42b942 (0x58cd0 bytes) 062000 1715203488.874698 trunc from 0x4d2b42 to 0x55dc1f (0x8b0de bytes) 064000 1715203496.127601 read 0x032800 thru 0x0364c2 (0x3cc3 bytes) 065000 1715203500.237329 trunc from 0x535e48 to 0x48cffe (0xa8e49 bytes) 068000 1715203512.474181 mapread 0x04517b thru 0x0456e3 (0x569 bytes) 073000 1715203530.279509 mapwrite 0x26ea72 thru 0x2782da (0x9869 bytes) 074000 1715203533.372493 trunc from 0x538865 to 0x26fa64 (0x2c8e00 bytes) 075000 1715203536.232607 mapwrite 0x416cf9 thru 0x41c95e (0x5c66 bytes) 079000 1715203549.610740 write 0x3cd813 thru 0x3dd4d1 (0xfcbf bytes) 081000 1715203557.145397 mapwrite 0x1ed0ef thru 0x1ef5b4 (0x24c6 bytes) 082000 1715203560.840678 trunc from 0x558d03 to 0x2975f2 (0x2c1710 bytes) 083000 1715203564.515713 mapwrite 0x0444df thru 0x04bbec (0x770e bytes) 086000 1715203576.085650 read 0x37714a thru 0x3782b8 (0x116f bytes) 089000 1715203586.254468 trunc from 0x3120d4 to 0x136de8 (0x1db2eb bytes) 090000 1715203589.919828 mapread 0x0dcedd thru 0x0ec19d (0xf2c1 bytes) 091000 1715203593.358303 mapwrite 0x367f39 thru 0x36efd8 (0x70a0 bytes) 094000 1715203606.172047 trunc from 0x518236 to 0x41a8d7 (0xfd95e bytes) 096000 1715203614.697056 mapread 0x2d4415 thru 0x2d53c7 (0xfb3 bytes) 097000 1715203618.669008 mapread 0x3b5b44 thru 0x3c144f (0xb90c bytes) 099000 1715203626.078342 mapread 0x27c06f thru 0x28215b (0x60ed bytes) 100000 1715203629.728916 mapwrite 0x4a071f thru 0x4a2236 (0x1b18 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (404s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 17:27:10 (1715203630) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1715203642.307793 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1715203645.069906 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1715203651.798755 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1715203655.835810 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1715203659.552481 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1715203681.597870 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1715203684.793035 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1715203688.595525 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1715203696.468800 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1715203700.336010 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1715203703.851732 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1715203711.462890 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1715203715.162912 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1715203722.587153 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1715203726.200894 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1715203729.426954 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1715203735.623703 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1715203739.330481 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1715203750.479883 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1715203764.805087 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1715203768.154916 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1715203771.753404 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1715203775.256739 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1715203778.948698 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1715203800.531933 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1715203804.190039 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1715203810.648846 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1715203824.625870 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1715203838.045644 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1715203845.697184 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1715203849.172070 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1715203856.170657 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1715203863.726579 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1715203871.281535 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1715203874.963568 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1715203878.632874 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1715203893.200788 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1715203896.760470 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1715203899.931570 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1715203907.069995 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1715203913.919629 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1715203917.772879 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1715203930.010962 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1715203937.276841 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1715203940.894342 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1715203944.582271 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1715203947.795271 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1715203951.550610 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1715203955.214790 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1715203958.590408 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1715203975.830563 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1715203979.453788 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1715203986.473351 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (360s) == sanity-benchmark test complete, duration 1173 sec ===== 17:33:10 (1715203990)