-----============= acceptance-small: sanity-benchmark ============----- Tue Jan 7 10:22:45 EST 2025 excepting tests: skipping tests SLOW=no: iozone oleg428-client.virtnet: executing check_config_client /mnt/lustre oleg428-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg428-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b639f000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b639f000.idle_timeout=debug disable quota as required oleg428-server: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 10:23:03 (1736263383) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7485] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg428-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg428-client.virtnet at Tue Jan 7 10:23:04 EST 2025 waiting for dbench pid 9630 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 15 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 82 74.32 MB/sec warmup 1 sec latency 108.459 ms 20 182 73.53 MB/sec warmup 2 sec latency 102.699 ms 20 274 68.52 MB/sec warmup 3 sec latency 82.622 ms 20 355 63.68 MB/sec warmup 4 sec latency 117.233 ms 20 462 64.82 MB/sec warmup 5 sec latency 74.748 ms 20 632 69.61 MB/sec warmup 6 sec latency 119.081 ms 20 665 60.41 MB/sec warmup 7 sec latency 1016.512 ms 20 754 53.31 MB/sec warmup 8 sec latency 1126.306 ms 20 873 48.08 MB/sec warmup 9 sec latency 65.705 ms 20 966 43.60 MB/sec warmup 10 sec latency 71.582 ms 20 1128 41.77 MB/sec warmup 11 sec latency 50.023 ms 20 1240 38.45 MB/sec warmup 12 sec latency 47.957 ms 20 1420 40.00 MB/sec warmup 13 sec latency 83.571 ms 20 1511 37.22 MB/sec warmup 14 sec latency 83.626 ms 20 1629 34.89 MB/sec warmup 15 sec latency 54.957 ms 20 1728 32.81 MB/sec warmup 16 sec latency 68.875 ms 20 1820 30.97 MB/sec warmup 17 sec latency 91.945 ms 20 1940 29.37 MB/sec warmup 18 sec latency 58.631 ms 20 2038 27.96 MB/sec warmup 19 sec latency 54.391 ms 20 2158 26.70 MB/sec warmup 20 sec latency 56.748 ms 20 2339 26.51 MB/sec warmup 21 sec latency 55.590 ms 20 2426 25.53 MB/sec warmup 22 sec latency 61.479 ms 20 2567 25.14 MB/sec warmup 23 sec latency 55.170 ms 20 3013 29.38 MB/sec execute 1 sec latency 59.921 ms 20 3347 33.06 MB/sec execute 2 sec latency 57.513 ms 20 3609 42.99 MB/sec execute 3 sec latency 38.745 ms 20 3734 35.33 MB/sec execute 4 sec latency 58.804 ms 20 3821 30.68 MB/sec execute 5 sec latency 80.485 ms 20 3902 26.35 MB/sec execute 6 sec latency 64.860 ms 20 3961 22.77 MB/sec execute 7 sec latency 177.203 ms 20 4022 19.93 MB/sec execute 8 sec latency 105.659 ms 20 4089 17.76 MB/sec execute 9 sec latency 136.186 ms 20 4205 16.14 MB/sec execute 10 sec latency 112.017 ms 20 4277 14.99 MB/sec execute 11 sec latency 92.102 ms 20 4363 14.12 MB/sec execute 12 sec latency 202.881 ms 20 4457 13.39 MB/sec execute 13 sec latency 87.538 ms 20 4547 12.84 MB/sec execute 14 sec latency 64.926 ms 20 4682 13.32 MB/sec execute 15 sec latency 71.720 ms 20 4786 12.62 MB/sec execute 16 sec latency 59.248 ms 20 4941 14.82 MB/sec execute 17 sec latency 96.651 ms 20 5027 14.51 MB/sec execute 18 sec latency 103.412 ms 20 5111 13.81 MB/sec execute 19 sec latency 72.166 ms 20 5190 13.19 MB/sec execute 20 sec latency 67.685 ms 20 5285 12.64 MB/sec execute 21 sec latency 86.205 ms 20 5371 12.14 MB/sec execute 22 sec latency 65.948 ms 20 5462 11.67 MB/sec execute 23 sec latency 62.402 ms 20 5592 11.31 MB/sec execute 24 sec latency 48.099 ms 20 5707 10.97 MB/sec execute 25 sec latency 63.033 ms 20 5830 10.94 MB/sec execute 26 sec latency 68.045 ms 20 5949 11.10 MB/sec execute 27 sec latency 81.198 ms 20 6039 11.10 MB/sec execute 28 sec latency 60.935 ms 20 6194 11.57 MB/sec execute 29 sec latency 66.057 ms 20 6440 13.17 MB/sec execute 30 sec latency 75.752 ms 20 6581 13.31 MB/sec execute 31 sec latency 65.074 ms 20 6822 13.68 MB/sec execute 32 sec latency 81.170 ms 20 7002 14.49 MB/sec execute 33 sec latency 79.405 ms 20 7155 15.02 MB/sec execute 34 sec latency 54.044 ms 20 7261 14.85 MB/sec execute 35 sec latency 78.053 ms 20 7357 14.87 MB/sec execute 36 sec latency 86.223 ms 20 7423 14.51 MB/sec execute 37 sec latency 85.025 ms 20 7484 14.25 MB/sec execute 38 sec latency 135.096 ms 20 7549 13.88 MB/sec execute 39 sec latency 102.787 ms 20 7630 13.55 MB/sec execute 40 sec latency 93.206 ms 20 7736 13.25 MB/sec execute 41 sec latency 92.962 ms 20 7807 13.01 MB/sec execute 42 sec latency 185.057 ms 20 7881 12.79 MB/sec execute 43 sec latency 288.696 ms 20 7982 12.62 MB/sec execute 44 sec latency 73.596 ms 20 8074 12.43 MB/sec execute 45 sec latency 65.289 ms 20 8203 12.64 MB/sec execute 46 sec latency 65.399 ms 20 8319 12.42 MB/sec execute 47 sec latency 59.602 ms 20 8512 13.30 MB/sec execute 48 sec latency 56.237 ms 20 8618 13.14 MB/sec execute 49 sec latency 78.546 ms 20 8712 12.91 MB/sec execute 50 sec latency 58.686 ms 20 8810 12.69 MB/sec execute 51 sec latency 70.152 ms 20 8905 12.48 MB/sec execute 52 sec latency 70.639 ms 20 9008 12.28 MB/sec execute 53 sec latency 68.250 ms 20 9164 12.12 MB/sec execute 54 sec latency 42.222 ms 20 9293 11.96 MB/sec execute 55 sec latency 48.644 ms 20 9437 12.06 MB/sec execute 56 sec latency 55.808 ms 20 9536 12.03 MB/sec execute 57 sec latency 52.605 ms 20 9699 12.22 MB/sec execute 58 sec latency 55.121 ms 20 9978 13.20 MB/sec execute 59 sec latency 55.517 ms 20 10191 13.32 MB/sec execute 60 sec latency 54.063 ms 20 10477 13.86 MB/sec execute 61 sec latency 70.653 ms 20 10679 14.39 MB/sec execute 62 sec latency 42.963 ms 20 10803 14.34 MB/sec execute 63 sec latency 59.535 ms 20 10904 14.34 MB/sec execute 64 sec latency 76.403 ms 20 10989 14.17 MB/sec execute 65 sec latency 65.876 ms 20 11056 13.99 MB/sec execute 66 sec latency 161.836 ms 20 11125 13.79 MB/sec execute 67 sec latency 83.432 ms 20 11251 13.61 MB/sec execute 68 sec latency 70.960 ms 20 11359 13.46 MB/sec execute 69 sec latency 112.819 ms 20 11455 13.34 MB/sec execute 70 sec latency 54.475 ms 20 11548 13.21 MB/sec execute 71 sec latency 70.672 ms 20 11632 13.13 MB/sec execute 72 sec latency 168.886 ms 20 11760 13.20 MB/sec execute 73 sec latency 216.737 ms 20 11870 13.05 MB/sec execute 74 sec latency 70.852 ms 20 12043 13.52 MB/sec execute 75 sec latency 69.133 ms 20 12162 13.50 MB/sec execute 76 sec latency 74.813 ms 20 12261 13.35 MB/sec execute 77 sec latency 52.124 ms 20 12361 13.20 MB/sec execute 78 sec latency 67.439 ms 20 12450 13.05 MB/sec execute 79 sec latency 70.767 ms 20 12552 12.91 MB/sec execute 80 sec latency 56.650 ms 20 12689 12.79 MB/sec execute 81 sec latency 44.676 ms 20 12824 12.67 MB/sec execute 82 sec latency 50.392 ms 20 12994 12.77 MB/sec execute 83 sec latency 58.005 ms 20 13088 12.73 MB/sec execute 84 sec latency 59.129 ms 20 13206 12.73 MB/sec execute 85 sec latency 68.130 ms 20 13429 13.26 MB/sec execute 86 sec latency 67.685 ms 20 13633 13.50 MB/sec execute 87 sec latency 70.132 ms 20 13910 13.63 MB/sec execute 88 sec latency 67.793 ms 20 14116 14.01 MB/sec execute 89 sec latency 56.062 ms 20 14275 14.19 MB/sec execute 90 sec latency 44.633 ms 20 14393 14.20 MB/sec execute 91 sec latency 70.442 ms 20 14485 14.13 MB/sec execute 92 sec latency 68.421 ms 20 14577 14.04 MB/sec execute 93 sec latency 59.914 ms 20 14635 13.89 MB/sec execute 94 sec latency 152.493 ms 20 14710 13.75 MB/sec execute 95 sec latency 82.735 ms 20 14815 13.62 MB/sec execute 96 sec latency 74.191 ms 20 14922 13.52 MB/sec execute 97 sec latency 90.523 ms 20 15008 13.43 MB/sec execute 98 sec latency 66.812 ms 20 15113 13.35 MB/sec execute 99 sec latency 73.675 ms 20 15231 13.35 MB/sec execute 100 sec latency 47.297 ms 20 15375 13.34 MB/sec execute 101 sec latency 59.809 ms 20 15525 13.46 MB/sec execute 102 sec latency 54.663 ms 20 15693 13.67 MB/sec execute 103 sec latency 72.046 ms 20 15801 13.56 MB/sec execute 104 sec latency 55.733 ms 20 15900 13.44 MB/sec execute 105 sec latency 75.945 ms 20 15995 13.33 MB/sec execute 106 sec latency 66.657 ms 20 16104 13.22 MB/sec execute 107 sec latency 47.576 ms 20 16252 13.13 MB/sec execute 108 sec latency 50.591 ms 20 16419 13.10 MB/sec execute 109 sec latency 39.979 ms 20 16580 13.15 MB/sec execute 110 sec latency 44.896 ms 20 16716 13.17 MB/sec execute 111 sec latency 44.855 ms 20 16967 13.56 MB/sec execute 112 sec latency 51.147 ms 20 17231 13.82 MB/sec execute 113 sec latency 54.048 ms 20 17497 13.94 MB/sec execute 114 sec latency 52.194 ms 20 17761 14.40 MB/sec execute 115 sec latency 46.371 ms 20 17920 14.40 MB/sec execute 116 sec latency 44.479 ms 20 18050 14.39 MB/sec execute 117 sec latency 49.140 ms 20 18160 14.31 MB/sec execute 118 sec latency 56.759 ms 20 18248 14.19 MB/sec execute 119 sec latency 67.000 ms 20 cleanup 120 sec 1 cleanup 121 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 54019 26.001 177.197 Close 38819 6.448 46.637 Rename 2244 33.567 107.914 Unlink 11429 8.317 55.606 Qpathinfo 48713 5.433 92.949 Qfileinfo 8266 0.135 18.883 Qfsinfo 9199 0.090 27.589 Sfileinfo 4022 19.683 76.319 Find 18949 1.268 77.867 WriteX 26227 3.563 59.374 ReadX 85010 0.017 10.358 LockX 181 6.068 18.631 UnlockX 183 6.297 15.134 Flush 3630 29.109 288.689 Throughput 14.1876 MB/sec 20 clients 20 procs max_latency=288.696 ms stopping dbench on /mnt/lustre/d0.oleg428-client.virtnet at Tue Jan 7 10:25:30 EST 2025 with return code 0 clean dbench files on /mnt/lustre/d0.oleg428-client.virtnet /mnt/lustre/d0.oleg428-client.virtnet /mnt/lustre/d0.oleg428-client.virtnet removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg428-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (153s) == sanity-benchmark test bonnie: bonnie++ ================ 10:25:35 (1736263535) min OST has 3546628kB available, using 5319942kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7485] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5195] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg428-clien 5195M 113301 72 98667 75 178952 35 1744 190 Latency 13851us 94755us 115ms 15132us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg428-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 238 19 1782 15 306 15 194 18 243 16 375 15 Latency 29401us 14356us 38472us 28470us 21311us 30776us 1.97,1.97,oleg428-client.virtnet,1,1736273557,5195M,,,,113301,72,98667,75,,,178952,35,1744,190,10,,,,,238,19,1782,15,306,15,194,18,243,16,375,15,,13851us,94755us,,115ms,15132us,29401us,14356us,38472us,28470us,21311us,30776us debug=0x33f0484 PASS bonnie (346s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 10:31:21 (1736263881) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 10348 -P /tmp -l 5408064 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 10348 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero length punch hole skipping zero length punch hole truncating to largest ever: 0x36bd86 fallocating to largest ever: 0x48d2c2 fallocating to largest ever: 0x4e3a54 truncating to largest ever: 0x51c1e1 fallocating to largest ever: 0x51fc0d fallocating to largest ever: 0x528540 001000 1736263887.072788 punch from 0x25b8ec to 0x2694b2 (0xdbc7 bytes) 002000 1736263892.263279 trunc from 0x3f367b to 0x30d83d (0xe5e3d bytes) 003000 1736263896.597421 punch from 0x29a828 to 0x29f927 (0x5100 bytes) 004000 1736263899.467173 mapread 0x3f1523 thru 0x400d5a (0xf838 bytes) 005000 1736263902.959502 mapread 0x2b7134 thru 0x2c6427 (0xf2f4 bytes) 007000 1736263911.938762 punch from 0x12f8c0 to 0x130b15 (0x1256 bytes) 009000 1736263919.879440 read 0x0a6a04 thru 0x0b38f2 (0xceef bytes) 012000 1736263930.969432 write 0x00b4b3 thru 0x012a7d (0x75cb bytes) 013000 1736263934.236204 write 0x4ea8c7 thru 0x4f541a (0xab54 bytes) 014000 1736263938.253370 read 0x205987 thru 0x215701 (0xfd7b bytes) 015000 1736263942.516705 write 0x014591 thru 0x01570e (0x117e bytes) 016000 1736263947.738480 fallocate 0x3dd9ac thru 0x3e0e48 (0x349d bytes) 017000 1736263952.465967 fallocate 0x1f1dfa thru 0x1f4f55 (0x315c bytes) 019000 1736263961.528574 mapread 0x0f07de thru 0x0fc3fa (0xbc1d bytes) 020000 1736263965.747275 read 0x36a68e thru 0x378ac8 (0xe43b bytes) 022000 1736263974.491604 fallocate 0x50e00f thru 0x50eca8 (0xc9a bytes) 023000 1736263979.388414 mapread 0x2d72c0 thru 0x2e6bf5 (0xf936 bytes) 026000 1736263994.004905 mapread 0x121810 thru 0x12d807 (0xbff8 bytes) 029000 1736264004.689472 fallocate 0x319a89 thru 0x329689 (0xfc01 bytes) 030000 1736264007.948497 write 0x463bc3 thru 0x471fda (0xe418 bytes) 031000 1736264012.231626 punch from 0x12c2e1 to 0x13a88f (0xe5af bytes) 032000 1736264017.137202 punch from 0x09eed9 to 0x0a1e37 (0x2f5f bytes) 033000 1736264021.757152 trunc from 0x435587 to 0x05c30e (0x3d9278 bytes) 035000 1736264030.699343 write 0x4a07bb thru 0x4ab615 (0xae5b bytes) 037000 1736264038.908626 punch from 0x480ae9 to 0x489e30 (0x9348 bytes) 038000 1736264042.928020 trunc from 0x4db2ec to 0x0f74db (0x3e3e10 bytes) 039000 1736264047.597056 write 0x31f51e thru 0x327af7 (0x85da bytes) 040000 1736264051.621026 trunc from 0x464cd5 to 0x0fe027 (0x366cad bytes) 041000 1736264055.523015 read 0x436ede thru 0x44018c (0x92af bytes) 042000 1736264059.956574 write 0x13c77c thru 0x145d42 (0x95c7 bytes) 043000 1736264065.065602 mapread 0x3904b6 thru 0x39daab (0xd5f6 bytes) 044000 1736264069.912854 write 0x47d75a thru 0x486596 (0x8e3d bytes) 046000 1736264079.437215 mapwrite 0x0251f7 thru 0x02e41d (0x9227 bytes) 047000 1736264083.811204 write 0x308e39 thru 0x30bb64 (0x2d2c bytes) 048000 1736264088.674747 mapread 0x09b7ff thru 0x09e014 (0x2816 bytes) 049000 1736264093.336911 mapread 0x11a3d0 thru 0x11d24c (0x2e7d bytes) 050000 1736264097.663236 mapwrite 0x03b042 thru 0x03d306 (0x22c5 bytes) 051000 1736264102.020825 read 0x13ebcc thru 0x14c88d (0xdcc2 bytes) 053000 1736264111.338348 write 0x47e712 thru 0x4835d5 (0x4ec4 bytes) 054000 1736264116.416744 read 0x06b503 thru 0x078a2d (0xd52b bytes) 055000 1736264120.956212 fallocate 0x0c53fb thru 0x0d12c3 (0xbec9 bytes) 057000 1736264129.419068 trunc from 0x50bf73 to 0x1aa1b2 (0x361dc0 bytes) 058000 1736264134.113729 mapread 0x228d46 thru 0x2318a5 (0x8b60 bytes) 060000 1736264142.683918 mapread 0x0215db thru 0x0245cf (0x2ff5 bytes) 061000 1736264147.411221 read 0x0614bb thru 0x063ba8 (0x26ee bytes) 063000 1736264155.801988 write 0x14cdcc thru 0x1586eb (0xb920 bytes) 064000 1736264160.572462 punch from 0x21cfef to 0x22865a (0xb66c bytes) 066000 1736264169.280569 punch from 0x291c01 to 0x295a2f (0x3e2f bytes) 068000 1736264179.669879 fallocate 0x1124ab thru 0x1193be (0x6f14 bytes) 069000 1736264183.243863 read 0x3fb698 thru 0x3ff3f7 (0x3d60 bytes) 070000 1736264187.360165 read 0x30d7d4 thru 0x31cc2d (0xf45a bytes) 071000 1736264191.185796 write 0x0cdd10 thru 0x0da449 (0xc73a bytes) 072000 1736264195.708816 fallocate 0x324c7f thru 0x32b71f (0x6aa1 bytes) 073000 1736264199.132264 write 0x41690b thru 0x421a7b (0xb171 bytes) 074000 1736264202.346045 fallocate 0x3f0948 thru 0x3f7685 (0x6d3e bytes) 075000 1736264205.595875 write 0x3d903e thru 0x3ddf55 (0x4f18 bytes) 077000 1736264212.990837 punch from 0x176d0f to 0x183517 (0xc809 bytes) 078000 1736264216.684972 mapread 0x26bec8 thru 0x276e9a (0xafd3 bytes) 079000 1736264220.098993 fallocate 0x0a257f thru 0x0aac0e (0x8690 bytes) 081000 1736264226.769901 trunc from 0x504f56 to 0x15cc72 (0x3a82e3 bytes) 082000 1736264230.075574 trunc from 0x2322f5 to 0x1b1f86 (0x8036e bytes) 083000 1736264233.158903 trunc from 0x42c8b3 to 0x14ef30 (0x2dd982 bytes) 084000 1736264235.964779 fallocate 0x1ee91e thru 0x1f5c64 (0x7347 bytes) 086000 1736264243.377657 trunc from 0x416b37 to 0x2aa7b5 (0x16c381 bytes) 087000 1736264246.499942 fallocate 0x0b7499 thru 0x0c5c46 (0xe7ae bytes) 088000 1736264249.828366 punch from 0x040de0 to 0x042e22 (0x2043 bytes) 089000 1736264253.349254 punch from 0x0714d4 to 0x080a40 (0xf56d bytes) 090000 1736264256.087835 fallocate 0x43cd1c thru 0x449a07 (0xccec bytes) 091000 1736264258.733701 punch from 0x50e26d to 0x514bd7 (0x696b bytes) 092000 1736264261.181557 trunc from 0x2a6c22 to 0x470338 (0x1c9717 bytes) 094000 1736264267.503359 fallocate 0x04bdf7 thru 0x053dac (0x7fb6 bytes) 096000 1736264275.142177 trunc from 0x32f508 to 0x18c7db (0x1a2d2c bytes) 097000 1736264279.261305 read 0x09e73e thru 0x0a9393 (0xac56 bytes) 098000 1736264283.085460 read 0x4f04df thru 0x4f0a54 (0x576 bytes) 099000 1736264286.047561 trunc from 0x277980 to 0x36d185 (0xf5806 bytes) 100000 1736264288.892195 write 0x179404 thru 0x187a37 (0xe634 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (408s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 10:38:10 (1736264290) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1736264293.950302 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1736264297.118247 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1736264308.849444 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1736264311.746129 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1736264314.753018 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1736264317.900524 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1736264320.781115 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1736264326.551640 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1736264329.271206 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1736264334.486984 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1736264337.436642 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1736264342.916206 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1736264345.187556 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1736264350.284943 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1736264352.696594 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1736264355.007599 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1736264357.734899 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1736264360.177505 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1736264363.086695 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1736264365.904720 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1736264368.779371 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1736264374.651454 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1736264377.552971 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1736264380.624618 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1736264383.634192 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1736264386.698253 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1736264389.812952 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1736264392.985065 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1736264395.954208 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1736264399.040598 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1736264401.702293 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1736264404.568879 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1736264409.893956 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1736264413.216574 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1736264416.024869 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1736264418.948487 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1736264428.753629 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1736264431.549179 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1736264434.606836 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1736264437.769171 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1736264440.583222 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1736264443.182910 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1736264449.491800 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1736264452.189125 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1736264455.940167 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1736264467.932539 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1736264474.192036 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1736264476.962510 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1736264479.654349 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1736264485.276238 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1736264491.690218 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1736264495.095980 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1736264498.337116 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1736264504.229275 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1736264506.875098 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1736264509.821368 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1736264512.513741 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1736264515.698576 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1736264519.196422 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1736264526.075345 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1736264534.059960 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1736264536.941664 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1736264539.627600 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1736264542.836483 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1736264547.863188 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1736264553.433893 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1736264559.176539 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1736264561.704085 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1736264564.447152 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1736264567.141783 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1736264569.971078 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1736264576.328041 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1736264579.037473 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1736264581.813773 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1736264587.657277 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (298s) == sanity-benchmark test complete, duration 1222 sec ===== 10:43:08 (1736264588)