-----============= acceptance-small: sanity-benchmark ============----- Wed May 29 17:22:41 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg335-client.virtnet: executing check_config_client /mnt/lustre oleg335-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg335-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a56b800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a56b800.idle_timeout=debug disable quota as required oleg335-server: oleg335-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 17:23:01 (1717017781) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7456] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg335-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg335-client.virtnet at Wed May 29 17:23:03 EDT 2024 waiting for dbench pid 9604 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 20 of 20 processes prepared for launch 0 sec releasing clients 20 67 57.13 MB/sec warmup 1 sec latency 94.104 ms 20 157 65.66 MB/sec warmup 2 sec latency 140.587 ms 20 233 59.58 MB/sec warmup 3 sec latency 107.928 ms 20 307 56.31 MB/sec warmup 4 sec latency 137.317 ms 20 383 54.51 MB/sec warmup 5 sec latency 101.609 ms 20 450 52.70 MB/sec warmup 6 sec latency 128.957 ms 20 533 52.65 MB/sec warmup 7 sec latency 115.188 ms 20 649 52.62 MB/sec warmup 8 sec latency 357.111 ms 20 667 46.96 MB/sec warmup 9 sec latency 1242.282 ms 20 714 42.36 MB/sec warmup 10 sec latency 1616.892 ms 20 802 39.00 MB/sec warmup 11 sec latency 76.610 ms 20 912 36.16 MB/sec warmup 12 sec latency 78.937 ms 20 1045 34.99 MB/sec warmup 13 sec latency 52.811 ms 20 1175 32.85 MB/sec warmup 14 sec latency 54.949 ms 20 1313 32.32 MB/sec warmup 15 sec latency 64.122 ms 20 1474 32.51 MB/sec warmup 16 sec latency 107.849 ms 20 1621 30.75 MB/sec warmup 17 sec latency 314.199 ms 20 1768 29.18 MB/sec warmup 18 sec latency 371.908 ms 20 1940 27.83 MB/sec warmup 19 sec latency 667.363 ms 20 2084 26.87 MB/sec warmup 20 sec latency 545.661 ms 20 2179 25.79 MB/sec warmup 21 sec latency 614.771 ms 20 2269 24.94 MB/sec warmup 22 sec latency 1615.179 ms 20 2394 24.95 MB/sec warmup 23 sec latency 2615.277 ms 20 2620 17.30 MB/sec execute 1 sec latency 4615.566 ms 20 2737 19.84 MB/sec execute 2 sec latency 5616.715 ms 20 2813 17.44 MB/sec execute 3 sec latency 6616.917 ms 20 2878 15.08 MB/sec execute 4 sec latency 7618.247 ms 20 2947 13.06 MB/sec execute 5 sec latency 8619.642 ms 20 3019 11.38 MB/sec execute 6 sec latency 9620.860 ms 20 3109 11.12 MB/sec execute 7 sec latency 10621.374 ms 20 3212 11.37 MB/sec execute 8 sec latency 11621.813 ms 20 3311 11.27 MB/sec execute 9 sec latency 12622.820 ms 20 3428 11.48 MB/sec execute 10 sec latency 13623.484 ms 20 3548 13.06 MB/sec execute 11 sec latency 14624.064 ms 20 3624 12.58 MB/sec execute 12 sec latency 15624.203 ms 20 3712 12.00 MB/sec execute 13 sec latency 16624.599 ms 20 3803 11.42 MB/sec execute 14 sec latency 17626.132 ms 20 3910 11.15 MB/sec execute 15 sec latency 18626.288 ms 20 3994 10.88 MB/sec execute 16 sec latency 19626.520 ms 20 4070 10.69 MB/sec execute 17 sec latency 20626.639 ms 20 4221 11.75 MB/sec execute 18 sec latency 21627.255 ms 20 4337 11.65 MB/sec execute 19 sec latency 22627.358 ms 20 4483 12.36 MB/sec execute 20 sec latency 23627.956 ms 20 4576 12.29 MB/sec execute 21 sec latency 24628.348 ms 20 4643 11.97 MB/sec execute 22 sec latency 25628.909 ms 20 4704 11.61 MB/sec execute 23 sec latency 26629.030 ms 20 4781 11.16 MB/sec execute 24 sec latency 27629.152 ms 20 4863 10.84 MB/sec execute 25 sec latency 28629.415 ms 20 4945 10.62 MB/sec execute 26 sec latency 29629.530 ms 20 5033 10.59 MB/sec execute 27 sec latency 30629.689 ms 20 5095 10.39 MB/sec execute 28 sec latency 31629.827 ms 20 5179 10.67 MB/sec execute 29 sec latency 32629.944 ms 20 5244 10.47 MB/sec execute 30 sec latency 33630.274 ms 20 5311 10.35 MB/sec execute 31 sec latency 34630.604 ms 20 5376 10.12 MB/sec execute 32 sec latency 35630.706 ms 20 5448 9.86 MB/sec execute 33 sec latency 36633.792 ms 20 5526 9.62 MB/sec execute 34 sec latency 37634.092 ms 20 5623 9.70 MB/sec execute 35 sec latency 38634.971 ms 20 5690 9.71 MB/sec execute 36 sec latency 39635.460 ms 20 5809 10.06 MB/sec execute 37 sec latency 40635.752 ms 20 5917 10.19 MB/sec execute 38 sec latency 41636.211 ms 20 6076 10.33 MB/sec execute 39 sec latency 42636.413 ms 20 6199 10.71 MB/sec execute 40 sec latency 43636.502 ms 20 6272 10.64 MB/sec execute 41 sec latency 44636.910 ms 20 6336 10.47 MB/sec execute 42 sec latency 45638.086 ms 20 6395 10.28 MB/sec execute 43 sec latency 46638.255 ms 20 6478 10.14 MB/sec execute 44 sec latency 47638.393 ms 20 6555 9.99 MB/sec execute 45 sec latency 48638.498 ms 20 6634 9.91 MB/sec execute 46 sec latency 49639.698 ms 20 6745 10.02 MB/sec execute 47 sec latency 50639.826 ms 20 6848 10.12 MB/sec execute 48 sec latency 51640.664 ms 20 6948 10.20 MB/sec execute 49 sec latency 52642.000 ms 20 7036 10.09 MB/sec execute 50 sec latency 53642.982 ms 20 7111 9.99 MB/sec execute 51 sec latency 54643.136 ms 20 7191 9.90 MB/sec execute 52 sec latency 55643.384 ms 20 7264 9.78 MB/sec execute 53 sec latency 56643.609 ms 20 7349 9.77 MB/sec execute 54 sec latency 57644.801 ms 20 7428 9.77 MB/sec execute 55 sec latency 58646.310 ms 20 7513 9.88 MB/sec execute 56 sec latency 59646.445 ms 20 7640 10.14 MB/sec execute 57 sec latency 60646.577 ms 20 7772 10.21 MB/sec execute 58 sec latency 61648.015 ms 20 7892 10.46 MB/sec execute 59 sec latency 62649.292 ms 20 7958 10.41 MB/sec execute 60 sec latency 63650.833 ms 20 8017 10.39 MB/sec execute 61 sec latency 64651.009 ms 20 8065 10.33 MB/sec execute 62 sec latency 65651.653 ms 20 8105 10.19 MB/sec execute 63 sec latency 66653.878 ms 20 8152 10.05 MB/sec execute 64 sec latency 67654.357 ms 20 8204 9.91 MB/sec execute 65 sec latency 68655.373 ms 20 8256 9.79 MB/sec execute 66 sec latency 69656.141 ms 20 8309 9.68 MB/sec execute 67 sec latency 70656.506 ms 20 8374 9.62 MB/sec execute 68 sec latency 71656.749 ms 20 8432 9.58 MB/sec execute 69 sec latency 72657.693 ms 20 8484 9.48 MB/sec execute 70 sec latency 73657.805 ms 20 8557 9.53 MB/sec execute 71 sec latency 74657.930 ms 20 8624 9.53 MB/sec execute 72 sec latency 75661.374 ms 20 8680 9.45 MB/sec execute 73 sec latency 76661.731 ms 20 8733 9.34 MB/sec execute 74 sec latency 77662.557 ms 20 8787 9.23 MB/sec execute 75 sec latency 78662.935 ms 20 8860 9.17 MB/sec execute 76 sec latency 79664.134 ms 20 8925 9.07 MB/sec execute 77 sec latency 80667.592 ms 20 9001 9.02 MB/sec execute 78 sec latency 81668.041 ms 20 9070 8.98 MB/sec execute 79 sec latency 82668.170 ms 20 9133 8.98 MB/sec execute 80 sec latency 83668.300 ms 20 9226 9.08 MB/sec execute 81 sec latency 84668.416 ms 20 9305 9.17 MB/sec execute 82 sec latency 85668.850 ms 20 9425 9.24 MB/sec execute 83 sec latency 86668.961 ms 20 9529 9.35 MB/sec execute 84 sec latency 87669.276 ms 20 9605 9.39 MB/sec execute 85 sec latency 88669.660 ms 20 9669 9.38 MB/sec execute 86 sec latency 89669.750 ms 20 9728 9.34 MB/sec execute 87 sec latency 90670.638 ms 20 9783 9.25 MB/sec execute 88 sec latency 91671.539 ms 20 9823 9.16 MB/sec execute 89 sec latency 92671.673 ms 20 9903 9.09 MB/sec execute 90 sec latency 93672.554 ms 20 9971 9.07 MB/sec execute 91 sec latency 94673.204 ms 20 10026 9.03 MB/sec execute 92 sec latency 95674.977 ms 20 10094 9.00 MB/sec execute 93 sec latency 96675.163 ms 20 10165 8.96 MB/sec execute 94 sec latency 97675.533 ms 20 10244 9.01 MB/sec execute 95 sec latency 98675.809 ms 20 10323 9.06 MB/sec execute 96 sec latency 99676.425 ms 20 10379 8.99 MB/sec execute 97 sec latency 100676.742 ms 20 10432 8.90 MB/sec execute 98 sec latency 101677.038 ms 20 10490 8.83 MB/sec execute 99 sec latency 102677.711 ms 20 10563 8.79 MB/sec execute 100 sec latency 103678.890 ms 20 10643 8.77 MB/sec execute 101 sec latency 104679.794 ms 20 10726 8.74 MB/sec execute 102 sec latency 105679.925 ms 20 10809 8.73 MB/sec execute 103 sec latency 106680.482 ms 20 10872 8.72 MB/sec execute 104 sec latency 107680.610 ms 20 10975 8.88 MB/sec execute 105 sec latency 108680.855 ms 20 11071 8.88 MB/sec execute 106 sec latency 109681.238 ms 20 11169 8.90 MB/sec execute 107 sec latency 110682.107 ms 20 11263 8.99 MB/sec execute 108 sec latency 111682.399 ms 20 11330 8.99 MB/sec execute 109 sec latency 112682.595 ms 20 11391 8.97 MB/sec execute 110 sec latency 113684.933 ms 20 11435 8.92 MB/sec execute 111 sec latency 114687.005 ms 20 11479 8.85 MB/sec execute 112 sec latency 115688.284 ms 20 11514 8.78 MB/sec execute 113 sec latency 116688.677 ms 20 11579 8.72 MB/sec execute 114 sec latency 117688.778 ms 20 11642 8.66 MB/sec execute 115 sec latency 118690.226 ms 20 11708 8.64 MB/sec execute 116 sec latency 119690.361 ms 20 11784 8.64 MB/sec execute 117 sec latency 120690.774 ms 20 11856 8.61 MB/sec execute 118 sec latency 121691.117 ms 20 11938 8.68 MB/sec execute 119 sec latency 122692.741 ms 20 cleanup 120 sec 13 cleanup 121 sec 10 cleanup 122 sec 8 cleanup 123 sec 5 cleanup 124 sec 3 cleanup 125 sec 0 cleanup 126 sec 0 cleanup 126 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 32774 38.017 128659.772 Close 23899 27.101 126648.724 Rename 1408 31.511 696.391 Unlink 6865 27.536 94778.723 Qpathinfo 29557 4.466 290.264 Qfileinfo 5066 0.128 10.134 Qfsinfo 5698 0.114 18.409 Sfileinfo 2721 23.441 2923.527 Find 11644 0.883 49.286 WriteX 16237 2.943 40.899 ReadX 52026 0.023 7.243 LockX 104 12.166 198.209 UnlockX 104 13.392 131.703 Flush 2349 23.429 121.585 Throughput 8.68258 MB/sec 20 clients 20 procs max_latency=122692.741 ms stopping dbench on /mnt/lustre/d0.oleg335-client.virtnet at Wed May 29 17:25:33 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg335-client.virtnet /mnt/lustre/d0.oleg335-client.virtnet /mnt/lustre/d0.oleg335-client.virtnet removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg335-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (159s) == sanity-benchmark test bonnie: bonnie++ ================ 17:25:40 (1717017940) min OST has 3580000kB available, using 5370000kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7456] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5244] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg335-clien 5244M 99365 74 83560 67 171317 36 2322 239 Latency 15124us 205ms 91886us 9665us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg335-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 174 19 1461 13 269 13 178 17 191 15 199 12 Latency 30533us 15423us 61652us 48825us 58162us 84455us 1.97,1.97,oleg335-client.virtnet,1,1717024743,5244M,,,,99365,74,83560,67,,,171317,36,2322,239,10,,,,,174,19,1461,13,269,13,178,17,191,15,199,12,,15124us,205ms,,91886us,9665us,30533us,15423us,61652us,48825us,58162us,84455us debug=0x33f0484 PASS bonnie (428s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 17:32:49 (1717018369) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 22375 -P /tmp -l 5408064 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 22375 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x8a88c truncating to largest ever: 0x3e3265 truncating to largest ever: 0x4d8dbc fallocating to largest ever: 0x52832e 001000 1717018377.577138 mapread 0x2b0742 thru 0x2b6ff8 (0x68b7 bytes) fallocating to largest ever: 0x528540 002000 1717018384.709206 punch from 0x29ec8a to 0x2a2852 (0x3bc9 bytes) 006000 1717018415.131528 write 0x3ed31e thru 0x3faac1 (0xd7a4 bytes) 008000 1717018430.109099 mapwrite 0x1d140a thru 0x1dbe1d (0xaa14 bytes) 009000 1717018436.479597 mapread 0x4433bc thru 0x449241 (0x5e86 bytes) 010000 1717018443.995690 fallocate 0x44ca71 thru 0x44ceeb (0x47b bytes) 013000 1717018463.310574 punch from 0x11c8cc to 0x11d515 (0xc4a bytes) 014000 1717018469.043685 fallocate 0x020749 thru 0x02de43 (0xd6fb bytes) 015000 1717018475.988741 punch from 0x1c3ed7 to 0x1cacc0 (0x6dea bytes) 016000 1717018483.890723 trunc from 0x4c2016 to 0x505157 (0x43142 bytes) 018000 1717018499.949109 punch from 0x109f8e to 0x11770e (0xd781 bytes) 019000 1717018506.677233 trunc from 0x4d8d3d to 0x2fd6ef (0x1db64d bytes) 020000 1717018514.252086 trunc from 0x4b8e5d to 0x1d95a8 (0x2df8b4 bytes) 021000 1717018521.227303 read 0x1af2eb thru 0x1b7879 (0x858f bytes) 022000 1717018527.750844 read 0x2699d8 thru 0x26be2b (0x2454 bytes) 023000 1717018535.262648 trunc from 0x2358c1 to 0x340030 (0x10a770 bytes) 024000 1717018543.058739 punch from 0x3994a9 to 0x3a18ec (0x8444 bytes) 025000 1717018551.411849 mapread 0x464032 thru 0x471d4c (0xdd1b bytes) 026000 1717018560.428619 trunc from 0x4a7466 to 0x4b96d4 (0x1226f bytes) 027000 1717018569.387009 punch from 0x26a1e0 to 0x279947 (0xf768 bytes) 028000 1717018577.719888 write 0x2a447f thru 0x2a8ba5 (0x4727 bytes) 029000 1717018585.479525 read 0x13d9f6 thru 0x14adcb (0xd3d6 bytes) 030000 1717018593.203148 write 0x3bf21b thru 0x3c90ab (0x9e91 bytes) 031000 1717018601.365280 fallocate 0x0e007d thru 0x0ecdd5 (0xcd59 bytes) 032000 1717018609.372543 read 0x0696a9 thru 0x077a04 (0xe35c bytes) 033000 1717018617.769931 trunc from 0x4945a3 to 0x2b0596 (0x1e400c bytes) 034000 1717018625.272249 write 0x517d32 thru 0x51ad7e (0x304d bytes) 036000 1717018641.611533 mapwrite 0x195e64 thru 0x1a1215 (0xb3b2 bytes) 037000 1717018650.149204 trunc from 0x233cb2 to 0x35aac5 (0x126e14 bytes) 041000 1717018678.313213 read 0x109245 thru 0x109a3d (0x7f9 bytes) 044000 1717018703.051056 mapread 0x003532 thru 0x007f9d (0x4a6c bytes) 045000 1717018709.150022 mapwrite 0x478848 thru 0x483ba3 (0xb35c bytes) 048000 1717018731.613123 mapread 0x4697b1 thru 0x46a05c (0x8ac bytes) 049000 1717018737.832825 read 0x280af6 thru 0x28e5e7 (0xdaf2 bytes) 050000 1717018744.152275 trunc from 0x2dd30d to 0x277f65 (0x653a7 bytes) 051000 1717018750.320116 punch from 0x139cec to 0x13f656 (0x596b bytes) 052000 1717018757.473911 mapwrite 0x2bb11d thru 0x2c103d (0x5f21 bytes) 053000 1717018763.540586 mapwrite 0x035484 thru 0x04223c (0xcdb9 bytes) 054000 1717018770.885219 write 0x4a4366 thru 0x4ac9f4 (0x868f bytes) 055000 1717018777.434725 fallocate 0x4c1c94 thru 0x4cd383 (0xb6f0 bytes) 056000 1717018784.218986 punch from 0x1a7ffc to 0x1b0b02 (0x8b07 bytes) 057000 1717018791.652648 fallocate 0x19d888 thru 0x1a2052 (0x47cb bytes) 059000 1717018806.389655 mapread 0x2267e1 thru 0x233bda (0xd3fa bytes) 060000 1717018813.293885 write 0x1379b9 thru 0x142c01 (0xb249 bytes) 061000 1717018820.737381 punch from 0x1203d7 to 0x12f3bc (0xefe6 bytes) 062000 1717018827.993044 mapread 0x0315f3 thru 0x034dd7 (0x37e5 bytes) 064000 1717018840.770218 write 0x33b1a3 thru 0x33c747 (0x15a5 bytes) 065000 1717018845.833955 mapwrite 0x1c8df7 thru 0x1d2166 (0x9370 bytes) 066000 1717018851.486545 punch from 0x07734a to 0x07ed6d (0x7a24 bytes) 067000 1717018857.573724 fallocate 0x1275f9 thru 0x137071 (0xfa79 bytes) 068000 1717018863.499514 mapwrite 0x1b1336 thru 0x1be708 (0xd3d3 bytes) 069000 1717018869.922709 fallocate 0x0e2465 thru 0x0ef003 (0xcb9f bytes) 070000 1717018874.388663 fallocate 0x50430d thru 0x50561b (0x130f bytes) 073000 1717018890.886327 fallocate 0x32a85f thru 0x33a671 (0xfe13 bytes) 074000 1717018896.910065 mapread 0x03c803 thru 0x03fb1a (0x3318 bytes) 075000 1717018903.129841 fallocate 0x3318eb thru 0x33d4f7 (0xbc0d bytes) 076000 1717018909.148558 trunc from 0x3c5078 to 0x183335 (0x241d42 bytes) 077000 1717018914.773979 read 0x3db5f4 thru 0x3e2b03 (0x7510 bytes) 079000 1717018925.655157 fallocate 0x2a60c4 thru 0x2a65fc (0x539 bytes) 080000 1717018930.480245 mapwrite 0x3e17a1 thru 0x3e73f9 (0x5c59 bytes) 081000 1717018936.745878 write 0x511285 thru 0x51426e (0x2fea bytes) 082000 1717018943.254763 write 0x4c105e thru 0x4ccf76 (0xbf19 bytes) 083000 1717018949.421555 write 0x4ee52a thru 0x4fcfe1 (0xeab8 bytes) 085000 1717018961.985334 write 0x0f2f20 thru 0x100e97 (0xdf78 bytes) 086000 1717018967.018286 read 0x204179 thru 0x21351f (0xf3a7 bytes) 087000 1717018973.956446 read 0x09193b thru 0x096550 (0x4c16 bytes) 088000 1717018979.780511 mapwrite 0x267b0d thru 0x26ef8e (0x7482 bytes) 090000 1717018991.487021 punch from 0x35b2cf to 0x362592 (0x72c4 bytes) 091000 1717018996.839294 fallocate 0x22108f thru 0x22c1fd (0xb16f bytes) 092000 1717019001.777559 punch from 0x20b388 to 0x212f93 (0x7c0c bytes) 094000 1717019013.348425 write 0x25251e thru 0x258a49 (0x652c bytes) 095000 1717019018.394644 write 0x50f704 thru 0x51065b (0xf58 bytes) 096000 1717019023.237930 trunc from 0x443df6 to 0x0c4aaa (0x37f34b bytes) 097000 1717019027.546325 punch from 0x3d4657 to 0x3df2b9 (0xac63 bytes) 098000 1717019033.246532 fallocate 0x01a95d thru 0x0218c9 (0x6f6d bytes) 099000 1717019040.586238 fallocate 0x35d897 thru 0x36c028 (0xe792 bytes) 100000 1717019045.635321 read 0x2289d7 thru 0x230ee0 (0x850a bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (679s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 17:44:07 (1717019047) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1717019054.524592 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1717019061.369849 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1717019087.742924 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1717019093.780934 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1717019100.285637 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1717019107.215496 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1717019114.066424 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1717019127.913656 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1717019133.797318 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1717019145.545135 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1717019153.311375 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1717019168.468523 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1717019175.308130 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1717019191.164069 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1717019198.105497 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1717019204.470396 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1717019211.459197 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1717019218.030401 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1717019225.976988 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1717019233.793435 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1717019241.171889 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1717019257.421501 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1717019264.783035 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1717019272.176244 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1717019281.387442 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1717019289.432882 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1717019297.610355 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1717019305.407630 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1717019313.233608 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1717019321.766283 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1717019329.587642 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1717019336.171397 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1717019349.807405 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1717019357.702134 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1717019365.877368 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1717019373.332751 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1717019395.945677 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1717019402.332684 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1717019409.595524 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1717019416.142232 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1717019421.954489 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1717019429.198651 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1717019444.926890 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1717019453.508050 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1717019463.229901 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1717019489.655388 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1717019505.501939 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1717019512.663949 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1717019519.609282 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1717019535.805216 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1717019553.094210 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1717019562.569575 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1717019571.360198 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1717019586.643904 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1717019593.295710 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1717019600.495329 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1717019606.377659 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1717019613.711418 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1717019620.763468 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1717019635.921093 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1717019650.264156 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1717019656.741875 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1717019662.858465 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1717019671.040133 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1717019684.223984 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1717019696.901122 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1717019708.781965 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1717019715.414332 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1717019722.109111 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1717019728.752712 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1717019736.133812 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1717019752.325060 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1717019760.013249 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1717019767.264561 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1717019779.404581 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (734s) == sanity-benchmark test complete, duration 2019 sec ===== 17:56:21 (1717019781)