-----============= acceptance-small: sanity-benchmark ============----- Fri Mar 22 03:09:36 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 03:09:38 (1711091378) === oleg160-client.virtnet: executing check_config_client /mnt/lustre oleg160-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg160-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6345000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6345000.idle_timeout=debug disable quota as required oleg160-server: oleg160-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 03:09:44 (1711091384) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 03:09:45 (1711091385) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6753] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg160-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg160-client.virtnet at Fri Mar 22 03:09:45 EDT 2024 waiting for dbench pid 8679 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 202 159.71 MB/sec warmup 1 sec latency 97.523 ms 20 406 144.06 MB/sec warmup 2 sec latency 80.183 ms 20 653 140.60 MB/sec warmup 3 sec latency 360.654 ms 20 787 107.20 MB/sec warmup 4 sec latency 413.476 ms 20 934 87.13 MB/sec warmup 5 sec latency 149.872 ms 20 1179 76.74 MB/sec warmup 6 sec latency 118.862 ms 20 1482 74.41 MB/sec warmup 7 sec latency 159.640 ms 20 1685 65.56 MB/sec warmup 8 sec latency 222.417 ms 20 1943 58.78 MB/sec warmup 9 sec latency 79.592 ms 20 2210 53.77 MB/sec warmup 10 sec latency 95.571 ms 20 2441 51.29 MB/sec warmup 11 sec latency 156.773 ms 20 2732 52.04 MB/sec warmup 12 sec latency 192.286 ms 20 3053 51.92 MB/sec warmup 13 sec latency 256.404 ms 20 3429 51.97 MB/sec warmup 14 sec latency 174.628 ms 20 3746 52.32 MB/sec warmup 15 sec latency 37.804 ms 20 3925 50.02 MB/sec warmup 16 sec latency 29.423 ms 20 4080 47.16 MB/sec warmup 17 sec latency 215.023 ms 20 4268 44.81 MB/sec warmup 18 sec latency 275.171 ms 20 4398 42.79 MB/sec warmup 19 sec latency 213.257 ms 20 4585 41.32 MB/sec warmup 20 sec latency 130.963 ms 20 4889 41.43 MB/sec warmup 21 sec latency 141.678 ms 20 5171 41.15 MB/sec warmup 22 sec latency 111.850 ms 20 5374 39.52 MB/sec warmup 23 sec latency 93.998 ms 20 5919 24.52 MB/sec execute 1 sec latency 94.840 ms 20 6163 29.31 MB/sec execute 2 sec latency 186.352 ms 20 6579 47.22 MB/sec execute 3 sec latency 160.084 ms 20 6961 48.32 MB/sec execute 4 sec latency 134.790 ms 20 7286 50.46 MB/sec execute 5 sec latency 92.167 ms 20 7484 44.51 MB/sec execute 6 sec latency 27.950 ms 20 7654 38.54 MB/sec execute 7 sec latency 225.982 ms 20 7810 34.28 MB/sec execute 8 sec latency 277.974 ms 20 7954 31.33 MB/sec execute 9 sec latency 115.318 ms 20 8136 29.70 MB/sec execute 10 sec latency 268.182 ms 20 8426 30.69 MB/sec execute 11 sec latency 117.455 ms 20 8701 31.03 MB/sec execute 12 sec latency 104.117 ms 20 8948 28.99 MB/sec execute 13 sec latency 83.007 ms 20 9242 27.56 MB/sec execute 14 sec latency 60.491 ms 20 9533 27.85 MB/sec execute 15 sec latency 146.803 ms 20 9825 29.16 MB/sec execute 16 sec latency 141.936 ms 20 10208 31.47 MB/sec execute 17 sec latency 170.462 ms 20 10610 33.15 MB/sec execute 18 sec latency 105.179 ms 20 10893 33.67 MB/sec execute 19 sec latency 24.072 ms 20 11064 32.56 MB/sec execute 20 sec latency 160.385 ms 20 11238 31.10 MB/sec execute 21 sec latency 171.130 ms 20 11411 29.99 MB/sec execute 22 sec latency 115.780 ms 20 11586 29.14 MB/sec execute 23 sec latency 117.148 ms 20 11834 29.19 MB/sec execute 24 sec latency 142.038 ms 20 12157 30.14 MB/sec execute 25 sec latency 72.190 ms 20 12380 29.12 MB/sec execute 26 sec latency 107.582 ms 20 12615 28.27 MB/sec execute 27 sec latency 78.333 ms 20 12917 27.90 MB/sec execute 28 sec latency 92.791 ms 20 13183 28.07 MB/sec execute 29 sec latency 149.611 ms 20 13544 29.48 MB/sec execute 30 sec latency 174.719 ms 20 13974 30.45 MB/sec execute 31 sec latency 155.172 ms 20 14318 31.55 MB/sec execute 32 sec latency 117.367 ms 20 14524 31.20 MB/sec execute 33 sec latency 140.042 ms 20 14699 30.42 MB/sec execute 34 sec latency 132.656 ms 20 14902 29.70 MB/sec execute 35 sec latency 168.509 ms 20 15049 29.13 MB/sec execute 36 sec latency 212.925 ms 20 15253 28.73 MB/sec execute 37 sec latency 119.653 ms 20 15539 28.95 MB/sec execute 38 sec latency 123.942 ms 20 15823 29.20 MB/sec execute 39 sec latency 75.171 ms 20 16044 28.66 MB/sec execute 40 sec latency 104.266 ms 20 16327 28.19 MB/sec execute 41 sec latency 66.795 ms 20 16622 28.15 MB/sec execute 42 sec latency 79.363 ms 20 16881 28.47 MB/sec execute 43 sec latency 158.071 ms 20 17283 29.50 MB/sec execute 44 sec latency 151.562 ms 20 17639 29.90 MB/sec execute 45 sec latency 156.261 ms 20 17941 30.37 MB/sec execute 46 sec latency 109.492 ms 20 18132 30.08 MB/sec execute 47 sec latency 124.406 ms 20 18293 29.56 MB/sec execute 48 sec latency 127.446 ms 20 18477 29.08 MB/sec execute 49 sec latency 242.054 ms 20 18590 28.61 MB/sec execute 50 sec latency 174.084 ms 20 18756 28.24 MB/sec execute 51 sec latency 128.980 ms 20 18996 28.30 MB/sec execute 52 sec latency 129.592 ms 20 19290 28.69 MB/sec execute 53 sec latency 123.164 ms 20 19509 28.31 MB/sec execute 54 sec latency 103.462 ms 20 19751 27.90 MB/sec execute 55 sec latency 90.903 ms 20 20005 27.64 MB/sec execute 56 sec latency 69.940 ms 20 20268 27.62 MB/sec execute 57 sec latency 119.111 ms 20 20519 27.86 MB/sec execute 58 sec latency 145.015 ms 20 20914 28.62 MB/sec execute 59 sec latency 178.532 ms 20 21249 28.87 MB/sec execute 60 sec latency 150.871 ms 20 21523 29.19 MB/sec execute 61 sec latency 103.963 ms 20 21729 29.01 MB/sec execute 62 sec latency 96.194 ms 20 21894 28.66 MB/sec execute 63 sec latency 205.522 ms 20 22081 28.27 MB/sec execute 64 sec latency 194.332 ms 20 22212 27.93 MB/sec execute 65 sec latency 120.081 ms 20 22403 27.78 MB/sec execute 66 sec latency 122.486 ms 20 22629 27.78 MB/sec execute 67 sec latency 168.912 ms 20 22910 28.04 MB/sec execute 68 sec latency 99.676 ms 20 23125 27.75 MB/sec execute 69 sec latency 107.692 ms 20 23340 27.47 MB/sec execute 70 sec latency 179.127 ms 20 23596 27.24 MB/sec execute 71 sec latency 101.016 ms 20 23877 27.35 MB/sec execute 72 sec latency 142.802 ms 20 24166 27.55 MB/sec execute 73 sec latency 142.580 ms 20 24538 28.11 MB/sec execute 74 sec latency 157.714 ms 20 24859 28.36 MB/sec execute 75 sec latency 158.651 ms 20 25116 28.51 MB/sec execute 76 sec latency 141.861 ms 20 25302 28.37 MB/sec execute 77 sec latency 163.874 ms 20 25441 28.05 MB/sec execute 78 sec latency 150.345 ms 20 25593 27.73 MB/sec execute 79 sec latency 147.955 ms 20 25748 27.48 MB/sec execute 80 sec latency 215.604 ms 20 25922 27.34 MB/sec execute 81 sec latency 148.335 ms 20 26144 27.33 MB/sec execute 82 sec latency 151.443 ms 20 26422 27.42 MB/sec execute 83 sec latency 187.772 ms 20 26668 27.38 MB/sec execute 84 sec latency 99.367 ms 20 26878 27.14 MB/sec execute 85 sec latency 86.944 ms 20 27116 27.00 MB/sec execute 86 sec latency 99.811 ms 20 27385 26.94 MB/sec execute 87 sec latency 110.564 ms 20 27621 27.04 MB/sec execute 88 sec latency 187.480 ms 20 27976 27.52 MB/sec execute 89 sec latency 152.434 ms 20 28260 27.55 MB/sec execute 90 sec latency 166.220 ms 20 28576 27.92 MB/sec execute 91 sec latency 144.717 ms 20 28792 27.86 MB/sec execute 92 sec latency 247.433 ms 20 28961 27.64 MB/sec execute 93 sec latency 135.265 ms 20 29105 27.37 MB/sec execute 94 sec latency 174.709 ms 20 29289 27.17 MB/sec execute 95 sec latency 147.557 ms 20 29438 27.03 MB/sec execute 96 sec latency 221.693 ms 20 29639 26.96 MB/sec execute 97 sec latency 152.560 ms 20 29897 26.94 MB/sec execute 98 sec latency 99.103 ms 20 30180 27.11 MB/sec execute 99 sec latency 110.533 ms 20 30376 26.90 MB/sec execute 100 sec latency 188.279 ms 20 30626 26.80 MB/sec execute 101 sec latency 75.959 ms 20 30933 26.76 MB/sec execute 102 sec latency 110.799 ms 20 31194 26.82 MB/sec execute 103 sec latency 130.162 ms 20 31471 27.04 MB/sec execute 104 sec latency 186.230 ms 20 31786 27.25 MB/sec execute 105 sec latency 199.189 ms 20 32114 27.49 MB/sec execute 106 sec latency 162.666 ms 20 32343 27.51 MB/sec execute 107 sec latency 147.899 ms 20 32506 27.34 MB/sec execute 108 sec latency 149.468 ms 20 32672 27.14 MB/sec execute 109 sec latency 157.834 ms 20 32859 27.01 MB/sec execute 110 sec latency 158.740 ms 20 33010 26.85 MB/sec execute 111 sec latency 159.906 ms 20 33195 26.75 MB/sec execute 112 sec latency 156.549 ms 20 33449 26.76 MB/sec execute 113 sec latency 117.166 ms 20 33724 26.90 MB/sec execute 114 sec latency 119.862 ms 20 33938 26.76 MB/sec execute 115 sec latency 103.916 ms 20 34159 26.62 MB/sec execute 116 sec latency 90.971 ms 20 34449 26.62 MB/sec execute 117 sec latency 107.567 ms 20 34717 26.66 MB/sec execute 118 sec latency 123.149 ms 20 35004 26.80 MB/sec execute 119 sec latency 162.610 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 101869 11.575 67.715 Close 75017 2.707 32.268 Rename 4389 15.144 60.363 Unlink 20508 4.924 54.867 Qpathinfo 92595 2.691 48.457 Qfileinfo 16397 0.082 10.318 Qfsinfo 17093 0.083 4.551 Sfileinfo 8353 7.297 38.237 Find 35966 0.645 42.852 WriteX 50967 0.875 34.069 ReadX 163258 0.013 3.269 LockX 360 3.271 10.137 UnlockX 360 3.104 11.902 Flush 7096 65.019 277.968 Throughput 26.7976 MB/sec 20 clients 20 procs max_latency=277.974 ms stopping dbench on /mnt/lustre/d0.oleg160-client.virtnet at Fri Mar 22 03:12:10 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg160-client.virtnet /mnt/lustre/d0.oleg160-client.virtnet /mnt/lustre/d0.oleg160-client.virtnet removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg160-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 03:12:14 (1711091534) min OST has 3058688kB available, using 4588032kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6753] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4480] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg160-clien 4480M 149305 98 133318 95 375449 83 2275 123 Latency 1953us 29917us 26657us 247ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg160-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 296 27 3735 68 321 34 298 26 635 42 304 34 Latency 14739us 12900us 55165us 15390us 13397us 30290us 1.97,1.97,oleg160-client.virtnet,1,1711081928,4480M,,,,149305,98,133318,95,,,375449,83,2275,123,10,,,,,296,27,3735,68,321,34,298,26,635,42,304,34,,1953us,29917us,,26657us,247ms,14739us,12900us,55165us,15390us,13397us,30290us debug=0x33f0484 PASS bonnie (240s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 03:16:17 (1711091777) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 5285 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 5285 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x3b002b truncating to largest ever: 0x4e144d truncating to largest ever: 0x55b1f3 truncating to largest ever: 0x55d2a9 truncating to largest ever: 0x560153 005000 1711091793.116033 write 0x1e2c5e thru 0x1ee73a (0xbadd bytes) 006000 1711091796.082121 mapread 0x3e564a thru 0x3f2965 (0xd31c bytes) 009000 1711091806.188389 trunc from 0x40d9df to 0x3a898e (0x65050 bytes) 010000 1711091809.291206 mapwrite 0x541ae9 thru 0x54b01d (0x9535 bytes) 011000 1711091812.315460 mapread 0x0b4a44 thru 0x0b4c52 (0x20f bytes) truncating to largest ever: 0x561eb8 013000 1711091818.470421 trunc from 0x491f68 to 0x3a34c5 (0xeeaa2 bytes) 017000 1711091830.812113 write 0x01b201 thru 0x02a442 (0xf242 bytes) 021000 1711091843.730984 read 0x1a8c77 thru 0x1b0184 (0x750e bytes) 023000 1711091849.945711 write 0x314ea7 thru 0x32334c (0xe4a6 bytes) 025000 1711091855.848067 write 0x1d5e79 thru 0x1e38e4 (0xda6c bytes) 028000 1711091866.109710 write 0x10880c thru 0x11339d (0xab92 bytes) truncating to largest ever: 0x561f12 030000 1711091872.852187 mapwrite 0x297448 thru 0x2a283a (0xb3f3 bytes) 031000 1711091875.838770 mapwrite 0x26577d thru 0x26cc38 (0x74bc bytes) truncating to largest ever: 0x562ac8 035000 1711091887.820516 read 0x3feae8 thru 0x402c16 (0x412f bytes) 036000 1711091890.868842 mapwrite 0x028182 thru 0x02878a (0x609 bytes) 037000 1711091894.532546 read 0x0a7339 thru 0x0aabd1 (0x3899 bytes) 038000 1711091897.502436 mapwrite 0x41455f thru 0x421191 (0xcc33 bytes) 039000 1711091899.919109 mapread 0x301049 thru 0x30185b (0x813 bytes) 041000 1711091906.782522 mapwrite 0x31896f thru 0x31d2cf (0x4961 bytes) 042000 1711091910.398180 trunc from 0x4ca69f to 0x26cbde (0x25dac0 bytes) 043000 1711091913.424571 mapread 0x0032c0 thru 0x003dbf (0xb00 bytes) 045000 1711091920.337418 write 0x13e3bd thru 0x14b151 (0xcd95 bytes) 046000 1711091923.324151 mapwrite 0x3f2934 thru 0x3fb868 (0x8f35 bytes) 047000 1711091926.611244 trunc from 0x1f30f6 to 0x362247 (0x16f152 bytes) 055000 1711091951.905166 write 0x52b3c1 thru 0x5376cc (0xc30c bytes) 056000 1711091954.674174 write 0x0e95b2 thru 0x0f40ea (0xab39 bytes) 058000 1711091961.228801 trunc from 0x43b843 to 0x34eb9a (0xecca8 bytes) 059000 1711091964.084004 mapwrite 0x2abf49 thru 0x2ba5c9 (0xe681 bytes) 061000 1711091969.707002 read 0x48fa1c thru 0x4966ac (0x6c91 bytes) 062000 1711091972.500265 read 0x109099 thru 0x10d545 (0x44ad bytes) 067000 1711091987.251128 mapread 0x34fca6 thru 0x354900 (0x4c5b bytes) 069000 1711091993.023611 read 0x290ac8 thru 0x29d5e5 (0xcb1e bytes) 070000 1711091996.046399 trunc from 0x4d95ab to 0x22bcbb (0x2ad8ef bytes) 071000 1711091998.669153 mapwrite 0x40c96d thru 0x41804d (0xb6e1 bytes) 073000 1711092004.319742 write 0x419662 thru 0x421355 (0x7cf4 bytes) 076000 1711092013.144273 write 0x2887d7 thru 0x28b2f2 (0x2b1c bytes) 078000 1711092018.516291 trunc from 0x0a0423 to 0x1d0c64 (0x130842 bytes) 079000 1711092021.212453 read 0x3e4c97 thru 0x3f2982 (0xdcec bytes) 080000 1711092024.116398 write 0x2e549a thru 0x2eafac (0x5b13 bytes) 083000 1711092032.919978 mapwrite 0x243c27 thru 0x25278c (0xeb66 bytes) 084000 1711092035.729899 trunc from 0x3ee521 to 0x0bb0df (0x333441 bytes) 085000 1711092038.662049 mapwrite 0x0e5022 thru 0x0ecfb1 (0x7f90 bytes) 087000 1711092044.598630 mapwrite 0x2b21da thru 0x2b965c (0x7483 bytes) 090000 1711092053.181313 mapwrite 0x1e2aa8 thru 0x1eaf42 (0x849b bytes) 094000 1711092064.710244 trunc from 0x55e630 to 0x11f53b (0x43f0f4 bytes) 096000 1711092069.738134 mapwrite 0x547abb thru 0x54d1e2 (0x5728 bytes) 097000 1711092072.776778 read 0x1b5c4b thru 0x1c1a72 (0xbe28 bytes) 098000 1711092076.459982 mapwrite 0x4176b2 thru 0x41acb6 (0x3605 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (306s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 03:21:25 (1711092085) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1711092095.562954 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1711092102.896040 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1711092106.671084 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1711092119.922137 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1711092122.882230 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1711092135.245420 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1711092138.466251 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1711092144.521817 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1711092150.850021 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1711092153.956832 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1711092159.887956 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1711092163.300054 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1711092175.549908 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1711092181.454305 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1711092191.156347 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1711092201.459190 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1711092205.050513 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1711092218.385521 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1711092221.895983 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1711092232.613511 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1711092237.286583 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1711092241.783838 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1711092251.695878 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1711092258.123139 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1711092265.476986 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1711092269.228927 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1711092303.995817 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1711092313.468892 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1711092317.137878 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1711092320.213177 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1711092323.391707 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1711092333.567540 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1711092336.803710 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1711092346.938038 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1711092350.498859 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1711092359.662301 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1711092369.498251 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1711092372.752622 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1711092381.825105 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1711092398.262753 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1711092401.126338 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1711092407.337687 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1711092413.910578 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (333s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1042 sec ===== 03:26:58 (1711092418) === sanity-benchmark: start cleanup 03:26:58 (1711092418) === === sanity-benchmark: finish cleanup 03:26:58 (1711092418) ===