-----============= acceptance-small: sanity-benchmark ============----- Mon Jul 29 03:25:09 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg117-client.virtnet: executing check_config_client /mnt/lustre oleg117-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg117-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5c35000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5c35000.idle_timeout=debug disable quota as required oleg117-server: oleg117-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 03:25:19 (1722237919) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7433] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg117-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg117-client.virtnet at Mon Jul 29 03:25:19 EDT 2024 waiting for dbench pid 9572 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 243 185.37 MB/sec warmup 1 sec latency 55.034 ms 20 496 172.74 MB/sec warmup 2 sec latency 33.196 ms 20 671 141.09 MB/sec warmup 3 sec latency 699.456 ms 20 930 108.84 MB/sec warmup 4 sec latency 712.531 ms 20 1243 92.88 MB/sec warmup 5 sec latency 25.667 ms 20 1579 87.10 MB/sec warmup 6 sec latency 33.401 ms 20 1865 75.35 MB/sec warmup 7 sec latency 28.631 ms 20 2223 67.77 MB/sec warmup 8 sec latency 22.558 ms 20 2518 63.90 MB/sec warmup 9 sec latency 27.465 ms 20 3034 67.41 MB/sec warmup 10 sec latency 31.561 ms 20 3544 68.69 MB/sec warmup 11 sec latency 29.120 ms 20 3849 66.41 MB/sec warmup 12 sec latency 28.121 ms 20 4056 61.65 MB/sec warmup 13 sec latency 27.152 ms 20 4273 57.64 MB/sec warmup 14 sec latency 62.433 ms 20 4559 55.04 MB/sec warmup 15 sec latency 32.785 ms 20 4922 54.60 MB/sec warmup 16 sec latency 24.639 ms 20 5219 53.31 MB/sec warmup 17 sec latency 37.375 ms 20 5520 50.66 MB/sec warmup 18 sec latency 27.850 ms 20 5864 49.14 MB/sec warmup 19 sec latency 19.716 ms 20 6289 49.66 MB/sec warmup 20 sec latency 24.103 ms 20 6869 52.21 MB/sec warmup 21 sec latency 29.622 ms 20 7308 53.02 MB/sec warmup 22 sec latency 32.374 ms 20 7558 51.43 MB/sec warmup 23 sec latency 34.272 ms 20 8104 19.81 MB/sec execute 1 sec latency 44.950 ms 20 8455 28.64 MB/sec execute 2 sec latency 22.229 ms 20 8820 33.18 MB/sec execute 3 sec latency 25.164 ms 20 9169 28.52 MB/sec execute 4 sec latency 24.472 ms 20 9628 32.95 MB/sec execute 5 sec latency 18.641 ms 20 10109 40.65 MB/sec execute 6 sec latency 20.420 ms 20 10637 45.82 MB/sec execute 7 sec latency 25.993 ms 20 10999 46.19 MB/sec execute 8 sec latency 65.476 ms 20 11244 42.34 MB/sec execute 9 sec latency 86.292 ms 20 11521 39.32 MB/sec execute 10 sec latency 48.983 ms 20 11851 38.87 MB/sec execute 11 sec latency 24.403 ms 20 12204 38.55 MB/sec execute 12 sec latency 28.908 ms 20 12539 37.72 MB/sec execute 13 sec latency 31.073 ms 20 12873 37.19 MB/sec execute 14 sec latency 34.719 ms 20 13327 38.07 MB/sec execute 15 sec latency 26.265 ms 20 13694 39.06 MB/sec execute 16 sec latency 25.611 ms 20 14165 40.75 MB/sec execute 17 sec latency 27.778 ms 20 14528 41.30 MB/sec execute 18 sec latency 35.187 ms 20 14777 40.37 MB/sec execute 19 sec latency 30.797 ms 20 15044 39.42 MB/sec execute 20 sec latency 55.284 ms 20 15317 38.20 MB/sec execute 21 sec latency 74.607 ms 20 15582 37.29 MB/sec execute 22 sec latency 27.229 ms 20 15933 37.60 MB/sec execute 23 sec latency 29.448 ms 20 16244 37.29 MB/sec execute 24 sec latency 28.778 ms 20 16605 37.08 MB/sec execute 25 sec latency 32.237 ms 20 16944 37.07 MB/sec execute 26 sec latency 22.258 ms 20 17222 36.95 MB/sec execute 27 sec latency 30.798 ms 20 17624 37.78 MB/sec execute 28 sec latency 29.639 ms 20 18031 38.55 MB/sec execute 29 sec latency 48.220 ms 20 18300 38.29 MB/sec execute 30 sec latency 28.514 ms 20 18540 37.85 MB/sec execute 31 sec latency 32.910 ms 20 18799 36.90 MB/sec execute 32 sec latency 60.254 ms 20 19060 36.08 MB/sec execute 33 sec latency 28.351 ms 20 19367 35.79 MB/sec execute 34 sec latency 25.842 ms 20 19707 36.52 MB/sec execute 35 sec latency 28.577 ms 20 20053 36.34 MB/sec execute 36 sec latency 34.654 ms 20 20366 36.16 MB/sec execute 37 sec latency 25.249 ms 20 20631 35.72 MB/sec execute 38 sec latency 25.454 ms 20 20870 35.41 MB/sec execute 39 sec latency 74.040 ms 20 21270 36.10 MB/sec execute 40 sec latency 52.515 ms 20 21707 36.90 MB/sec execute 41 sec latency 23.935 ms 20 22007 36.97 MB/sec execute 42 sec latency 30.505 ms 20 22232 36.30 MB/sec execute 43 sec latency 31.650 ms 20 22465 35.58 MB/sec execute 44 sec latency 47.882 ms 20 22739 35.15 MB/sec execute 45 sec latency 25.928 ms 20 23022 35.02 MB/sec execute 46 sec latency 27.773 ms 20 23431 35.86 MB/sec execute 47 sec latency 39.961 ms 20 23743 35.77 MB/sec execute 48 sec latency 33.742 ms 20 23995 35.29 MB/sec execute 49 sec latency 30.286 ms 20 24278 34.90 MB/sec execute 50 sec latency 24.077 ms 20 24547 34.79 MB/sec execute 51 sec latency 36.983 ms 20 24978 35.42 MB/sec execute 52 sec latency 31.086 ms 20 25395 36.20 MB/sec execute 53 sec latency 27.810 ms 20 25651 35.92 MB/sec execute 54 sec latency 29.814 ms 20 25888 35.37 MB/sec execute 55 sec latency 28.679 ms 20 26157 34.94 MB/sec execute 56 sec latency 62.289 ms 20 26430 34.83 MB/sec execute 57 sec latency 38.089 ms 20 26816 35.15 MB/sec execute 58 sec latency 26.180 ms 20 27154 35.50 MB/sec execute 59 sec latency 33.271 ms 20 27398 35.15 MB/sec execute 60 sec latency 35.495 ms 20 27681 34.67 MB/sec execute 61 sec latency 37.964 ms 20 27990 34.49 MB/sec execute 62 sec latency 33.710 ms 20 28382 34.96 MB/sec execute 63 sec latency 34.890 ms 20 28847 35.54 MB/sec execute 64 sec latency 27.862 ms 20 29175 35.68 MB/sec execute 65 sec latency 24.208 ms 20 29439 35.29 MB/sec execute 66 sec latency 29.907 ms 20 29719 34.96 MB/sec execute 67 sec latency 57.528 ms 20 30110 35.12 MB/sec execute 68 sec latency 28.089 ms 20 30523 35.56 MB/sec execute 69 sec latency 52.376 ms 20 30851 35.57 MB/sec execute 70 sec latency 23.515 ms 20 31128 35.14 MB/sec execute 71 sec latency 53.413 ms 20 31476 34.92 MB/sec execute 72 sec latency 25.987 ms 20 31847 35.18 MB/sec execute 73 sec latency 22.657 ms 20 32340 35.70 MB/sec execute 74 sec latency 26.093 ms 20 32723 35.92 MB/sec execute 75 sec latency 27.017 ms 20 33020 35.75 MB/sec execute 76 sec latency 27.746 ms 20 33315 35.61 MB/sec execute 77 sec latency 51.084 ms 20 33697 35.69 MB/sec execute 78 sec latency 27.102 ms 20 34078 35.86 MB/sec execute 79 sec latency 21.681 ms 20 34372 35.90 MB/sec execute 80 sec latency 38.854 ms 20 34613 35.51 MB/sec execute 81 sec latency 51.125 ms 20 34910 35.21 MB/sec execute 82 sec latency 27.304 ms 20 35267 35.27 MB/sec execute 83 sec latency 20.858 ms 20 35705 35.70 MB/sec execute 84 sec latency 28.192 ms 20 36185 36.06 MB/sec execute 85 sec latency 33.499 ms 20 36467 35.98 MB/sec execute 86 sec latency 31.636 ms 20 36749 35.90 MB/sec execute 87 sec latency 24.432 ms 20 37088 35.84 MB/sec execute 88 sec latency 58.560 ms 20 37427 35.86 MB/sec execute 89 sec latency 29.217 ms 20 37747 35.94 MB/sec execute 90 sec latency 28.129 ms 20 38005 35.78 MB/sec execute 91 sec latency 44.769 ms 20 38276 35.47 MB/sec execute 92 sec latency 32.823 ms 20 38583 35.30 MB/sec execute 93 sec latency 23.579 ms 20 38894 35.32 MB/sec execute 94 sec latency 28.573 ms 20 39328 35.63 MB/sec execute 95 sec latency 26.377 ms 20 39815 35.90 MB/sec execute 96 sec latency 24.972 ms 20 40146 36.01 MB/sec execute 97 sec latency 24.990 ms 20 40489 36.04 MB/sec execute 98 sec latency 56.437 ms 20 40808 35.99 MB/sec execute 99 sec latency 59.346 ms 20 41095 35.88 MB/sec execute 100 sec latency 28.490 ms 20 41416 35.87 MB/sec execute 101 sec latency 34.900 ms 20 41709 35.74 MB/sec execute 102 sec latency 28.876 ms 20 42020 35.55 MB/sec execute 103 sec latency 27.374 ms 20 42397 35.52 MB/sec execute 104 sec latency 21.171 ms 20 42826 35.76 MB/sec execute 105 sec latency 24.981 ms 20 43339 36.06 MB/sec execute 106 sec latency 32.217 ms 20 43736 36.34 MB/sec execute 107 sec latency 26.395 ms 20 44124 36.40 MB/sec execute 108 sec latency 26.390 ms 20 44416 36.26 MB/sec execute 109 sec latency 68.257 ms 20 44697 36.11 MB/sec execute 110 sec latency 22.777 ms 20 45027 36.12 MB/sec execute 111 sec latency 47.844 ms 20 45345 36.01 MB/sec execute 112 sec latency 25.100 ms 20 45705 35.94 MB/sec execute 113 sec latency 21.919 ms 20 46080 35.82 MB/sec execute 114 sec latency 19.275 ms 20 46589 36.15 MB/sec execute 115 sec latency 22.706 ms 20 47151 36.68 MB/sec execute 116 sec latency 29.899 ms 20 47574 36.86 MB/sec execute 117 sec latency 24.379 ms 20 47857 36.71 MB/sec execute 118 sec latency 43.321 ms 20 48159 36.52 MB/sec execute 119 sec latency 34.451 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 140548 10.042 74.597 Close 103407 2.234 34.879 Rename 5991 13.602 51.068 Unlink 28438 3.150 30.026 Qpathinfo 127338 2.220 46.820 Qfileinfo 22180 0.070 6.047 Qfsinfo 23463 0.029 7.359 Sfileinfo 11648 6.976 41.969 Find 49258 0.441 65.779 WriteX 69649 1.334 35.229 ReadX 220196 0.012 3.338 LockX 454 2.492 12.675 UnlockX 454 2.495 19.676 Flush 10026 9.487 86.284 Throughput 36.5192 MB/sec 20 clients 20 procs max_latency=86.292 ms stopping dbench on /mnt/lustre/d0.oleg117-client.virtnet at Mon Jul 29 03:27:44 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg117-client.virtnet /mnt/lustre/d0.oleg117-client.virtnet /mnt/lustre/d0.oleg117-client.virtnet removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg117-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 03:27:47 (1722238067) min OST has 3380616kB available, using 5070924kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7433] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4952] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg117-clien 4952M 140711 99 137259 97 231630 53 4288 258 Latency 12439us 158ms 61527us 4999us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg117-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 434 19 3424 20 670 15 438 19 548 15 693 15 Latency 21279us 5250us 27921us 19698us 19098us 79358us 1.97,1.97,oleg117-client.virtnet,1,1722248698,4952M,,,,140711,99,137259,97,,,231630,53,4288,258,10,,,,,434,19,3424,20,670,15,438,19,548,15,693,15,,12439us,158ms,,61527us,4999us,21279us,5250us,27921us,19698us,19098us,79358us debug=0x33f0484 PASS bonnie (202s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 03:31:10 (1722238270) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 28152 -P /tmp -l 5392128 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 28152 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole skipping zero size read skipping zero size read truncating to largest ever: 0x30bb96 fallocating to largest ever: 0x40731e truncating to largest ever: 0x41e1f8 truncating to largest ever: 0x447c5c truncating to largest ever: 0x50bd3e fallocating to largest ever: 0x51d241 fallocating to largest ever: 0x521a1d fallocating to largest ever: 0x524700 001000 1722238273.707440 punch from 0x148936 to 0x153170 (0xa83b bytes) 004000 1722238281.147181 write 0x2d7ae0 thru 0x2e0a89 (0x8faa bytes) 008000 1722238292.008756 punch from 0x2fbe59 to 0x309f1b (0xe0c3 bytes) 010000 1722238297.039485 punch from 0x135aa9 to 0x14454e (0xeaa6 bytes) 013000 1722238304.860312 mapwrite 0x365b01 thru 0x36ed6a (0x926a bytes) 014000 1722238307.442593 mapwrite 0x4438a6 thru 0x450612 (0xcd6d bytes) 018000 1722238318.873943 punch from 0x17279d to 0x17d608 (0xae6c bytes) 019000 1722238321.658651 mapread 0x43c7f8 thru 0x44a7ff (0xe008 bytes) 021000 1722238327.496614 punch from 0x39ffd5 to 0x3a2027 (0x2053 bytes) 022000 1722238329.786267 mapread 0x27a627 thru 0x27e24f (0x3c29 bytes) 023000 1722238332.464139 fallocate 0x25bcb0 thru 0x25de53 (0x21a4 bytes) 024000 1722238335.435412 punch from 0x2f43ac to 0x2fc359 (0x7fae bytes) skipping zero length fallocate 025000 1722238338.022219 read 0x033aa6 thru 0x043617 (0xfb72 bytes) 026000 1722238341.071562 write 0x31654d thru 0x31d683 (0x7137 bytes) 027000 1722238343.686876 fallocate 0x14d096 thru 0x14f1ef (0x215a bytes) 028000 1722238346.333360 mapwrite 0x4ef448 thru 0x4fe96b (0xf524 bytes) 029000 1722238349.254013 mapread 0x195a08 thru 0x199b2f (0x4128 bytes) 030000 1722238351.907894 mapread 0x0d2c35 thru 0x0d2ca0 (0x6c bytes) 031000 1722238354.355980 mapwrite 0x51c647 thru 0x5246ff (0x80b9 bytes) 032000 1722238356.543221 punch from 0x0892d2 to 0x0939da (0xa709 bytes) 033000 1722238359.146391 read 0x13a1a8 thru 0x146d34 (0xcb8d bytes) 034000 1722238362.044375 mapread 0x010a7a thru 0x0125f9 (0x1b80 bytes) 037000 1722238370.406118 write 0x1e7998 thru 0x1e7f2a (0x593 bytes) 038000 1722238372.943818 read 0x21e635 thru 0x2218ab (0x3277 bytes) 039000 1722238375.981622 punch from 0x13c55b to 0x14b232 (0xecd8 bytes) 041000 1722238381.798508 write 0x454b5f thru 0x458d75 (0x4217 bytes) 042000 1722238384.546094 mapwrite 0x14acde thru 0x154a83 (0x9da6 bytes) 043000 1722238387.218075 read 0x066079 thru 0x06c4cd (0x6455 bytes) 044000 1722238389.880906 trunc from 0x027b5a to 0x27b3b6 (0x25385d bytes) 046000 1722238395.220289 mapwrite 0x48a487 thru 0x48c447 (0x1fc1 bytes) 047000 1722238398.327148 fallocate 0x36d3ec thru 0x36f682 (0x2297 bytes) 049000 1722238404.049580 trunc from 0x345555 to 0x29ea4c (0xa6b08 bytes) 051000 1722238408.906583 mapread 0x24736c thru 0x248bff (0x1894 bytes) skipping zero size write 053000 1722238413.840783 mapread 0x02249e thru 0x028049 (0x5bac bytes) 054000 1722238416.512119 punch from 0x17eb0a to 0x1842b1 (0x57a8 bytes) 055000 1722238419.224303 trunc from 0x497167 to 0x194c70 (0x3024f6 bytes) 056000 1722238421.520075 read 0x1709e7 thru 0x17afb9 (0xa5d3 bytes) 057000 1722238423.979760 punch from 0x1ec7ac to 0x1f2f1d (0x6772 bytes) 058000 1722238426.645436 mapread 0x154d23 thru 0x15f21e (0xa4fc bytes) 059000 1722238429.245422 fallocate 0x1419d0 thru 0x144721 (0x2d52 bytes) 060000 1722238431.643716 mapread 0x2d190d thru 0x2dacd1 (0x93c5 bytes) 061000 1722238434.554535 mapwrite 0x5240a8 thru 0x5240d1 (0x2a bytes) 062000 1722238437.194839 fallocate 0x05807f thru 0x067a09 (0xf98b bytes) 064000 1722238442.841855 mapread 0x073ac9 thru 0x0804af (0xc9e7 bytes) 065000 1722238445.651103 mapread 0x253b39 thru 0x2550cd (0x1595 bytes) 066000 1722238448.544700 mapwrite 0x3e5825 thru 0x3ece98 (0x7674 bytes) 067000 1722238451.417810 mapwrite 0x099bfd thru 0x0a237a (0x877e bytes) 068000 1722238454.103512 write 0x3f8322 thru 0x407f2b (0xfc0a bytes) 069000 1722238457.190970 trunc from 0x1b2108 to 0x4a62f2 (0x2f41eb bytes) 070000 1722238459.836123 mapwrite 0x046845 thru 0x05399c (0xd158 bytes) 071000 1722238462.564559 mapread 0x4a1879 thru 0x4b1321 (0xfaa9 bytes) 072000 1722238465.224533 mapwrite 0x463904 thru 0x4676e5 (0x3de2 bytes) 074000 1722238470.085960 fallocate 0x4d97fb thru 0x4dd1da (0x39e0 bytes) 075000 1722238472.644350 mapread 0x0eceaf thru 0x0ef060 (0x21b2 bytes) 076000 1722238475.105268 mapwrite 0x4ddbf7 thru 0x4e6574 (0x897e bytes) 077000 1722238477.662888 fallocate 0x04935e thru 0x050ac8 (0x776b bytes) 078000 1722238480.307727 punch from 0x135979 to 0x141360 (0xb9e8 bytes) 079000 1722238482.974059 trunc from 0x5149eb to 0x2b2275 (0x262775 bytes) 080000 1722238485.883888 mapwrite 0x049b23 thru 0x04c53f (0x2a1d bytes) 081000 1722238488.647379 write 0x439727 thru 0x441579 (0x7e53 bytes) 082000 1722238491.195685 mapread 0x1270bf thru 0x136948 (0xf88a bytes) 083000 1722238493.442588 mapwrite 0x0743f1 thru 0x083d35 (0xf945 bytes) 084000 1722238495.803678 mapread 0x1955d3 thru 0x19835e (0x2d8c bytes) 085000 1722238498.053517 fallocate 0x39538e thru 0x399829 (0x449c bytes) 086000 1722238500.607167 mapwrite 0x35ac94 thru 0x3658cc (0xac39 bytes) 087000 1722238502.861013 trunc from 0x456ef0 to 0x114426 (0x342ac9 bytes) 088000 1722238504.995283 write 0x1733c7 thru 0x182a2b (0xf665 bytes) 089000 1722238507.519457 mapwrite 0x0ef4aa thru 0x0f95c7 (0xa11e bytes) 091000 1722238512.746422 mapwrite 0x1c6bc3 thru 0x1c7faa (0x13e8 bytes) 093000 1722238517.842683 trunc from 0x517648 to 0x37a12d (0x19d51a bytes) 094000 1722238519.872527 fallocate 0x287726 thru 0x2936ec (0xbfc7 bytes) 095000 1722238522.418833 fallocate 0x46587d thru 0x468c7f (0x3403 bytes) 096000 1722238524.821366 fallocate 0x383532 thru 0x38705a (0x3b29 bytes) 098000 1722238529.363110 write 0x50418a thru 0x50a69c (0x6513 bytes) 099000 1722238531.806285 trunc from 0x1a1d54 to 0x2c4b58 (0x122e05 bytes) 100000 1722238533.920676 punch from 0x444c91 to 0x44f3ee (0xa75e bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (264s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 03:35:34 (1722238534) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1722238538.291181 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1722238540.875363 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1722238552.435204 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1722238555.134806 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1722238558.127532 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1722238560.792686 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1722238563.646121 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1722238569.036892 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1722238572.038538 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1722238577.843331 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1722238581.392931 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1722238587.530526 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1722238590.794076 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1722238606.691006 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1722238613.931328 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1722238618.385748 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1722238624.448966 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1722238628.991187 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1722238634.089620 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1722238639.321184 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1722238645.598711 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1722238657.492468 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1722238662.852731 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1722238667.097048 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1722238671.437654 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1722238675.382075 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1722238679.268220 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1722238683.121696 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1722238687.947199 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1722238692.702428 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1722238696.530379 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1722238699.955136 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1722238709.235196 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1722238714.247435 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1722238718.404279 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1722238722.670192 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1722238735.708516 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1722238739.670133 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1722238744.250432 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1722238749.136713 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1722238753.680142 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1722238758.388770 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1722238766.778756 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1722238770.684173 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1722238775.207745 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1722238787.570379 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1722238796.687139 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1722238800.809521 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1722238804.686638 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1722238812.128593 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1722238821.243306 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1722238826.086666 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1722238830.831097 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1722238839.051756 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1722238842.809469 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1722238847.495159 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1722238851.263218 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1722238855.848113 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1722238860.227401 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1722238869.083386 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1722238876.988119 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1722238881.012073 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1722238884.414847 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1722238888.176826 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1722238895.280737 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1722238904.414726 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1722238913.113533 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1722238917.242413 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1722238921.583085 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1722238925.137664 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1722238928.796822 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1722238935.734072 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1722238939.502249 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1722238943.207289 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1722238951.390548 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (418s) == sanity-benchmark test complete, duration 1043 sec ===== 03:42:32 (1722238952)