-----============= acceptance-small: sanity-benchmark ============----- Sun Feb 25 00:28:12 EST 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 00:28:14 (1708838894) === oleg125-client.virtnet: executing check_config_client /mnt/lustre oleg125-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg125-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800abb32000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800abb32000.idle_timeout=debug disable quota as required oleg125-server: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 00:28:22 (1708838902) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 00:28:24 (1708838904) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7336] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg125-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg125-client.virtnet at Sun Feb 25 00:28:24 EST 2024 waiting for dbench pid 9470 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 293 217.46 MB/sec warmup 1 sec latency 43.117 ms 20 662 211.00 MB/sec warmup 2 sec latency 34.861 ms 20 998 147.19 MB/sec warmup 3 sec latency 18.678 ms 20 1470 130.15 MB/sec warmup 4 sec latency 30.148 ms 20 1852 105.42 MB/sec warmup 5 sec latency 19.452 ms 20 2320 92.15 MB/sec warmup 6 sec latency 16.744 ms 20 2687 86.98 MB/sec warmup 7 sec latency 235.317 ms 20 3387 90.33 MB/sec warmup 8 sec latency 26.836 ms 20 3814 88.24 MB/sec warmup 9 sec latency 22.498 ms 20 4083 80.14 MB/sec warmup 10 sec latency 25.598 ms 20 4390 73.84 MB/sec warmup 11 sec latency 41.072 ms 20 4738 70.22 MB/sec warmup 12 sec latency 21.278 ms 20 5152 69.62 MB/sec warmup 13 sec latency 29.013 ms 20 5506 65.08 MB/sec warmup 14 sec latency 21.762 ms 20 5939 62.65 MB/sec warmup 15 sec latency 20.879 ms 20 6482 65.29 MB/sec warmup 16 sec latency 22.246 ms 20 7145 67.49 MB/sec warmup 17 sec latency 21.245 ms 20 7456 65.65 MB/sec warmup 18 sec latency 25.986 ms 20 7744 62.44 MB/sec warmup 19 sec latency 70.078 ms 20 8075 60.25 MB/sec warmup 20 sec latency 23.524 ms 20 8515 60.64 MB/sec warmup 21 sec latency 22.348 ms 20 8874 58.65 MB/sec warmup 22 sec latency 19.581 ms 20 9308 56.67 MB/sec warmup 23 sec latency 16.661 ms 20 10446 104.22 MB/sec execute 1 sec latency 26.663 ms 20 10878 91.45 MB/sec execute 2 sec latency 24.451 ms 20 11134 64.52 MB/sec execute 3 sec latency 21.141 ms 20 11439 50.67 MB/sec execute 4 sec latency 42.797 ms 20 11783 46.61 MB/sec execute 5 sec latency 22.252 ms 20 12205 49.43 MB/sec execute 6 sec latency 26.324 ms 20 12548 43.22 MB/sec execute 7 sec latency 24.001 ms 20 12998 40.97 MB/sec execute 8 sec latency 15.936 ms 20 13505 46.98 MB/sec execute 9 sec latency 21.242 ms 20 14157 52.82 MB/sec execute 10 sec latency 24.749 ms 20 14505 51.99 MB/sec execute 11 sec latency 21.614 ms 20 14756 48.05 MB/sec execute 12 sec latency 28.685 ms 20 14975 45.00 MB/sec execute 13 sec latency 327.333 ms 20 15281 43.61 MB/sec execute 14 sec latency 350.755 ms 20 15705 45.23 MB/sec execute 15 sec latency 24.118 ms 20 16023 42.73 MB/sec execute 16 sec latency 21.043 ms 20 16423 41.15 MB/sec execute 17 sec latency 25.620 ms 20 16794 41.64 MB/sec execute 18 sec latency 31.945 ms 20 17444 44.95 MB/sec execute 19 sec latency 28.910 ms 20 17906 47.15 MB/sec execute 20 sec latency 25.161 ms 20 18164 45.60 MB/sec execute 21 sec latency 28.319 ms 20 18429 43.77 MB/sec execute 22 sec latency 39.701 ms 20 18751 42.95 MB/sec execute 23 sec latency 28.133 ms 20 19147 43.54 MB/sec execute 24 sec latency 20.338 ms 20 19494 42.59 MB/sec execute 25 sec latency 22.695 ms 20 19903 41.29 MB/sec execute 26 sec latency 18.548 ms 20 20335 41.60 MB/sec execute 27 sec latency 21.418 ms 20 21026 44.34 MB/sec execute 28 sec latency 26.752 ms 20 21526 45.83 MB/sec execute 29 sec latency 27.297 ms 20 21799 44.72 MB/sec execute 30 sec latency 21.895 ms 20 22105 43.57 MB/sec execute 31 sec latency 45.530 ms 20 22477 43.11 MB/sec execute 32 sec latency 21.828 ms 20 22928 43.81 MB/sec execute 33 sec latency 22.756 ms 20 23300 42.72 MB/sec execute 34 sec latency 19.516 ms 20 23730 42.35 MB/sec execute 35 sec latency 21.340 ms 20 24307 44.07 MB/sec execute 36 sec latency 28.865 ms 20 24956 45.75 MB/sec execute 37 sec latency 23.436 ms 20 25267 45.34 MB/sec execute 38 sec latency 24.884 ms 20 25580 44.36 MB/sec execute 39 sec latency 32.742 ms 20 25939 43.96 MB/sec execute 40 sec latency 22.901 ms 20 26374 44.34 MB/sec execute 41 sec latency 21.823 ms 20 26746 43.64 MB/sec execute 42 sec latency 17.933 ms 20 27202 43.26 MB/sec execute 43 sec latency 27.809 ms 20 27733 44.30 MB/sec execute 44 sec latency 20.248 ms 20 28402 45.84 MB/sec execute 45 sec latency 20.644 ms 20 28756 45.74 MB/sec execute 46 sec latency 20.656 ms 20 29048 44.88 MB/sec execute 47 sec latency 39.097 ms 20 29400 44.34 MB/sec execute 48 sec latency 28.510 ms 20 29874 44.86 MB/sec execute 49 sec latency 18.549 ms 20 30242 44.29 MB/sec execute 50 sec latency 21.655 ms 20 30719 43.87 MB/sec execute 51 sec latency 17.371 ms 20 31194 44.60 MB/sec execute 52 sec latency 22.988 ms 20 31888 45.89 MB/sec execute 53 sec latency 24.762 ms 20 32263 45.99 MB/sec execute 54 sec latency 22.479 ms 20 32541 45.28 MB/sec execute 55 sec latency 40.144 ms 20 32883 44.77 MB/sec execute 56 sec latency 28.781 ms 20 33317 45.08 MB/sec execute 57 sec latency 21.480 ms 20 33680 44.74 MB/sec execute 58 sec latency 20.897 ms 20 34099 44.17 MB/sec execute 59 sec latency 20.446 ms 20 34564 44.39 MB/sec execute 60 sec latency 21.191 ms 20 35250 45.55 MB/sec execute 61 sec latency 24.086 ms 20 35723 46.10 MB/sec execute 62 sec latency 21.179 ms 20 35996 45.58 MB/sec execute 63 sec latency 46.612 ms 20 36288 45.00 MB/sec execute 64 sec latency 49.754 ms 20 36665 44.83 MB/sec execute 65 sec latency 23.938 ms 20 37100 45.08 MB/sec execute 66 sec latency 19.895 ms 20 37473 44.51 MB/sec execute 67 sec latency 20.006 ms 20 37898 44.29 MB/sec execute 68 sec latency 22.425 ms 20 38422 44.99 MB/sec execute 69 sec latency 24.093 ms 20 39022 45.76 MB/sec execute 70 sec latency 22.618 ms 20 39370 45.78 MB/sec execute 71 sec latency 23.948 ms 20 39627 45.21 MB/sec execute 72 sec latency 48.851 ms 20 39935 44.77 MB/sec execute 73 sec latency 63.131 ms 20 40326 44.79 MB/sec execute 74 sec latency 20.045 ms 20 40705 44.78 MB/sec execute 75 sec latency 24.697 ms 20 41062 44.28 MB/sec execute 76 sec latency 21.577 ms 20 41474 44.11 MB/sec execute 77 sec latency 23.111 ms 20 42020 44.80 MB/sec execute 78 sec latency 25.222 ms 20 42597 45.43 MB/sec execute 79 sec latency 31.522 ms 20 42913 45.39 MB/sec execute 80 sec latency 22.511 ms 20 43156 44.90 MB/sec execute 81 sec latency 36.137 ms 20 43487 44.52 MB/sec execute 82 sec latency 27.771 ms 20 43870 44.52 MB/sec execute 83 sec latency 22.222 ms 20 44261 44.54 MB/sec execute 84 sec latency 21.569 ms 20 44664 44.12 MB/sec execute 85 sec latency 20.310 ms 20 45095 44.09 MB/sec execute 86 sec latency 18.809 ms 20 45764 44.90 MB/sec execute 87 sec latency 24.374 ms 20 46272 45.37 MB/sec execute 88 sec latency 24.773 ms 20 46572 45.15 MB/sec execute 89 sec latency 23.366 ms 20 46883 44.72 MB/sec execute 90 sec latency 39.711 ms 20 47214 44.52 MB/sec execute 91 sec latency 24.554 ms 20 47658 44.76 MB/sec execute 92 sec latency 23.171 ms 20 48005 44.37 MB/sec execute 93 sec latency 18.636 ms 20 48436 44.15 MB/sec execute 94 sec latency 18.452 ms 20 48946 44.53 MB/sec execute 95 sec latency 830.218 ms 20 49571 45.19 MB/sec execute 96 sec latency 1830.315 ms 20 49931 45.20 MB/sec execute 97 sec latency 2830.397 ms 20 50201 44.80 MB/sec execute 98 sec latency 3830.489 ms 20 50526 44.51 MB/sec execute 99 sec latency 4830.574 ms 20 50912 44.60 MB/sec execute 100 sec latency 5830.681 ms 20 51281 44.45 MB/sec execute 101 sec latency 6830.783 ms 20 51673 44.12 MB/sec execute 102 sec latency 7830.889 ms 20 52067 44.16 MB/sec execute 103 sec latency 8830.978 ms 20 52721 44.79 MB/sec execute 104 sec latency 9831.059 ms 20 53164 45.08 MB/sec execute 105 sec latency 10831.153 ms 20 53442 44.86 MB/sec execute 106 sec latency 11021.680 ms 20 53747 44.54 MB/sec execute 107 sec latency 42.456 ms 20 54072 44.39 MB/sec execute 108 sec latency 24.699 ms 20 54470 44.49 MB/sec execute 109 sec latency 22.172 ms 20 54827 44.24 MB/sec execute 110 sec latency 21.386 ms 20 55259 44.03 MB/sec execute 111 sec latency 18.478 ms 20 55768 44.35 MB/sec execute 112 sec latency 21.761 ms 20 56403 44.85 MB/sec execute 113 sec latency 24.187 ms 20 56796 44.96 MB/sec execute 114 sec latency 22.892 ms 20 57064 44.70 MB/sec execute 115 sec latency 31.063 ms 20 57404 44.47 MB/sec execute 116 sec latency 23.210 ms 20 57756 44.37 MB/sec execute 117 sec latency 20.796 ms 20 58143 44.43 MB/sec execute 118 sec latency 21.275 ms 20 58493 44.13 MB/sec execute 119 sec latency 20.069 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 170424 8.143 11021.674 Close 125052 1.911 30.462 Rename 7176 10.672 34.994 Unlink 34433 2.953 26.119 Qpathinfo 154192 1.920 32.158 Qfileinfo 26807 0.068 5.658 Qfsinfo 28274 0.056 5.137 Sfileinfo 13758 6.270 40.668 Find 59554 0.505 36.485 WriteX 83842 0.918 16.880 ReadX 266580 0.013 4.302 LockX 557 2.072 7.392 UnlockX 557 2.060 7.204 Flush 11941 7.499 350.746 Throughput 44.1324 MB/sec 20 clients 20 procs max_latency=11021.680 ms stopping dbench on /mnt/lustre/d0.oleg125-client.virtnet at Sun Feb 25 00:30:49 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg125-client.virtnet /mnt/lustre/d0.oleg125-client.virtnet /mnt/lustre/d0.oleg125-client.virtnet removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg125-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (147s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 00:30:53 (1708839053) min OST has 3356676kB available, using 5035014kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7336] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4917] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg125-clien 4917M 163757 98 155083 99 401720 82 6180 336 Latency 4114us 37467us 35804us 6006us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg125-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 328 27 3574 53 373 39 345 26 621 42 380 36 Latency 19039us 17441us 28456us 11759us 7302us 30539us 1.97,1.97,oleg125-client.virtnet,1,1708849442,4917M,,,,163757,98,155083,99,,,401720,82,6180,336,10,,,,,328,27,3574,53,373,39,345,26,621,42,380,36,,4114us,37467us,,35804us,6006us,19039us,17441us,28456us,11759us,7302us,30539us debug=0x33f0484 PASS bonnie (218s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 00:34:33 (1708839273) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 31458 -P /tmp -l 5408244 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 31458 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x294664 fallocating to largest ever: 0x4ffb0f truncating to largest ever: 0x51710b fallocating to largest ever: 0x5285f4 skipping zero size read 002000 1708839278.707689 write 0x3da45e thru 0x3e04fc (0x609f bytes) 004000 1708839282.918204 punch from 0x1a6976 to 0x1a848e (0x1b19 bytes) 006000 1708839287.218157 fallocate 0x421e5e thru 0x42d443 (0xb5e6 bytes) 008000 1708839292.254964 write 0x27cb8b thru 0x27e318 (0x178e bytes) 009000 1708839295.613803 mapread 0x367afd thru 0x37513f (0xd643 bytes) 012000 1708839303.060567 write 0x2af965 thru 0x2bf0a8 (0xf744 bytes) 013000 1708839305.370593 trunc from 0x13b619 to 0x066452 (0xd51c6 bytes) 015000 1708839310.116008 fallocate 0x00a523 thru 0x014b6a (0xa648 bytes) 016000 1708839312.841281 write 0x30c1b0 thru 0x31a865 (0xe6b6 bytes) 017000 1708839315.582425 fallocate 0x46e773 thru 0x471c5a (0x34e8 bytes) 018000 1708839318.535586 punch from 0x11cfa6 to 0x129f30 (0xcf8b bytes) 020000 1708839322.674337 trunc from 0x34cec7 to 0x3360e2 (0x16de4 bytes) 022000 1708839327.815358 mapwrite 0x515476 thru 0x517d9a (0x2925 bytes) 023000 1708839329.903668 mapread 0x058025 thru 0x05a27a (0x2256 bytes) 025000 1708839334.247000 write 0x191494 thru 0x19a432 (0x8f9f bytes) 026000 1708839336.223137 write 0x14a031 thru 0x14c98e (0x295e bytes) 027000 1708839338.365951 write 0x0959cf thru 0x098ceb (0x331d bytes) 029000 1708839342.630482 read 0x3983fb thru 0x39c917 (0x451d bytes) 031000 1708839347.793857 mapwrite 0x0706d5 thru 0x075ab9 (0x53e5 bytes) 032000 1708839349.986741 mapread 0x0ffcd0 thru 0x100981 (0xcb2 bytes) 033000 1708839352.136701 punch from 0x2fdb11 to 0x2ff751 (0x1c41 bytes) 034000 1708839354.321519 punch from 0x1f35c2 to 0x1f8093 (0x4ad2 bytes) 035000 1708839356.837907 fallocate 0x34534c thru 0x3459dc (0x691 bytes) 037000 1708839360.992256 trunc from 0x47b3bc to 0x185761 (0x2f5c5a bytes) 038000 1708839363.102635 write 0x4101f1 thru 0x4191a9 (0x8fb9 bytes) 039000 1708839365.428114 read 0x1abfa4 thru 0x1ac485 (0x4e2 bytes) 040000 1708839367.681868 trunc from 0x40cbc8 to 0x06e5e4 (0x39e5e3 bytes) 041000 1708839369.962039 trunc from 0x18188f to 0x1b1436 (0x2fba8 bytes) 042000 1708839372.362463 read 0x29ed1e thru 0x2a06c1 (0x19a4 bytes) 045000 1708839379.253242 write 0x48bcb8 thru 0x497dd0 (0xc119 bytes) 046000 1708839381.322038 mapread 0x016db5 thru 0x020b32 (0x9d7e bytes) 047000 1708839383.357808 trunc from 0x4c3395 to 0x460779 (0x62c1b bytes) 048000 1708839385.385640 read 0x0fd276 thru 0x106641 (0x93cc bytes) 049000 1708839387.565270 mapwrite 0x45bd23 thru 0x467936 (0xbc14 bytes) 050000 1708839389.657929 trunc from 0x437c48 to 0x2566b6 (0x1e1591 bytes) 051000 1708839391.824448 fallocate 0x30bf70 thru 0x31addc (0xee6d bytes) 053000 1708839396.106282 trunc from 0x5285f4 to 0x0eba8b (0x43cb68 bytes) 055000 1708839400.660783 mapwrite 0x12bf17 thru 0x12d700 (0x17ea bytes) 056000 1708839402.634059 read 0x2dff79 thru 0x2e525e (0x52e6 bytes) 057000 1708839405.038301 write 0x0afdbf thru 0x0be695 (0xe8d7 bytes) 059000 1708839409.394210 mapwrite 0x1c4d92 thru 0x1cb421 (0x6690 bytes) 060000 1708839411.546922 mapread 0x19c739 thru 0x1a4d83 (0x864b bytes) 061000 1708839413.736166 mapread 0x0676f8 thru 0x06b2cd (0x3bd6 bytes) 062000 1708839415.838695 write 0x0e3976 thru 0x0e90d3 (0x575e bytes) 065000 1708839422.608462 fallocate 0x1f266d thru 0x1f6bb3 (0x4547 bytes) 066000 1708839424.701681 mapwrite 0x2df22f thru 0x2eab08 (0xb8da bytes) 067000 1708839427.085356 punch from 0x4db361 to 0x4df288 (0x3f28 bytes) 068000 1708839429.645471 mapwrite 0x1f5df6 thru 0x1f715f (0x136a bytes) 069000 1708839431.515689 mapread 0x097cc4 thru 0x0a0001 (0x833e bytes) 070000 1708839433.618899 write 0x16b511 thru 0x178ca4 (0xd794 bytes) 071000 1708839436.024743 mapread 0x0ebfee thru 0x0efd67 (0x3d7a bytes) 074000 1708839442.550924 read 0x3e8393 thru 0x3edb91 (0x57ff bytes) 075000 1708839444.656421 read 0x043b2d thru 0x048b81 (0x5055 bytes) 076000 1708839446.887300 write 0x39f621 thru 0x3aa896 (0xb276 bytes) 077000 1708839449.093732 trunc from 0x355eff to 0x23fc68 (0x116296 bytes) 078000 1708839451.452194 write 0x25cb92 thru 0x25f254 (0x26c3 bytes) 079000 1708839453.663181 mapwrite 0x04196e thru 0x049c75 (0x8308 bytes) 080000 1708839455.939770 read 0x18740b thru 0x18f8e8 (0x84de bytes) 081000 1708839458.014511 trunc from 0x4cfd2f to 0x1a279a (0x32d594 bytes) 082000 1708839460.082970 write 0x2d1ee7 thru 0x2e1c60 (0xfd7a bytes) 083000 1708839462.255798 punch from 0x05038a to 0x0557e0 (0x5457 bytes) 084000 1708839464.333044 mapwrite 0x1b00bb thru 0x1b68af (0x67f5 bytes) 088000 1708839472.944245 mapwrite 0x35fe7e thru 0x368e3c (0x8fbf bytes) 089000 1708839475.477377 read 0x0ccf92 thru 0x0d1d89 (0x4df8 bytes) 091000 1708839480.022406 fallocate 0x2c220a thru 0x2c8b70 (0x6967 bytes) 092000 1708839482.105296 mapwrite 0x328543 thru 0x3317fb (0x92b9 bytes) 093000 1708839484.091015 mapread 0x3e9a76 thru 0x3f4274 (0xa7ff bytes) 096000 1708839491.015659 fallocate 0x058c1e thru 0x065658 (0xca3b bytes) 098000 1708839495.427356 punch from 0x07e0e6 to 0x080a57 (0x2972 bytes) 099000 1708839497.691393 mapread 0x20abda thru 0x218dc8 (0xe1ef bytes) 100000 1708839499.898227 mapwrite 0x42d112 thru 0x439568 (0xc457 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (227s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 00:38:22 (1708839502) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1708839505.500429 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1708839508.194041 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1708839510.895172 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1708839513.694104 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1708839518.879630 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1708839521.432402 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1708839524.460066 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1708839527.137785 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1708839529.686365 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1708839532.189589 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1708839534.872486 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1708839537.415864 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1708839539.635936 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1708839542.250446 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1708839544.731799 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1708839547.099456 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1708839549.689695 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1708839552.649489 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1708839555.293590 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1708839564.878864 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1708839567.493319 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1708839570.127297 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1708839573.077338 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1708839578.543367 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1708839583.799420 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1708839586.933814 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1708839590.408727 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1708839597.704693 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1708839600.975601 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1708839608.171974 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1708839610.959783 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1708839613.624154 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1708839617.189957 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1708839620.443445 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1708839625.762526 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1708839635.088738 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1708839644.517832 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1708839650.463354 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1708839653.328692 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1708839656.683833 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1708839665.050445 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1708839668.788460 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1708839671.743381 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1708839676.989365 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1708839681.068733 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1708839685.006350 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1708839689.832184 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1708839694.256927 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1708839698.875092 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1708839706.670196 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1708839711.824379 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1708839716.214377 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1708839721.134499 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1708839726.851741 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1708839736.191959 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1708839748.048242 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1708839756.798718 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1708839760.387745 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1708839765.038305 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1708839774.326422 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1708839778.720796 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1708839786.150595 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1708839790.421985 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1708839798.315751 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1708839807.060391 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1708839816.091414 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1708839820.230394 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1708839823.796438 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1708839827.689991 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1708839834.895637 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1708839838.317576 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1708839845.267507 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1708839850.245894 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (349s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 958 sec ====== 00:44:11 (1708839851) === sanity-benchmark: start cleanup 00:44:12 (1708839852) === === sanity-benchmark: finish cleanup 00:44:12 (1708839852) ===