-----============= acceptance-small: sanity-benchmark ============----- Wed Jan 15 20:22:57 EST 2025 excepting tests: skipping tests SLOW=no: iozone oleg210-client.virtnet: executing check_config_client /mnt/lustre oleg210-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg210-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6051800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6051800.idle_timeout=debug disable quota as required oleg210-server: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 20:23:07 (1736990587) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7455] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg210-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg210-client.virtnet at Wed Jan 15 20:23:08 EST 2025 waiting for dbench pid 9594 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 245 186.53 MB/sec warmup 1 sec latency 49.794 ms 20 527 182.84 MB/sec warmup 2 sec latency 36.751 ms 20 714 141.43 MB/sec warmup 3 sec latency 653.511 ms 20 1054 114.32 MB/sec warmup 4 sec latency 24.539 ms 20 1473 104.11 MB/sec warmup 5 sec latency 31.129 ms 20 1853 87.86 MB/sec warmup 6 sec latency 20.540 ms 20 2287 78.07 MB/sec warmup 7 sec latency 19.459 ms 20 2778 78.43 MB/sec warmup 8 sec latency 26.312 ms 20 3466 81.53 MB/sec warmup 9 sec latency 25.850 ms 20 3874 79.72 MB/sec warmup 10 sec latency 22.713 ms 20 4150 73.03 MB/sec warmup 11 sec latency 52.249 ms 20 4449 67.98 MB/sec warmup 12 sec latency 51.210 ms 20 4856 66.47 MB/sec warmup 13 sec latency 26.979 ms 20 5258 64.78 MB/sec warmup 14 sec latency 29.049 ms 20 5668 61.37 MB/sec warmup 15 sec latency 20.847 ms 20 6113 60.87 MB/sec warmup 16 sec latency 20.376 ms 20 6681 63.52 MB/sec warmup 17 sec latency 25.730 ms 20 7186 64.05 MB/sec warmup 18 sec latency 26.486 ms 20 7474 62.13 MB/sec warmup 19 sec latency 25.974 ms 20 7697 59.36 MB/sec warmup 20 sec latency 50.687 ms 20 7952 57.12 MB/sec warmup 21 sec latency 62.712 ms 20 8255 56.18 MB/sec warmup 22 sec latency 29.942 ms 20 8593 55.43 MB/sec warmup 23 sec latency 27.774 ms 20 9100 10.24 MB/sec execute 1 sec latency 39.974 ms 20 9401 14.76 MB/sec execute 2 sec latency 25.624 ms 20 9890 31.99 MB/sec execute 3 sec latency 27.258 ms 20 10437 48.16 MB/sec execute 4 sec latency 30.484 ms 20 10908 51.90 MB/sec execute 5 sec latency 22.361 ms 20 11195 46.47 MB/sec execute 6 sec latency 54.548 ms 20 11454 41.54 MB/sec execute 7 sec latency 58.230 ms 20 11761 40.04 MB/sec execute 8 sec latency 34.251 ms 20 12047 37.74 MB/sec execute 9 sec latency 102.781 ms 20 12399 38.21 MB/sec execute 10 sec latency 38.190 ms 20 12654 35.98 MB/sec execute 11 sec latency 32.924 ms 20 13006 36.27 MB/sec execute 12 sec latency 25.578 ms 20 13382 36.74 MB/sec execute 13 sec latency 35.677 ms 20 13737 38.12 MB/sec execute 14 sec latency 37.059 ms 20 14206 39.66 MB/sec execute 15 sec latency 31.011 ms 20 14586 40.61 MB/sec execute 16 sec latency 39.865 ms 20 14840 39.48 MB/sec execute 17 sec latency 37.116 ms 20 15085 38.26 MB/sec execute 18 sec latency 61.480 ms 20 15366 37.03 MB/sec execute 19 sec latency 33.855 ms 20 15709 36.36 MB/sec execute 20 sec latency 21.626 ms 20 16067 36.93 MB/sec execute 21 sec latency 29.347 ms 20 16470 37.13 MB/sec execute 22 sec latency 23.863 ms 20 16926 37.47 MB/sec execute 23 sec latency 28.578 ms 20 17348 38.46 MB/sec execute 24 sec latency 21.468 ms 20 17923 40.11 MB/sec execute 25 sec latency 50.321 ms 20 18308 40.36 MB/sec execute 26 sec latency 21.482 ms 20 18687 39.89 MB/sec execute 27 sec latency 32.703 ms 20 19027 38.87 MB/sec execute 28 sec latency 49.069 ms 20 19461 39.32 MB/sec execute 29 sec latency 23.216 ms 20 19906 39.83 MB/sec execute 30 sec latency 30.017 ms 20 20401 39.94 MB/sec execute 31 sec latency 19.787 ms 20 20770 39.75 MB/sec execute 32 sec latency 22.698 ms 20 21283 40.78 MB/sec execute 33 sec latency 41.800 ms 20 21778 41.68 MB/sec execute 34 sec latency 24.611 ms 20 22095 41.67 MB/sec execute 35 sec latency 27.660 ms 20 22380 40.63 MB/sec execute 36 sec latency 49.080 ms 20 22714 39.91 MB/sec execute 37 sec latency 25.441 ms 20 23108 40.36 MB/sec execute 38 sec latency 22.503 ms 20 23603 40.97 MB/sec execute 39 sec latency 51.706 ms 20 24009 40.71 MB/sec execute 40 sec latency 20.131 ms 20 24399 40.41 MB/sec execute 41 sec latency 36.105 ms 20 24899 41.24 MB/sec execute 42 sec latency 30.488 ms 20 25394 42.13 MB/sec execute 43 sec latency 24.323 ms 20 25711 41.87 MB/sec execute 44 sec latency 27.179 ms 20 26051 41.07 MB/sec execute 45 sec latency 52.100 ms 20 26409 40.78 MB/sec execute 46 sec latency 23.724 ms 20 26922 41.80 MB/sec execute 47 sec latency 33.919 ms 20 27352 41.75 MB/sec execute 48 sec latency 24.786 ms 20 27776 41.26 MB/sec execute 49 sec latency 19.137 ms 20 28190 41.41 MB/sec execute 50 sec latency 34.578 ms 20 28799 42.50 MB/sec execute 51 sec latency 25.249 ms 20 29207 42.73 MB/sec execute 52 sec latency 23.373 ms 20 29532 42.08 MB/sec execute 53 sec latency 55.584 ms 20 29909 41.84 MB/sec execute 54 sec latency 32.725 ms 20 30382 42.27 MB/sec execute 55 sec latency 24.454 ms 20 30771 42.57 MB/sec execute 56 sec latency 30.627 ms 20 31031 41.97 MB/sec execute 57 sec latency 28.297 ms 20 31388 41.48 MB/sec execute 58 sec latency 45.948 ms 20 31781 41.64 MB/sec execute 59 sec latency 29.141 ms 20 32355 42.50 MB/sec execute 60 sec latency 31.439 ms 20 32787 42.70 MB/sec execute 61 sec latency 21.036 ms 20 33133 42.24 MB/sec execute 62 sec latency 22.854 ms 20 33499 42.17 MB/sec execute 63 sec latency 39.319 ms 20 33954 42.40 MB/sec execute 64 sec latency 23.336 ms 20 34333 42.62 MB/sec execute 65 sec latency 24.116 ms 20 34606 42.05 MB/sec execute 66 sec latency 41.619 ms 20 34977 41.64 MB/sec execute 67 sec latency 36.154 ms 20 35445 41.99 MB/sec execute 68 sec latency 23.945 ms 20 36021 42.65 MB/sec execute 69 sec latency 40.003 ms 20 36445 42.73 MB/sec execute 70 sec latency 23.801 ms 20 36755 42.42 MB/sec execute 71 sec latency 50.246 ms 20 37201 42.49 MB/sec execute 72 sec latency 28.187 ms 20 37611 42.70 MB/sec execute 73 sec latency 21.638 ms 20 37966 42.63 MB/sec execute 74 sec latency 27.502 ms 20 38318 42.17 MB/sec execute 75 sec latency 42.240 ms 20 38764 42.11 MB/sec execute 76 sec latency 21.215 ms 20 39295 42.69 MB/sec execute 77 sec latency 21.829 ms 20 39853 43.04 MB/sec execute 78 sec latency 20.454 ms 20 40239 43.01 MB/sec execute 79 sec latency 22.471 ms 20 40698 43.02 MB/sec execute 80 sec latency 57.675 ms 20 41106 43.09 MB/sec execute 81 sec latency 30.326 ms 20 41454 43.12 MB/sec execute 82 sec latency 36.146 ms 20 41749 42.68 MB/sec execute 83 sec latency 31.787 ms 20 42120 42.40 MB/sec execute 84 sec latency 24.173 ms 20 42520 42.44 MB/sec execute 85 sec latency 20.359 ms 20 43090 42.86 MB/sec execute 86 sec latency 24.278 ms 20 43561 43.19 MB/sec execute 87 sec latency 21.149 ms 20 43957 43.26 MB/sec execute 88 sec latency 24.761 ms 20 44353 43.18 MB/sec execute 89 sec latency 58.482 ms 20 44659 43.02 MB/sec execute 90 sec latency 28.057 ms 20 45047 43.07 MB/sec execute 91 sec latency 28.290 ms 20 45363 42.73 MB/sec execute 92 sec latency 25.806 ms 20 45809 42.62 MB/sec execute 93 sec latency 21.091 ms 20 46241 42.69 MB/sec execute 94 sec latency 20.516 ms 20 46842 43.10 MB/sec execute 95 sec latency 25.292 ms 20 47288 43.47 MB/sec execute 96 sec latency 26.913 ms 20 47673 43.45 MB/sec execute 97 sec latency 26.273 ms 20 48026 43.25 MB/sec execute 98 sec latency 45.586 ms 20 48354 43.04 MB/sec execute 99 sec latency 38.939 ms 20 48737 43.07 MB/sec execute 100 sec latency 30.188 ms 20 49118 42.92 MB/sec execute 101 sec latency 21.836 ms 20 49548 42.75 MB/sec execute 102 sec latency 19.315 ms 20 50079 43.06 MB/sec execute 103 sec latency 19.919 ms 20 50671 43.60 MB/sec execute 104 sec latency 22.290 ms 20 51094 43.73 MB/sec execute 105 sec latency 29.218 ms 20 51396 43.52 MB/sec execute 106 sec latency 76.886 ms 20 51704 43.24 MB/sec execute 107 sec latency 28.579 ms 20 52048 43.14 MB/sec execute 108 sec latency 40.339 ms 20 52403 43.10 MB/sec execute 109 sec latency 31.254 ms 20 52790 42.95 MB/sec execute 110 sec latency 21.322 ms 20 53218 42.79 MB/sec execute 111 sec latency 17.824 ms 20 53754 43.15 MB/sec execute 112 sec latency 18.753 ms 20 54391 43.69 MB/sec execute 113 sec latency 20.030 ms 20 54780 43.78 MB/sec execute 114 sec latency 25.564 ms 20 55069 43.49 MB/sec execute 115 sec latency 50.662 ms 20 55399 43.27 MB/sec execute 116 sec latency 33.273 ms 20 55820 43.37 MB/sec execute 117 sec latency 21.335 ms 20 56198 43.26 MB/sec execute 118 sec latency 30.520 ms 20 56639 43.02 MB/sec execute 119 sec latency 21.857 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 166892 8.486 76.878 Close 123053 1.857 22.685 Rename 7054 11.526 42.826 Unlink 33420 2.706 41.004 Qpathinfo 151804 1.882 57.664 Qfileinfo 26570 0.062 9.567 Qfsinfo 27503 0.026 3.712 Sfileinfo 13627 5.907 33.923 Find 58454 0.370 50.286 WriteX 82654 1.110 42.084 ReadX 261248 0.011 3.663 LockX 546 2.075 8.263 UnlockX 546 2.115 8.929 Flush 11614 7.769 102.775 Throughput 43.0162 MB/sec 20 clients 20 procs max_latency=102.781 ms stopping dbench on /mnt/lustre/d0.oleg210-client.virtnet at Wed Jan 15 20:25:32 EST 2025 with return code 0 clean dbench files on /mnt/lustre/d0.oleg210-client.virtnet /mnt/lustre/d0.oleg210-client.virtnet /mnt/lustre/d0.oleg210-client.virtnet removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg210-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 20:25:35 (1736990735) min OST has 3433048kB available, using 5149572kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7455] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5028] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg210-clien 5028M 146429 98 135799 97 263912 55 5467 277 Latency 7135us 139ms 45955us 5613us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg210-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 519 18 3560 17 740 15 455 17 563 16 745 14 Latency 23958us 5464us 17184us 16072us 9780us 13584us 1.97,1.97,oleg210-client.virtnet,1,1736985024,5028M,,,,146429,98,135799,97,,,263912,55,5467,277,10,,,,,519,18,3560,17,740,15,455,17,563,16,745,14,,7135us,139ms,,45955us,5613us,23958us,5464us,17184us,16072us,9780us,13584us debug=0x33f0484 PASS bonnie (191s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 20:28:47 (1736990927) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 4277 -P /tmp -l 5401104 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 4277 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x4bceb7 truncating to largest ever: 0x52197b fallocating to largest ever: 0x523f4a 001000 1736990930.818478 trunc from 0x521ee6 to 0x2d0a51 (0x251494 bytes) fallocating to largest ever: 0x526a10 002000 1736990933.787710 mapwrite 0x3fb010 thru 0x3ffa64 (0x4a55 bytes) 004000 1736990938.555405 read 0x16a2de thru 0x179a59 (0xf77c bytes) 005000 1736990941.300445 read 0x061df6 thru 0x06bd94 (0x9f9f bytes) 006000 1736990944.018326 write 0x36e2f0 thru 0x36ff10 (0x1c21 bytes) 007000 1736990946.203107 fallocate 0x2de65b thru 0x2eb1b0 (0xcb56 bytes) 008000 1736990948.646582 punch from 0x40b61c to 0x417fdc (0xc9c1 bytes) 009000 1736990951.353305 write 0x405cb5 thru 0x40a39c (0x46e8 bytes) 010000 1736990953.740884 fallocate 0x4a8c11 thru 0x4b2db5 (0xa1a5 bytes) 011000 1736990956.220908 fallocate 0x060b94 thru 0x06f226 (0xe693 bytes) 012000 1736990958.927342 punch from 0x229ca0 to 0x22a3c1 (0x722 bytes) 014000 1736990964.368843 punch from 0x02101e to 0x02ccb3 (0xbc96 bytes) 016000 1736990969.590086 read 0x1181fe thru 0x11a16f (0x1f72 bytes) 018000 1736990974.387068 mapread 0x3e9ddc thru 0x3f3862 (0x9a87 bytes) 019000 1736990976.780707 write 0x22cda2 thru 0x23a08b (0xd2ea bytes) 021000 1736990982.967671 trunc from 0x49981a to 0x4c4c94 (0x2b47b bytes) 023000 1736990988.133871 trunc from 0x481bf3 to 0x0ea024 (0x397bce bytes) 024000 1736990991.061130 read 0x111fba thru 0x11ca6d (0xaab4 bytes) 025000 1736990993.519152 punch from 0x220efa to 0x228fbf (0x80c6 bytes) 027000 1736990998.563639 read 0x18534c thru 0x18cd5e (0x7a13 bytes) skipping zero size read 029000 1736991003.642951 read 0x12860c thru 0x12bf94 (0x3989 bytes) 031000 1736991010.037004 write 0x35ebce thru 0x36ea6c (0xfe9f bytes) 032000 1736991012.936580 write 0x3b614c thru 0x3c43a5 (0xe25a bytes) 033000 1736991015.814891 write 0x35602a thru 0x35bb26 (0x5afd bytes) 035000 1736991022.050138 read 0x47efdd thru 0x4819b9 (0x29dd bytes) 036000 1736991024.604272 mapread 0x010067 thru 0x01f560 (0xf4fa bytes) 037000 1736991027.629230 trunc from 0x18da4e to 0x357cf2 (0x1ca2a5 bytes) 039000 1736991032.453645 punch from 0x09f98f to 0x0aa0ba (0xa72c bytes) 041000 1736991037.892010 mapread 0x36b56a thru 0x379ceb (0xe782 bytes) 042000 1736991040.348879 mapwrite 0x1e2250 thru 0x1efef8 (0xdca9 bytes) 047000 1736991053.615779 write 0x34fd18 thru 0x35c207 (0xc4f0 bytes) 048000 1736991056.129474 mapread 0x3f340c thru 0x3f35da (0x1cf bytes) 049000 1736991059.025196 mapread 0x18a289 thru 0x18c458 (0x21d0 bytes) 051000 1736991064.281625 trunc from 0x51de2e to 0x4d7841 (0x465ec bytes) 052000 1736991067.195714 fallocate 0x0ce401 thru 0x0d9bb2 (0xb7b2 bytes) 053000 1736991069.982607 write 0x28f991 thru 0x299111 (0x9781 bytes) 054000 1736991072.353253 trunc from 0x388d16 to 0x39d829 (0x14b14 bytes) 055000 1736991074.928663 write 0x0743fa thru 0x0765c2 (0x21c9 bytes) 056000 1736991077.986600 trunc from 0x4dbf28 to 0x383d29 (0x1581fe bytes) 059000 1736991086.201419 write 0x183c4c thru 0x187c24 (0x3fd9 bytes) 060000 1736991088.800244 mapread 0x0c21e3 thru 0x0c5e1d (0x3c3b bytes) 062000 1736991094.436192 fallocate 0x0dbe95 thru 0x0dc18c (0x2f8 bytes) 063000 1736991097.395803 read 0x03c307 thru 0x0486a8 (0xc3a2 bytes) 064000 1736991100.152762 write 0x20d295 thru 0x214069 (0x6dd5 bytes) 065000 1736991103.263077 fallocate 0x1cd8eb thru 0x1cf635 (0x1d4b bytes) 066000 1736991106.088748 fallocate 0x029f82 thru 0x0310da (0x7159 bytes) 067000 1736991108.412026 mapread 0x2604a6 thru 0x26e30c (0xde67 bytes) 068000 1736991110.812069 trunc from 0x2b43b5 to 0x2bf208 (0xae54 bytes) 069000 1736991113.266892 punch from 0x19cc66 to 0x1a0741 (0x3adc bytes) 070000 1736991115.918971 read 0x1c7bf0 thru 0x1cfa7b (0x7e8c bytes) 072000 1736991121.134777 mapread 0x1ff291 thru 0x20e92e (0xf69e bytes) 073000 1736991123.498384 read 0x003680 thru 0x0090fd (0x5a7e bytes) 074000 1736991126.222560 write 0x00607f thru 0x00dbcb (0x7b4d bytes) 075000 1736991128.423934 read 0x178638 thru 0x1843a6 (0xbd6f bytes) 076000 1736991131.040629 punch from 0x09f667 to 0x0a3c90 (0x462a bytes) 077000 1736991133.671603 write 0x4357ac thru 0x43e7f1 (0x9046 bytes) 079000 1736991138.975387 mapwrite 0x4b6c58 thru 0x4c1abf (0xae68 bytes) 080000 1736991141.513703 punch from 0x3c5aa6 to 0x3cfa01 (0x9f5c bytes) 081000 1736991144.227331 punch from 0x2ea0a7 to 0x2ea3a1 (0x2fb bytes) 083000 1736991149.343897 mapread 0x3ce3e2 thru 0x3dbce7 (0xd906 bytes) 084000 1736991152.005445 trunc from 0x23a23d to 0x39707c (0x15ce40 bytes) 085000 1736991154.531342 punch from 0x3374db to 0x33805d (0xb83 bytes) 086000 1736991157.303598 read 0x181231 thru 0x18b19c (0x9f6c bytes) 088000 1736991162.464320 write 0x39d193 thru 0x3a249a (0x5308 bytes) 090000 1736991167.765078 fallocate 0x212142 thru 0x215fba (0x3e79 bytes) 091000 1736991170.298485 write 0x3bb1a5 thru 0x3c1501 (0x635d bytes) 092000 1736991172.738921 fallocate 0x1301b7 thru 0x134766 (0x45b0 bytes) 093000 1736991175.042807 write 0x3c693e thru 0x3cc088 (0x574b bytes) 094000 1736991177.393345 fallocate 0x14d0d0 thru 0x14deb0 (0xde1 bytes) 095000 1736991179.686808 punch from 0x002936 to 0x005d96 (0x3461 bytes) 096000 1736991182.066821 write 0x087a5f thru 0x08a7d0 (0x2d72 bytes) 097000 1736991184.348733 mapwrite 0x515052 thru 0x518c27 (0x3bd6 bytes) 098000 1736991186.597189 mapwrite 0x3214f9 thru 0x32ba03 (0xa50b bytes) 099000 1736991189.340616 mapread 0x21b6bc thru 0x2209e7 (0x532c bytes) 100000 1736991191.859037 write 0x3247f3 thru 0x33068b (0xbe99 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (265s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 20:33:13 (1736991193) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1736991196.593254 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1736991199.377088 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1736991210.679095 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1736991213.539128 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1736991216.345878 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1736991219.246225 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1736991222.330992 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1736991227.743265 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1736991230.330363 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1736991235.732714 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1736991238.833233 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1736991244.703693 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1736991247.147391 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1736991253.768206 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1736991256.847946 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1736991259.686549 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1736991262.869899 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1736991265.764110 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1736991269.135153 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1736991272.068803 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1736991274.732695 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1736991280.764956 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1736991283.986515 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1736991286.761183 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1736991289.596921 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1736991292.500555 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1736991295.269742 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1736991298.248161 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1736991301.255016 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1736991304.450945 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1736991307.420082 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1736991310.384143 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1736991315.973723 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1736991318.982768 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1736991321.968111 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1736991325.406830 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1736991334.737952 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1736991337.736617 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1736991340.748244 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1736991343.689747 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1736991346.391601 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1736991349.140826 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1736991355.010672 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1736991358.037672 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1736991361.062742 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1736991370.538063 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1736991376.904141 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1736991379.812640 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1736991382.843842 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1736991388.981812 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1736991395.087737 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1736991398.450138 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1736991401.685325 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1736991407.859657 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1736991410.667744 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1736991413.947876 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1736991416.713604 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1736991419.691109 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1736991422.468105 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1736991428.140526 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1736991433.996189 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1736991436.686025 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1736991439.211604 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1736991442.556413 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1736991448.163838 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1736991454.027732 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1736991459.875646 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1736991462.646350 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1736991465.496275 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1736991468.459736 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1736991471.918679 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1736991478.077128 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1736991480.761279 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1736991483.734725 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1736991490.162393 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (298s) == sanity-benchmark test complete, duration 913 sec ====== 20:38:11 (1736991491)