-----============= acceptance-small: sanity-benchmark ============----- Thu Apr 4 20:05:34 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 20:05:36 (1712275536) === oleg137-client.virtnet: executing check_config_client /mnt/lustre oleg137-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg137-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b66b6000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b66b6000.idle_timeout=debug disable quota as required oleg137-server: oleg137-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 20:05:43 (1712275543) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 20:05:44 (1712275544) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7329] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg137-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg137-client.virtnet at Thu Apr 4 20:05:45 EDT 2024 waiting for dbench pid 9463 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 287 213.29 MB/sec warmup 1 sec latency 45.099 ms 20 630 208.49 MB/sec warmup 2 sec latency 44.524 ms 20 948 145.25 MB/sec warmup 3 sec latency 78.681 ms 20 1386 127.94 MB/sec warmup 4 sec latency 24.976 ms 20 1753 105.07 MB/sec warmup 5 sec latency 32.240 ms 20 2125 88.89 MB/sec warmup 6 sec latency 24.670 ms 20 2500 81.88 MB/sec warmup 7 sec latency 26.410 ms 20 3067 84.40 MB/sec warmup 8 sec latency 31.795 ms 20 3627 85.75 MB/sec warmup 9 sec latency 30.763 ms 20 3918 80.02 MB/sec warmup 10 sec latency 24.426 ms 20 4194 72.99 MB/sec warmup 11 sec latency 36.874 ms 20 4458 67.96 MB/sec warmup 12 sec latency 50.022 ms 20 4799 65.12 MB/sec warmup 13 sec latency 25.039 ms 20 5192 64.70 MB/sec warmup 14 sec latency 28.378 ms 20 5565 60.84 MB/sec warmup 15 sec latency 24.286 ms 20 5991 59.12 MB/sec warmup 16 sec latency 19.256 ms 20 6580 62.00 MB/sec warmup 17 sec latency 24.472 ms 20 7225 64.30 MB/sec warmup 18 sec latency 22.951 ms 20 7507 62.26 MB/sec warmup 19 sec latency 25.110 ms 20 7773 59.36 MB/sec warmup 20 sec latency 53.279 ms 20 8074 57.32 MB/sec warmup 21 sec latency 31.875 ms 20 8505 57.88 MB/sec warmup 22 sec latency 22.548 ms 20 8853 56.09 MB/sec warmup 23 sec latency 30.027 ms 20 9717 59.65 MB/sec execute 1 sec latency 24.453 ms 20 10391 82.28 MB/sec execute 2 sec latency 22.512 ms 20 10852 83.79 MB/sec execute 3 sec latency 25.266 ms 20 11109 65.82 MB/sec execute 4 sec latency 23.359 ms 20 11389 54.04 MB/sec execute 5 sec latency 41.136 ms 20 11717 49.59 MB/sec execute 6 sec latency 26.920 ms 20 12126 51.76 MB/sec execute 7 sec latency 25.123 ms 20 12456 46.34 MB/sec execute 8 sec latency 23.579 ms 20 12860 42.55 MB/sec execute 9 sec latency 17.668 ms 20 13242 43.15 MB/sec execute 10 sec latency 26.936 ms 20 13905 49.46 MB/sec execute 11 sec latency 22.984 ms 20 14382 52.69 MB/sec execute 12 sec latency 25.345 ms 20 14624 49.64 MB/sec execute 13 sec latency 27.704 ms 20 14901 46.50 MB/sec execute 14 sec latency 44.893 ms 20 15215 45.08 MB/sec execute 15 sec latency 24.558 ms 20 15628 46.01 MB/sec execute 16 sec latency 26.603 ms 20 15972 44.27 MB/sec execute 17 sec latency 21.292 ms 20 16360 42.38 MB/sec execute 18 sec latency 21.040 ms 20 16714 42.22 MB/sec execute 19 sec latency 42.415 ms 20 17342 45.56 MB/sec execute 20 sec latency 25.522 ms 20 17849 47.71 MB/sec execute 21 sec latency 25.053 ms 20 18143 46.71 MB/sec execute 22 sec latency 24.010 ms 20 18433 44.89 MB/sec execute 23 sec latency 35.863 ms 20 18741 43.87 MB/sec execute 24 sec latency 24.840 ms 20 19151 44.72 MB/sec execute 25 sec latency 18.831 ms 20 19499 43.64 MB/sec execute 26 sec latency 24.616 ms 20 19912 42.35 MB/sec execute 27 sec latency 20.083 ms 20 20341 42.57 MB/sec execute 28 sec latency 21.773 ms 20 20991 44.99 MB/sec execute 29 sec latency 85.062 ms 20 21512 46.54 MB/sec execute 30 sec latency 24.000 ms 20 21800 45.53 MB/sec execute 31 sec latency 23.165 ms 20 22095 44.36 MB/sec execute 32 sec latency 67.001 ms 20 22440 43.91 MB/sec execute 33 sec latency 26.728 ms 20 22850 44.45 MB/sec execute 34 sec latency 24.740 ms 20 23183 43.42 MB/sec execute 35 sec latency 21.514 ms 20 23607 42.79 MB/sec execute 36 sec latency 16.811 ms 20 24080 43.70 MB/sec execute 37 sec latency 23.004 ms 20 24754 45.54 MB/sec execute 38 sec latency 23.149 ms 20 25078 45.68 MB/sec execute 39 sec latency 202.590 ms 20 25376 44.85 MB/sec execute 40 sec latency 20.944 ms 20 25703 44.02 MB/sec execute 41 sec latency 36.251 ms 20 26090 43.89 MB/sec execute 42 sec latency 22.825 ms 20 26501 44.15 MB/sec execute 43 sec latency 27.665 ms 20 26877 43.30 MB/sec execute 44 sec latency 20.944 ms 20 27327 43.13 MB/sec execute 45 sec latency 17.863 ms 20 28009 44.73 MB/sec execute 46 sec latency 20.140 ms 20 28595 46.00 MB/sec execute 47 sec latency 20.251 ms 20 28891 45.34 MB/sec execute 48 sec latency 20.282 ms 20 29194 44.59 MB/sec execute 49 sec latency 41.333 ms 20 29541 44.26 MB/sec execute 50 sec latency 22.077 ms 20 29974 44.70 MB/sec execute 51 sec latency 27.506 ms 20 30359 43.97 MB/sec execute 52 sec latency 20.889 ms 20 30821 43.74 MB/sec execute 53 sec latency 18.254 ms 20 31456 44.92 MB/sec execute 54 sec latency 21.800 ms 20 32082 46.04 MB/sec execute 55 sec latency 20.668 ms 20 32387 45.67 MB/sec execute 56 sec latency 21.518 ms 20 32678 44.99 MB/sec execute 57 sec latency 35.813 ms 20 33046 44.73 MB/sec execute 58 sec latency 24.417 ms 20 33469 45.01 MB/sec execute 59 sec latency 21.294 ms 20 33831 44.45 MB/sec execute 60 sec latency 21.553 ms 20 34294 44.17 MB/sec execute 61 sec latency 17.727 ms 20 34802 44.90 MB/sec execute 62 sec latency 21.396 ms 20 35479 46.00 MB/sec execute 63 sec latency 23.504 ms 20 35840 45.91 MB/sec execute 64 sec latency 21.295 ms 20 36130 45.28 MB/sec execute 65 sec latency 36.050 ms 20 36459 44.84 MB/sec execute 66 sec latency 31.242 ms 20 36895 45.21 MB/sec execute 67 sec latency 24.229 ms 20 37271 44.82 MB/sec execute 68 sec latency 22.119 ms 20 37691 44.34 MB/sec execute 69 sec latency 23.404 ms 20 38158 44.67 MB/sec execute 70 sec latency 19.495 ms 20 38871 45.75 MB/sec execute 71 sec latency 23.376 ms 20 39291 46.03 MB/sec execute 72 sec latency 25.316 ms 20 39558 45.53 MB/sec execute 73 sec latency 21.985 ms 20 39882 45.06 MB/sec execute 74 sec latency 44.306 ms 20 40272 44.91 MB/sec execute 75 sec latency 23.788 ms 20 40710 45.11 MB/sec execute 76 sec latency 19.950 ms 20 41094 44.62 MB/sec execute 77 sec latency 17.825 ms 20 41506 44.50 MB/sec execute 78 sec latency 19.562 ms 20 42082 45.21 MB/sec execute 79 sec latency 20.931 ms 20 42676 45.88 MB/sec execute 80 sec latency 20.826 ms 20 42985 45.74 MB/sec execute 81 sec latency 23.500 ms 20 43257 45.24 MB/sec execute 82 sec latency 39.033 ms 20 43587 44.96 MB/sec execute 83 sec latency 23.485 ms 20 44013 45.18 MB/sec execute 84 sec latency 19.747 ms 20 44377 44.86 MB/sec execute 85 sec latency 18.738 ms 20 44847 44.57 MB/sec execute 86 sec latency 15.699 ms 20 45343 45.01 MB/sec execute 87 sec latency 20.687 ms 20 46047 45.78 MB/sec execute 88 sec latency 26.351 ms 20 46425 45.86 MB/sec execute 89 sec latency 23.652 ms 20 46694 45.43 MB/sec execute 90 sec latency 42.045 ms 20 47018 45.07 MB/sec execute 91 sec latency 37.220 ms 20 47418 45.09 MB/sec execute 92 sec latency 20.073 ms 20 47825 45.09 MB/sec execute 93 sec latency 20.327 ms 20 48245 44.70 MB/sec execute 94 sec latency 17.619 ms 20 48697 44.73 MB/sec execute 95 sec latency 20.019 ms 20 49377 45.49 MB/sec execute 96 sec latency 25.377 ms 20 49885 45.95 MB/sec execute 97 sec latency 19.535 ms 20 50166 45.62 MB/sec execute 98 sec latency 22.242 ms 20 50470 45.24 MB/sec execute 99 sec latency 39.982 ms 20 50817 45.08 MB/sec execute 100 sec latency 24.400 ms 20 51231 45.28 MB/sec execute 101 sec latency 30.671 ms 20 51559 44.89 MB/sec execute 102 sec latency 20.826 ms 20 52017 44.70 MB/sec execute 103 sec latency 15.811 ms 20 52547 45.19 MB/sec execute 104 sec latency 21.353 ms 20 53212 45.77 MB/sec execute 105 sec latency 25.447 ms 20 53556 45.75 MB/sec execute 106 sec latency 24.382 ms 20 53828 45.37 MB/sec execute 107 sec latency 33.981 ms 20 54125 45.06 MB/sec execute 108 sec latency 46.634 ms 20 54507 45.06 MB/sec execute 109 sec latency 25.682 ms 20 54880 45.07 MB/sec execute 110 sec latency 27.839 ms 20 55243 44.72 MB/sec execute 111 sec latency 25.176 ms 20 55671 44.63 MB/sec execute 112 sec latency 17.948 ms 20 56282 45.19 MB/sec execute 113 sec latency 21.468 ms 20 56879 45.70 MB/sec execute 114 sec latency 23.423 ms 20 57190 45.52 MB/sec execute 115 sec latency 20.646 ms 20 57490 45.18 MB/sec execute 116 sec latency 40.169 ms 20 57855 45.03 MB/sec execute 117 sec latency 22.762 ms 20 58279 45.20 MB/sec execute 118 sec latency 27.731 ms 20 58640 44.90 MB/sec execute 119 sec latency 23.511 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 172215 8.009 66.995 Close 126629 1.924 21.953 Rename 7296 10.536 32.016 Unlink 34766 2.943 26.182 Qpathinfo 156193 1.920 37.750 Qfileinfo 27250 0.068 8.922 Qfsinfo 28617 0.054 5.783 Sfileinfo 14071 6.284 36.764 Find 60370 0.503 40.323 WriteX 85123 0.924 15.631 ReadX 270050 0.012 5.238 LockX 560 2.091 6.531 UnlockX 560 2.082 7.046 Flush 12060 7.049 202.582 Throughput 44.9041 MB/sec 20 clients 20 procs max_latency=202.590 ms stopping dbench on /mnt/lustre/d0.oleg137-client.virtnet at Thu Apr 4 20:08:10 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg137-client.virtnet /mnt/lustre/d0.oleg137-client.virtnet /mnt/lustre/d0.oleg137-client.virtnet removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg137-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 20:08:14 (1712275694) min OST has 3366300kB available, using 5049450kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7329] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4931] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg137-clien 4931M 168354 98 155169 91 383050 71 6718 341 Latency 6231us 34864us 42682us 4134us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg137-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 341 26 3736 52 363 34 315 25 657 38 402 35 Latency 18230us 8113us 32682us 15094us 6828us 13442us 1.97,1.97,oleg137-client.virtnet,1,1712286066,4931M,,,,168354,98,155169,91,,,383050,71,6718,341,10,,,,,341,26,3736,52,363,34,315,25,657,38,402,35,,6231us,34864us,,42682us,4134us,18230us,8113us,32682us,15094us,6828us,13442us debug=0x33f0484 PASS bonnie (218s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 20:11:54 (1712275914) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 10753 -P /tmp -l 5408244 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 10753 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole skipping zero size read skipping zero size read skipping zero length punch hole truncating to largest ever: 0x108930 fallocating to largest ever: 0x39f241 fallocating to largest ever: 0x443c3e fallocating to largest ever: 0x4db3ad fallocating to largest ever: 0x5103e9 fallocating to largest ever: 0x5122f0 fallocating to largest ever: 0x5285f4 001000 1712275917.971931 read 0x037ed6 thru 0x03a311 (0x243c bytes) 002000 1712275919.931200 read 0x1fed6a thru 0x2001ff (0x1496 bytes) 003000 1712275922.115462 read 0x1ec7d9 thru 0x1f8400 (0xbc28 bytes) 004000 1712275923.930890 mapwrite 0x51ce40 thru 0x52839c (0xb55d bytes) skipping zero size read 007000 1712275930.278767 mapread 0x0bd209 thru 0x0cd16f (0xff67 bytes) 008000 1712275932.334461 fallocate 0x2ba191 thru 0x2c8e45 (0xecb5 bytes) 009000 1712275935.368050 write 0x0c2348 thru 0x0c27a6 (0x45f bytes) 011000 1712275940.349842 write 0x0da763 thru 0x0e802c (0xd8ca bytes) 012000 1712275943.020045 trunc from 0x47da44 to 0x0da9eb (0x3a3058 bytes) 013000 1712275945.723739 mapwrite 0x2d79aa thru 0x2de121 (0x6778 bytes) 014000 1712275948.801560 mapread 0x011309 thru 0x01a431 (0x9129 bytes) 015000 1712275952.203561 punch from 0x099257 to 0x0a239c (0x9146 bytes) 016000 1712275956.273237 write 0x2a39c2 thru 0x2a9b7f (0x61be bytes) 017000 1712275959.448849 mapread 0x2fb77b thru 0x30a9b9 (0xf23f bytes) 018000 1712275961.795213 mapread 0x121a6b thru 0x124adc (0x3072 bytes) 019000 1712275964.200610 trunc from 0x45bc36 to 0x0fdce1 (0x35df54 bytes) 022000 1712275973.671393 fallocate 0x0390ed thru 0x041ac5 (0x89d9 bytes) 023000 1712275977.039979 read 0x3731b9 thru 0x377b2d (0x4975 bytes) 024000 1712275981.034666 mapwrite 0x13ae6e thru 0x13df96 (0x3129 bytes) 025000 1712275983.408379 mapread 0x0a8d2a thru 0x0b1482 (0x8759 bytes) 026000 1712275986.512930 fallocate 0x360b9b thru 0x36d5db (0xca41 bytes) 028000 1712275991.533846 mapread 0x0b5b1b thru 0x0c340b (0xd8f1 bytes) 029000 1712275993.630936 mapwrite 0x3a7720 thru 0x3a9202 (0x1ae3 bytes) 030000 1712275996.193228 punch from 0x0ee9c3 to 0x0effd6 (0x1614 bytes) 033000 1712276003.959175 trunc from 0x45fc1c to 0x3043be (0x15b85d bytes) 034000 1712276007.050278 write 0x340567 thru 0x35012f (0xfbc9 bytes) 035000 1712276010.078880 mapwrite 0x255d5e thru 0x256aec (0xd8f bytes) 036000 1712276013.176620 mapread 0x2dcd87 thru 0x2dd96e (0xbe8 bytes) 038000 1712276020.113619 mapwrite 0x522e87 thru 0x523706 (0x880 bytes) 039000 1712276023.359903 write 0x1a2c87 thru 0x1b0a42 (0xddbc bytes) 040000 1712276026.965907 mapread 0x119e64 thru 0x11bab7 (0x1c54 bytes) 041000 1712276030.411762 punch from 0x002e04 to 0x00bcb0 (0x8ead bytes) 045000 1712276044.102777 punch from 0x25bf7e to 0x26bae8 (0xfb6b bytes) skipping zero size read 046000 1712276047.481620 mapread 0x21c4cd thru 0x228de0 (0xc914 bytes) 047000 1712276050.214390 trunc from 0x41b915 to 0x3c2ae8 (0x58e2c bytes) 048000 1712276053.911160 punch from 0x025afc to 0x03255f (0xca64 bytes) 049000 1712276057.229264 write 0x14bf1f thru 0x14e844 (0x2926 bytes) 050000 1712276060.033744 fallocate 0x3b13ac thru 0x3b3038 (0x1c8d bytes) 051000 1712276064.183919 mapread 0x37b998 thru 0x37e380 (0x29e9 bytes) 054000 1712276073.167795 read 0x0728f9 thru 0x07cf64 (0xa66c bytes) 055000 1712276077.004154 mapwrite 0x0028b6 thru 0x00e134 (0xb87f bytes) 057000 1712276083.614788 trunc from 0x449aec to 0x44f579 (0x5a8e bytes) 058000 1712276085.720042 mapread 0x258bf0 thru 0x268698 (0xfaa9 bytes) 059000 1712276088.340005 mapread 0x09ea56 thru 0x0a2430 (0x39db bytes) 060000 1712276090.860620 punch from 0x29743e to 0x2a5ba5 (0xe768 bytes) 061000 1712276093.848875 write 0x394d80 thru 0x3a1df0 (0xd071 bytes) 063000 1712276099.770380 trunc from 0x4d145d to 0x1aaab7 (0x3269a5 bytes) 065000 1712276106.296652 read 0x021c0c thru 0x026145 (0x453a bytes) 066000 1712276109.332472 read 0x3432d2 thru 0x348929 (0x5658 bytes) 067000 1712276111.576809 fallocate 0x176496 thru 0x18098d (0xa4f8 bytes) 071000 1712276124.098380 read 0x1b4883 thru 0x1b4f98 (0x716 bytes) 072000 1712276126.755996 write 0x2ea1a7 thru 0x2efb7d (0x59d7 bytes) 075000 1712276136.305852 fallocate 0x523320 thru 0x5285f3 (0x52d4 bytes) 076000 1712276138.680415 punch from 0x127a01 to 0x128107 (0x707 bytes) 079000 1712276146.625172 fallocate 0x2ec8d0 thru 0x2f3522 (0x6c53 bytes) 080000 1712276149.797651 write 0x11174c thru 0x1196af (0x7f64 bytes) 082000 1712276156.775644 write 0x1fc756 thru 0x2004c5 (0x3d70 bytes) 083000 1712276160.131601 mapwrite 0x27e807 thru 0x27e84e (0x48 bytes) 084000 1712276163.027897 mapwrite 0x17666e thru 0x184863 (0xe1f6 bytes) 087000 1712276172.222901 read 0x1b0867 thru 0x1bb6c6 (0xae60 bytes) 088000 1712276176.079982 fallocate 0x018b72 thru 0x026fd0 (0xe45f bytes) 089000 1712276180.084782 mapwrite 0x2b34e1 thru 0x2b79ab (0x44cb bytes) 092000 1712276191.546523 trunc from 0x492584 to 0x50f81a (0x7d297 bytes) 093000 1712276195.278781 write 0x2c8baf thru 0x2d821b (0xf66d bytes) 095000 1712276202.034219 fallocate 0x2e2ac7 thru 0x2f1d89 (0xf2c3 bytes) 096000 1712276205.517926 read 0x2833d0 thru 0x28e10f (0xad40 bytes) 098000 1712276213.530959 mapwrite 0x1a50b1 thru 0x1b10aa (0xbffa bytes) 099000 1712276217.234131 trunc from 0x212b5f to 0x49847f (0x285921 bytes) 100000 1712276221.314696 write 0x21508d thru 0x224e10 (0xfd84 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (308s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 20:17:05 (1712276225) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1712276230.550821 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1712276235.397454 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1712276239.992504 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1712276244.730877 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1712276254.062710 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1712276257.506657 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1712276260.086165 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1712276262.580252 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1712276264.937652 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1712276267.140512 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1712276269.534381 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1712276271.836464 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1712276273.806470 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1712276276.155382 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1712276278.537520 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1712276280.548616 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1712276282.925133 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1712276285.330525 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1712276287.605028 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1712276295.254415 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1712276297.661767 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1712276300.149037 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1712276302.371048 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1712276309.207945 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1712276317.274932 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1712276321.563283 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1712276326.016412 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1712276335.858674 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1712276340.443092 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1712276348.329658 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1712276352.838531 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1712276356.966173 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1712276361.647546 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1712276366.587986 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1712276374.440688 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1712276386.426212 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1712276397.807242 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1712276405.205188 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1712276409.146134 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1712276413.571635 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1712276425.694330 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1712276430.279370 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1712276432.661689 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1712276435.177230 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1712276439.272393 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1712276442.942981 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1712276447.255601 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1712276451.515506 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1712276455.665567 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1712276462.725391 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1712276465.741459 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1712276469.488381 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1712276473.230820 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1712276477.497457 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1712276486.314219 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1712276499.703831 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1712276507.967685 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1712276511.867543 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1712276514.835628 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1712276521.657323 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1712276524.774346 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1712276532.609632 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1712276536.705346 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1712276545.658632 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1712276553.181057 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1712276562.360271 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1712276566.526474 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1712276570.806779 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1712276574.284900 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1712276581.952275 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1712276584.941686 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1712276590.868326 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1712276595.273844 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (371s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1062 sec ===== 20:23:17 (1712276597) === sanity-benchmark: start cleanup 20:23:17 (1712276597) === === sanity-benchmark: finish cleanup 20:23:17 (1712276597) ===