-----============= acceptance-small: sanity-benchmark ============----- Fri Jul 19 12:37:27 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg204-client.virtnet: executing check_config_client /mnt/lustre oleg204-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg204-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6166000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6166000.idle_timeout=debug disable quota as required oleg204-server: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 12:37:37 (1721407057) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7447] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg204-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg204-client.virtnet at Fri Jul 19 12:37:38 EDT 2024 waiting for dbench pid 9586 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 260 196.01 MB/sec warmup 1 sec latency 50.455 ms 20 534 184.70 MB/sec warmup 2 sec latency 35.402 ms 20 715 141.37 MB/sec warmup 3 sec latency 539.950 ms 20 1016 112.20 MB/sec warmup 4 sec latency 26.846 ms 20 1425 104.04 MB/sec warmup 5 sec latency 31.246 ms 20 1768 87.61 MB/sec warmup 6 sec latency 31.265 ms 20 2147 76.43 MB/sec warmup 7 sec latency 21.069 ms 20 2520 71.85 MB/sec warmup 8 sec latency 23.883 ms 20 3134 75.96 MB/sec warmup 9 sec latency 37.951 ms 20 3691 77.88 MB/sec warmup 10 sec latency 25.746 ms 20 3960 72.78 MB/sec warmup 11 sec latency 24.613 ms 20 4218 67.07 MB/sec warmup 12 sec latency 54.710 ms 20 4480 63.01 MB/sec warmup 13 sec latency 34.352 ms 20 4798 61.09 MB/sec warmup 14 sec latency 24.444 ms 20 5142 60.32 MB/sec warmup 15 sec latency 39.066 ms 20 5448 56.90 MB/sec warmup 16 sec latency 27.039 ms 20 5831 54.59 MB/sec warmup 17 sec latency 20.023 ms 20 6245 55.12 MB/sec warmup 18 sec latency 23.828 ms 20 6918 58.12 MB/sec warmup 19 sec latency 24.329 ms 20 7332 58.53 MB/sec warmup 20 sec latency 25.965 ms 20 7600 56.40 MB/sec warmup 21 sec latency 39.403 ms 20 7884 54.20 MB/sec warmup 22 sec latency 47.177 ms 20 8260 53.48 MB/sec warmup 23 sec latency 23.312 ms 20 9075 8.39 MB/sec execute 1 sec latency 28.689 ms 20 9581 29.45 MB/sec execute 2 sec latency 18.653 ms 20 10216 56.35 MB/sec execute 3 sec latency 22.001 ms 20 10802 64.01 MB/sec execute 4 sec latency 21.182 ms 20 11133 55.81 MB/sec execute 5 sec latency 36.556 ms 20 11430 48.21 MB/sec execute 6 sec latency 46.233 ms 20 11808 47.31 MB/sec execute 7 sec latency 28.079 ms 20 12211 47.07 MB/sec execute 8 sec latency 33.681 ms 20 12602 43.38 MB/sec execute 9 sec latency 41.953 ms 20 13080 43.35 MB/sec execute 10 sec latency 17.780 ms 20 13637 47.75 MB/sec execute 11 sec latency 22.771 ms 20 14205 51.36 MB/sec execute 12 sec latency 29.721 ms 20 14558 50.42 MB/sec execute 13 sec latency 25.450 ms 20 14818 47.60 MB/sec execute 14 sec latency 50.211 ms 20 15117 45.48 MB/sec execute 15 sec latency 59.155 ms 20 15479 45.21 MB/sec execute 16 sec latency 25.390 ms 20 15838 44.88 MB/sec execute 17 sec latency 24.186 ms 20 16187 43.25 MB/sec execute 18 sec latency 28.667 ms 20 16564 42.88 MB/sec execute 19 sec latency 23.339 ms 20 17019 43.68 MB/sec execute 20 sec latency 24.531 ms 20 17490 45.60 MB/sec execute 21 sec latency 23.103 ms 20 17919 46.43 MB/sec execute 22 sec latency 28.651 ms 20 18185 45.27 MB/sec execute 23 sec latency 64.999 ms 20 18450 44.00 MB/sec execute 24 sec latency 34.538 ms 20 18770 43.27 MB/sec execute 25 sec latency 52.190 ms 20 19090 42.60 MB/sec execute 26 sec latency 30.084 ms 20 19485 42.50 MB/sec execute 27 sec latency 24.177 ms 20 19855 41.73 MB/sec execute 28 sec latency 26.739 ms 20 20340 42.13 MB/sec execute 29 sec latency 22.493 ms 20 20797 43.13 MB/sec execute 30 sec latency 27.306 ms 20 21310 44.16 MB/sec execute 31 sec latency 28.356 ms 20 21733 44.38 MB/sec execute 32 sec latency 44.438 ms 20 22047 43.70 MB/sec execute 33 sec latency 31.451 ms 20 22418 43.36 MB/sec execute 34 sec latency 37.476 ms 20 22791 42.83 MB/sec execute 35 sec latency 22.058 ms 20 23219 42.86 MB/sec execute 36 sec latency 23.935 ms 20 23641 42.87 MB/sec execute 37 sec latency 25.435 ms 20 24172 43.32 MB/sec execute 38 sec latency 18.590 ms 20 24617 44.00 MB/sec execute 39 sec latency 73.966 ms 20 25097 44.38 MB/sec execute 40 sec latency 32.525 ms 20 25432 44.23 MB/sec execute 41 sec latency 31.544 ms 20 25766 43.93 MB/sec execute 42 sec latency 51.964 ms 20 26098 43.30 MB/sec execute 43 sec latency 24.941 ms 20 26508 43.22 MB/sec execute 44 sec latency 21.898 ms 20 26932 43.16 MB/sec execute 45 sec latency 21.044 ms 20 27455 43.47 MB/sec execute 46 sec latency 19.960 ms 20 27933 43.88 MB/sec execute 47 sec latency 21.487 ms 20 28455 44.47 MB/sec execute 48 sec latency 30.449 ms 20 28865 44.64 MB/sec execute 49 sec latency 35.893 ms 20 29214 44.47 MB/sec execute 50 sec latency 23.868 ms 20 29533 43.89 MB/sec execute 51 sec latency 46.109 ms 20 29908 43.40 MB/sec execute 52 sec latency 26.320 ms 20 30330 43.57 MB/sec execute 53 sec latency 25.128 ms 20 30831 43.83 MB/sec execute 54 sec latency 23.713 ms 20 31299 43.96 MB/sec execute 55 sec latency 23.516 ms 20 31715 44.25 MB/sec execute 56 sec latency 24.226 ms 20 32215 44.55 MB/sec execute 57 sec latency 48.796 ms 20 32571 44.52 MB/sec execute 58 sec latency 26.008 ms 20 32902 44.34 MB/sec execute 59 sec latency 43.593 ms 20 33228 43.75 MB/sec execute 60 sec latency 33.575 ms 20 33662 43.76 MB/sec execute 61 sec latency 20.619 ms 20 34092 43.96 MB/sec execute 62 sec latency 22.712 ms 20 34577 44.06 MB/sec execute 63 sec latency 23.768 ms 20 34962 43.92 MB/sec execute 64 sec latency 23.632 ms 20 35424 44.19 MB/sec execute 65 sec latency 35.214 ms 20 35933 44.58 MB/sec execute 66 sec latency 30.004 ms 20 36312 44.67 MB/sec execute 67 sec latency 23.330 ms 20 36633 44.16 MB/sec execute 68 sec latency 46.068 ms 20 37025 43.82 MB/sec execute 69 sec latency 56.028 ms 20 37479 44.18 MB/sec execute 70 sec latency 26.460 ms 20 37969 44.35 MB/sec execute 71 sec latency 23.831 ms 20 38365 44.19 MB/sec execute 72 sec latency 23.100 ms 20 38755 44.17 MB/sec execute 73 sec latency 32.996 ms 20 39274 44.55 MB/sec execute 74 sec latency 27.298 ms 20 39731 44.85 MB/sec execute 75 sec latency 23.538 ms 20 40077 44.50 MB/sec execute 76 sec latency 43.827 ms 20 40476 44.12 MB/sec execute 77 sec latency 24.527 ms 20 40907 44.32 MB/sec execute 78 sec latency 22.982 ms 20 41455 44.66 MB/sec execute 79 sec latency 22.144 ms 20 41893 44.55 MB/sec execute 80 sec latency 21.664 ms 20 42322 44.54 MB/sec execute 81 sec latency 31.884 ms 20 42847 44.88 MB/sec execute 82 sec latency 30.370 ms 20 43314 45.15 MB/sec execute 83 sec latency 21.351 ms 20 43645 44.82 MB/sec execute 84 sec latency 46.496 ms 20 44058 44.52 MB/sec execute 85 sec latency 27.349 ms 20 44517 44.78 MB/sec execute 86 sec latency 22.448 ms 20 45029 45.01 MB/sec execute 87 sec latency 21.997 ms 20 45466 44.86 MB/sec execute 88 sec latency 18.345 ms 20 45894 44.89 MB/sec execute 89 sec latency 42.423 ms 20 46418 45.19 MB/sec execute 90 sec latency 25.679 ms 20 46860 45.40 MB/sec execute 91 sec latency 22.532 ms 20 47199 45.07 MB/sec execute 92 sec latency 40.355 ms 20 47569 44.75 MB/sec execute 93 sec latency 25.253 ms 20 48016 44.95 MB/sec execute 94 sec latency 26.212 ms 20 48523 45.23 MB/sec execute 95 sec latency 26.979 ms 20 48928 45.03 MB/sec execute 96 sec latency 19.816 ms 20 49295 44.86 MB/sec execute 97 sec latency 34.186 ms 20 49795 45.03 MB/sec execute 98 sec latency 30.415 ms 20 50271 45.37 MB/sec execute 99 sec latency 80.742 ms 20 50637 45.28 MB/sec execute 100 sec latency 23.789 ms 20 51013 44.95 MB/sec execute 101 sec latency 40.817 ms 20 51410 44.91 MB/sec execute 102 sec latency 23.328 ms 20 51933 45.24 MB/sec execute 103 sec latency 24.910 ms 20 52363 45.20 MB/sec execute 104 sec latency 24.052 ms 20 52752 44.97 MB/sec execute 105 sec latency 36.117 ms 20 53245 45.15 MB/sec execute 106 sec latency 24.477 ms 20 53788 45.53 MB/sec execute 107 sec latency 22.313 ms 20 54189 45.46 MB/sec execute 108 sec latency 23.370 ms 20 54553 45.16 MB/sec execute 109 sec latency 28.447 ms 20 54976 45.19 MB/sec execute 110 sec latency 20.975 ms 20 55521 45.50 MB/sec execute 111 sec latency 18.995 ms 20 55918 45.40 MB/sec execute 112 sec latency 18.998 ms 20 56305 45.17 MB/sec execute 113 sec latency 46.971 ms 20 56824 45.36 MB/sec execute 114 sec latency 21.905 ms 20 57365 45.72 MB/sec execute 115 sec latency 21.998 ms 20 57731 45.61 MB/sec execute 116 sec latency 26.083 ms 20 58088 45.34 MB/sec execute 117 sec latency 37.374 ms 20 58535 45.38 MB/sec execute 118 sec latency 20.790 ms 20 59054 45.66 MB/sec execute 119 sec latency 19.918 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 175548 8.000 64.991 Close 129085 1.812 15.684 Rename 7410 11.123 35.444 Unlink 35210 2.619 33.908 Qpathinfo 159203 1.798 37.094 Qfileinfo 27850 0.061 6.519 Qfsinfo 29063 0.026 5.276 Sfileinfo 14128 5.656 27.880 Find 61460 0.355 26.100 WriteX 86644 1.071 33.420 ReadX 275735 0.010 3.247 LockX 576 2.006 6.107 UnlockX 576 2.047 12.345 Flush 12204 7.561 80.736 Throughput 45.655 MB/sec 20 clients 20 procs max_latency=80.742 ms stopping dbench on /mnt/lustre/d0.oleg204-client.virtnet at Fri Jul 19 12:40:03 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg204-client.virtnet /mnt/lustre/d0.oleg204-client.virtnet /mnt/lustre/d0.oleg204-client.virtnet removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg204-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 12:40:05 (1721407205) min OST has 3420244kB available, using 5130366kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7447] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5010] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg204-clien 5010M 156701 98 123579 97 271663 55 6246 291 Latency 4451us 125ms 60553us 4117us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg204-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 505 18 3700 19 717 14 491 17 564 15 705 14 Latency 36113us 5867us 22825us 16360us 4460us 74154us 1.97,1.97,oleg204-client.virtnet,1,1721417543,5010M,,,,156701,98,123579,97,,,271663,55,6246,291,10,,,,,505,18,3700,19,717,14,491,17,564,15,705,14,,4451us,125ms,,60553us,4117us,36113us,5867us,22825us,16360us,4460us,74154us debug=0x33f0484 PASS bonnie (192s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 12:43:17 (1721407397) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 3219 -P /tmp -l 5401704 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 3219 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x517ab6 fallocating to largest ever: 0x52484a fallocating to largest ever: 0x526c68 002000 1721407403.492076 mapwrite 0x1ef8b7 thru 0x1fe17d (0xe8c7 bytes) 003000 1721407406.007920 read 0x1c0ea2 thru 0x1ca1b4 (0x9313 bytes) 005000 1721407411.035749 mapwrite 0x472aca thru 0x479055 (0x658c bytes) 007000 1721407415.697270 write 0x2d0444 thru 0x2da04f (0x9c0c bytes) 008000 1721407418.083940 mapread 0x428bde thru 0x43793b (0xed5e bytes) 009000 1721407420.746726 mapwrite 0x05345c thru 0x060fd0 (0xdb75 bytes) 010000 1721407422.900641 read 0x20462b thru 0x207bc3 (0x3599 bytes) 011000 1721407425.248231 read 0x3ba92b thru 0x3c2b5f (0x8235 bytes) 012000 1721407427.909096 mapread 0x2a6d9d thru 0x2b3c56 (0xceba bytes) 014000 1721407433.002326 mapread 0x29cb29 thru 0x2a03e3 (0x38bb bytes) 015000 1721407435.162828 mapread 0x3d9d18 thru 0x3dd864 (0x3b4d bytes) 016000 1721407437.454336 mapread 0x068746 thru 0x06de5a (0x5715 bytes) 017000 1721407439.792943 fallocate 0x3816ca thru 0x38a93b (0x9272 bytes) 018000 1721407442.183039 read 0x0db4f8 thru 0x0e978e (0xe297 bytes) 019000 1721407444.629905 write 0x1704ca thru 0x17d4a4 (0xcfdb bytes) 020000 1721407447.061648 write 0x4034d0 thru 0x408036 (0x4b67 bytes) 021000 1721407449.605018 read 0x07421a thru 0x0839cd (0xf7b4 bytes) 022000 1721407451.976712 write 0x09bafe thru 0x0a4510 (0x8a13 bytes) 023000 1721407454.431811 punch from 0x267d9c to 0x275907 (0xdb6c bytes) 024000 1721407456.796543 mapread 0x3d3148 thru 0x3df883 (0xc73c bytes) 026000 1721407461.483983 read 0x1b6727 thru 0x1bc4c9 (0x5da3 bytes) 027000 1721407463.918749 fallocate 0x32f69c thru 0x330a74 (0x13d9 bytes) 028000 1721407466.107137 punch from 0x036d49 to 0x037726 (0x9de bytes) 029000 1721407468.357076 mapread 0x1ceb37 thru 0x1da860 (0xbd2a bytes) 030000 1721407470.774869 mapread 0x07c38b thru 0x082690 (0x6306 bytes) 031000 1721407472.716957 read 0x110846 thru 0x117af9 (0x72b4 bytes) 032000 1721407474.767597 punch from 0x0ae3c0 to 0x0b7079 (0x8cba bytes) 033000 1721407476.750006 fallocate 0x0c7f2c thru 0x0d7825 (0xf8fa bytes) 034000 1721407478.799782 fallocate 0x366686 thru 0x3765db (0xff56 bytes) 035000 1721407480.665194 mapwrite 0x080ef7 thru 0x0898b6 (0x89c0 bytes) 036000 1721407482.887749 mapwrite 0x22855b thru 0x237d08 (0xf7ae bytes) 037000 1721407485.160604 mapread 0x4bd9be thru 0x4cd3f6 (0xfa39 bytes) 038000 1721407487.539113 mapwrite 0x22a216 thru 0x2337b1 (0x959c bytes) 039000 1721407489.857660 mapread 0x018877 thru 0x01d8d8 (0x5062 bytes) 040000 1721407492.442973 read 0x1a6421 thru 0x1b3d05 (0xd8e5 bytes) 042000 1721407497.342840 fallocate 0x3bdb9f thru 0x3cd25d (0xf6bf bytes) 043000 1721407499.926990 punch from 0x099f1e to 0x0a58a6 (0xb989 bytes) 044000 1721407502.280289 write 0x087ecf thru 0x08ed78 (0x6eaa bytes) 045000 1721407504.816686 read 0x3f9a43 thru 0x406378 (0xc936 bytes) 046000 1721407507.648473 read 0x115b05 thru 0x11fc74 (0xa170 bytes) 047000 1721407510.460546 trunc from 0x3cbe0c to 0x09ec6d (0x32d19e bytes) 048000 1721407512.941155 mapwrite 0x3aed7f thru 0x3b500f (0x6291 bytes) 050000 1721407517.991442 mapread 0x0813cb thru 0x090dd8 (0xfa0e bytes) 051000 1721407520.390825 trunc from 0x1e7ef6 to 0x0ee538 (0xf99bd bytes) 052000 1721407522.643306 mapread 0x1ca97e thru 0x1d8ece (0xe551 bytes) 053000 1721407525.223189 punch from 0x0ccb21 to 0x0d9459 (0xc939 bytes) 054000 1721407527.642178 punch from 0x3ad2c5 to 0x3b5a94 (0x87d0 bytes) 055000 1721407530.207409 trunc from 0x247b6e to 0x095f98 (0x1b1bd5 bytes) 056000 1721407532.680900 trunc from 0x38b1ea to 0x313e62 (0x77387 bytes) 057000 1721407535.252164 punch from 0x1172e8 to 0x11d65a (0x6373 bytes) 058000 1721407537.363551 mapwrite 0x02e6ef thru 0x035033 (0x6945 bytes) 059000 1721407539.750282 read 0x1cb5ff thru 0x1cf36a (0x3d6c bytes) 061000 1721407544.263124 fallocate 0x516bf7 thru 0x51a845 (0x3c4f bytes) 062000 1721407546.452936 write 0x1db1fa thru 0x1df89f (0x46a6 bytes) 063000 1721407548.829754 fallocate 0x109b63 thru 0x10edd7 (0x5275 bytes) 064000 1721407551.265470 read 0x14a62c thru 0x157bc7 (0xd59c bytes) 065000 1721407553.917023 trunc from 0x2f25bd to 0x519dd0 (0x227814 bytes) 066000 1721407556.949843 mapwrite 0x12ea6e thru 0x136cb4 (0x8247 bytes) 067000 1721407559.553859 fallocate 0x34e424 thru 0x35ab98 (0xc775 bytes) 068000 1721407561.859506 fallocate 0x117210 thru 0x117cc4 (0xab5 bytes) 069000 1721407564.394411 read 0x147cec thru 0x14a19e (0x24b3 bytes) 072000 1721407571.861876 read 0x208194 thru 0x210cc2 (0x8b2f bytes) 073000 1721407574.291649 punch from 0x15be6f to 0x15e122 (0x22b4 bytes) 074000 1721407576.473795 mapwrite 0x03b09d thru 0x049f7f (0xeee3 bytes) 075000 1721407579.123969 trunc from 0x4c165a to 0x2c53e4 (0x1fc275 bytes) 077000 1721407583.401055 mapread 0x21e4b9 thru 0x2292cd (0xae15 bytes) 078000 1721407585.505519 fallocate 0x12470c thru 0x1321d6 (0xdacb bytes) 080000 1721407589.817677 read 0x155fbc thru 0x15612b (0x170 bytes) 081000 1721407592.358270 write 0x30a7e6 thru 0x314af1 (0xa30c bytes) 082000 1721407595.082394 read 0x049a2e thru 0x04eed9 (0x54ac bytes) 084000 1721407600.355607 read 0x2aaebf thru 0x2b89c8 (0xdb0a bytes) 085000 1721407602.613984 punch from 0x18d857 to 0x192ca8 (0x5452 bytes) 086000 1721407604.923287 write 0x2ea28b thru 0x2f22dc (0x8052 bytes) 088000 1721407609.676389 trunc from 0x4b1198 to 0x3f2030 (0xbf167 bytes) 090000 1721407614.389441 fallocate 0x2b5110 thru 0x2c28ca (0xd7bb bytes) 091000 1721407616.674058 write 0x0981a4 thru 0x09e6b2 (0x650f bytes) 092000 1721407619.022635 read 0x1b0696 thru 0x1b553f (0x4eaa bytes) 093000 1721407621.233318 read 0x309b51 thru 0x319745 (0xfbf5 bytes) 094000 1721407623.579468 read 0x069afa thru 0x0752f7 (0xb7fe bytes) 095000 1721407625.914128 write 0x0e35ee thru 0x0eb33c (0x7d4f bytes) 096000 1721407628.290079 mapwrite 0x35fe90 thru 0x36e546 (0xe6b7 bytes) 097000 1721407630.958529 mapread 0x036cc3 thru 0x03effb (0x8339 bytes) 098000 1721407633.233213 write 0x186ebf thru 0x18fdfc (0x8f3e bytes) 099000 1721407635.741018 fallocate 0x0edb98 thru 0x0f3518 (0x5981 bytes) 100000 1721407638.290539 trunc from 0x51cb02 to 0x463a44 (0xb90bd bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (242s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 12:47:19 (1721407639) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1721407642.840164 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1721407645.345178 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1721407656.279605 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1721407658.913217 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1721407661.612801 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1721407664.237944 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1721407667.008033 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1721407671.988133 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1721407674.466194 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1721407679.678656 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1721407682.626383 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1721407688.169481 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1721407690.442981 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1721407696.205909 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1721407698.876670 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1721407701.401363 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1721407704.331856 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1721407706.828098 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1721407709.595898 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1721407712.253044 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1721407714.803658 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1721407720.304722 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1721407723.066485 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1721407725.742958 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1721407728.385846 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1721407731.075430 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1721407733.666692 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1721407736.408339 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1721407739.116411 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1721407742.238159 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1721407745.101083 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1721407747.695304 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1721407752.918650 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1721407755.726961 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1721407758.203031 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1721407760.988499 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1721407769.454910 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1721407772.723111 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1721407775.367904 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1721407778.875156 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1721407781.899225 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1721407784.428025 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1721407790.879922 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1721407793.602360 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1721407796.536315 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1721407805.524095 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1721407812.470742 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1721407815.809147 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1721407819.457726 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1721407825.498837 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1721407832.923394 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1721407836.286406 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1721407840.048206 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1721407846.004118 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1721407848.723505 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1721407851.647443 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1721407854.247113 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1721407857.210354 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1721407860.437090 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1721407867.044221 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1721407873.285102 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1721407875.941275 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1721407878.472738 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1721407882.409547 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1721407888.268206 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1721407895.855211 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1721407901.462513 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1721407904.861760 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1721407907.567073 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1721407910.551410 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1721407914.080702 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1721407920.746924 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1721407924.238535 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1721407927.047134 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1721407933.366352 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (295s) == sanity-benchmark test complete, duration 886 sec ====== 12:52:14 (1721407934)