-----============= acceptance-small: sanity-benchmark ============----- Tue Oct 1 02:31:21 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 02:31:29 (1727764289) === oleg103-client.virtnet: executing check_config_client /mnt/lustre oleg103-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg103-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6cc3000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6cc3000.idle_timeout=debug disable quota as required oleg103-server: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 02:31:42 (1727764302) === == sanity-benchmark test dbench: dbench ================== 02:31:42 (1727764302) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7573] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg103-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg103-client.virtnet at Tue Oct 1 02:31:44 EDT 2024 waiting for dbench pid 9799 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 17 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 17 61 52.32 MB/sec warmup 1 sec latency 58.022 ms 20 180 72.77 MB/sec warmup 2 sec latency 122.185 ms 20 285 70.75 MB/sec warmup 3 sec latency 85.490 ms 20 399 70.84 MB/sec warmup 4 sec latency 89.288 ms 20 592 80.49 MB/sec warmup 5 sec latency 60.417 ms 20 738 71.02 MB/sec warmup 6 sec latency 49.442 ms 20 835 61.50 MB/sec warmup 7 sec latency 62.268 ms 20 915 54.35 MB/sec warmup 8 sec latency 76.057 ms 20 1020 49.70 MB/sec warmup 9 sec latency 61.050 ms 20 1164 46.00 MB/sec warmup 10 sec latency 58.790 ms 20 1254 42.23 MB/sec warmup 11 sec latency 92.196 ms 20 1437 43.34 MB/sec warmup 12 sec latency 85.138 ms 20 1557 40.15 MB/sec warmup 13 sec latency 64.423 ms 20 1680 37.44 MB/sec warmup 14 sec latency 48.999 ms 20 1798 35.07 MB/sec warmup 15 sec latency 79.499 ms 20 1877 32.95 MB/sec warmup 16 sec latency 67.724 ms 20 1994 31.15 MB/sec warmup 17 sec latency 66.667 ms 20 2101 29.61 MB/sec warmup 18 sec latency 75.569 ms 20 2182 28.14 MB/sec warmup 19 sec latency 79.381 ms 20 2295 27.45 MB/sec warmup 20 sec latency 90.779 ms 20 2394 26.65 MB/sec warmup 21 sec latency 83.237 ms 20 2492 26.03 MB/sec warmup 22 sec latency 70.115 ms 20 2645 25.97 MB/sec warmup 23 sec latency 83.044 ms 20 2992 21.76 MB/sec execute 1 sec latency 103.755 ms 20 3199 19.14 MB/sec execute 2 sec latency 97.166 ms 20 3398 23.54 MB/sec execute 3 sec latency 85.459 ms 20 3620 30.50 MB/sec execute 4 sec latency 45.130 ms 20 3718 26.09 MB/sec execute 5 sec latency 81.552 ms 20 3803 24.34 MB/sec execute 6 sec latency 88.733 ms 20 3877 21.08 MB/sec execute 7 sec latency 62.955 ms 20 3932 19.00 MB/sec execute 8 sec latency 156.675 ms 20 4002 16.90 MB/sec execute 9 sec latency 80.126 ms 20 4065 15.23 MB/sec execute 10 sec latency 89.712 ms 20 4161 13.91 MB/sec execute 11 sec latency 79.552 ms 20 4235 12.97 MB/sec execute 12 sec latency 313.380 ms 20 4293 12.14 MB/sec execute 13 sec latency 616.420 ms 20 4368 11.57 MB/sec execute 14 sec latency 83.001 ms 20 4440 11.02 MB/sec execute 15 sec latency 99.068 ms 20 4495 10.54 MB/sec execute 16 sec latency 105.464 ms 20 4577 10.32 MB/sec execute 17 sec latency 116.195 ms 20 4707 10.73 MB/sec execute 18 sec latency 57.593 ms 20 4781 10.23 MB/sec execute 19 sec latency 75.504 ms 20 4889 10.79 MB/sec execute 20 sec latency 76.540 ms 20 5021 12.08 MB/sec execute 21 sec latency 88.779 ms 20 5093 11.58 MB/sec execute 22 sec latency 89.151 ms 20 5162 11.14 MB/sec execute 23 sec latency 74.709 ms 20 5225 10.72 MB/sec execute 24 sec latency 100.833 ms 20 5286 10.32 MB/sec execute 25 sec latency 94.886 ms 20 5363 9.97 MB/sec execute 26 sec latency 76.916 ms 20 5417 9.64 MB/sec execute 27 sec latency 99.926 ms 20 5515 9.37 MB/sec execute 28 sec latency 86.098 ms 20 5593 9.10 MB/sec execute 29 sec latency 86.524 ms 20 5670 8.88 MB/sec execute 30 sec latency 93.466 ms 20 5744 8.67 MB/sec execute 31 sec latency 95.048 ms 20 5820 8.54 MB/sec execute 32 sec latency 102.216 ms 20 5914 8.81 MB/sec execute 33 sec latency 110.846 ms 20 5967 8.64 MB/sec execute 34 sec latency 117.472 ms 20 6027 8.57 MB/sec execute 35 sec latency 112.584 ms 20 6104 8.69 MB/sec execute 36 sec latency 117.506 ms 20 6198 8.82 MB/sec execute 37 sec latency 120.604 ms 20 6347 9.80 MB/sec execute 38 sec latency 107.713 ms 20 6471 10.08 MB/sec execute 39 sec latency 105.673 ms 20 6582 10.14 MB/sec execute 40 sec latency 146.521 ms 20 6726 10.19 MB/sec execute 41 sec latency 109.139 ms 20 6857 10.44 MB/sec execute 42 sec latency 162.578 ms 20 6981 10.70 MB/sec execute 43 sec latency 81.144 ms 20 7122 11.41 MB/sec execute 44 sec latency 101.672 ms 20 7190 11.23 MB/sec execute 45 sec latency 104.090 ms 20 7259 11.12 MB/sec execute 46 sec latency 113.845 ms 20 7322 11.18 MB/sec execute 47 sec latency 183.954 ms 20 7375 11.00 MB/sec execute 48 sec latency 140.420 ms 20 7443 10.84 MB/sec execute 49 sec latency 90.403 ms 20 7507 10.68 MB/sec execute 50 sec latency 85.546 ms 20 7575 10.47 MB/sec execute 51 sec latency 71.453 ms 20 7639 10.28 MB/sec execute 52 sec latency 107.586 ms 20 7737 10.11 MB/sec execute 53 sec latency 114.826 ms 20 7814 9.99 MB/sec execute 54 sec latency 125.537 ms 20 7887 9.87 MB/sec execute 55 sec latency 72.815 ms 20 7939 9.74 MB/sec execute 56 sec latency 91.753 ms 20 7998 9.62 MB/sec execute 57 sec latency 98.649 ms 20 8047 9.49 MB/sec execute 58 sec latency 139.279 ms 20 8109 9.45 MB/sec execute 59 sec latency 113.050 ms 20 8198 9.56 MB/sec execute 60 sec latency 110.993 ms 20 8287 9.43 MB/sec execute 61 sec latency 70.297 ms 20 8359 9.39 MB/sec execute 62 sec latency 98.622 ms 20 8490 9.94 MB/sec execute 63 sec latency 90.812 ms 20 8560 9.93 MB/sec execute 64 sec latency 102.839 ms 20 8620 9.79 MB/sec execute 65 sec latency 99.707 ms 20 8683 9.66 MB/sec execute 66 sec latency 84.195 ms 20 8727 9.53 MB/sec execute 67 sec latency 126.563 ms 20 8785 9.40 MB/sec execute 68 sec latency 131.441 ms 20 8846 9.28 MB/sec execute 69 sec latency 110.428 ms 20 8908 9.16 MB/sec execute 70 sec latency 84.203 ms 20 8990 9.05 MB/sec execute 71 sec latency 70.999 ms 20 9091 8.95 MB/sec execute 72 sec latency 75.783 ms 20 9154 8.86 MB/sec execute 73 sec latency 84.988 ms 20 9260 8.77 MB/sec execute 74 sec latency 65.852 ms 20 9368 8.77 MB/sec execute 75 sec latency 59.179 ms 20 9465 8.85 MB/sec execute 76 sec latency 100.813 ms 20 9521 8.79 MB/sec execute 77 sec latency 244.391 ms 20 9588 8.79 MB/sec execute 78 sec latency 288.217 ms 20 9690 8.85 MB/sec execute 79 sec latency 100.973 ms 20 9797 9.13 MB/sec execute 80 sec latency 115.540 ms 20 9935 9.40 MB/sec execute 81 sec latency 124.416 ms 20 10075 9.56 MB/sec execute 82 sec latency 96.194 ms 20 10194 9.56 MB/sec execute 83 sec latency 116.844 ms 20 10361 9.69 MB/sec execute 84 sec latency 109.461 ms 20 10471 9.78 MB/sec execute 85 sec latency 125.654 ms 20 10586 10.07 MB/sec execute 86 sec latency 104.644 ms 20 10676 10.16 MB/sec execute 87 sec latency 119.253 ms 20 10730 10.08 MB/sec execute 88 sec latency 103.676 ms 20 10777 10.01 MB/sec execute 89 sec latency 132.141 ms 20 10842 10.02 MB/sec execute 90 sec latency 134.556 ms 20 10897 10.00 MB/sec execute 91 sec latency 132.317 ms 20 10935 9.90 MB/sec execute 92 sec latency 136.066 ms 20 10982 9.82 MB/sec execute 93 sec latency 120.944 ms 20 11026 9.74 MB/sec execute 94 sec latency 118.733 ms 20 11064 9.64 MB/sec execute 95 sec latency 145.964 ms 20 11102 9.54 MB/sec execute 96 sec latency 120.646 ms 20 11145 9.45 MB/sec execute 97 sec latency 113.184 ms 20 11197 9.35 MB/sec execute 98 sec latency 112.418 ms 20 11253 9.27 MB/sec execute 99 sec latency 159.555 ms 20 11314 9.19 MB/sec execute 100 sec latency 151.158 ms 20 11374 9.13 MB/sec execute 101 sec latency 127.981 ms 20 11433 9.07 MB/sec execute 102 sec latency 101.701 ms 20 11496 9.01 MB/sec execute 103 sec latency 117.610 ms 20 11554 8.95 MB/sec execute 104 sec latency 104.251 ms 20 11598 8.89 MB/sec execute 105 sec latency 116.257 ms 20 11650 8.85 MB/sec execute 106 sec latency 117.628 ms 20 11723 8.91 MB/sec execute 107 sec latency 135.493 ms 20 11799 8.86 MB/sec execute 108 sec latency 302.215 ms 20 11862 8.79 MB/sec execute 109 sec latency 108.919 ms 20 11931 8.82 MB/sec execute 110 sec latency 112.428 ms 20 12035 9.09 MB/sec execute 111 sec latency 100.201 ms 20 12081 9.04 MB/sec execute 112 sec latency 188.741 ms 20 12138 9.01 MB/sec execute 113 sec latency 148.008 ms 20 12192 8.94 MB/sec execute 114 sec latency 109.608 ms 20 12241 8.87 MB/sec execute 115 sec latency 108.631 ms 20 12298 8.80 MB/sec execute 116 sec latency 98.740 ms 20 12348 8.73 MB/sec execute 117 sec latency 128.404 ms 20 12397 8.67 MB/sec execute 118 sec latency 155.346 ms 20 12449 8.60 MB/sec execute 119 sec latency 90.136 ms 20 cleanup 120 sec 20 cleanup 121 sec 15 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 33989 40.548 183.936 Close 24449 9.944 57.826 Rename 1421 59.537 188.730 Unlink 7082 12.547 84.327 Qpathinfo 30152 9.542 120.078 Qfileinfo 5080 0.214 24.714 Qfsinfo 5710 0.163 30.750 Sfileinfo 2680 41.100 137.543 Find 11701 1.737 122.176 WriteX 16279 4.954 105.590 ReadX 51767 0.032 8.877 LockX 96 12.098 28.505 UnlockX 96 12.924 28.681 Flush 2424 41.326 616.411 Throughput 8.60007 MB/sec 20 clients 20 procs max_latency=616.420 ms stopping dbench on /mnt/lustre/d0.oleg103-client.virtnet at Tue Oct 1 02:34:11 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg103-client.virtnet /mnt/lustre/d0.oleg103-client.virtnet /mnt/lustre/d0.oleg103-client.virtnet removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg103-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 02:34:18 (1727764458) min OST has 3577840kB available, using 5366760kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7573] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5240] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg103-clien 5240M 96171 73 73664 57 167083 32 1132 172 Latency 21135us 117ms 168ms 28800us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg103-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 115 14 2097 12 171 11 113 14 276 10 174 11 Latency 58027us 84815us 65511us 51553us 31733us 53653us 1.97,1.97,oleg103-client.virtnet,1,1727774084,5240M,,,,96171,73,73664,57,,,167083,32,1132,172,10,,,,,115,14,2097,12,171,11,113,14,276,10,174,11,,21135us,117ms,,168ms,28800us,58027us,84815us,65511us,51553us,31733us,53653us debug=0x33f0484 PASS bonnie (517s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 02:42:56 (1727764976) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 29642 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 29642 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole fallocating to largest ever: 0x3b8ca7 skipping zero length punch hole skipping zero length punch hole fallocating to largest ever: 0x4ec5c6 fallocating to largest ever: 0x4fd38a truncating to largest ever: 0x51751b fallocating to largest ever: 0x5285e2 skipping zero length punch hole 001000 1727764984.875869 punch from 0x001ea9 to 0x008dcf (0x6f27 bytes) 003000 1727765000.101505 mapread 0x439dee thru 0x43c167 (0x237a bytes) 006000 1727765021.197366 read 0x225801 thru 0x235744 (0xff44 bytes) 008000 1727765035.678746 read 0x0183ea thru 0x023dec (0xba03 bytes) 009000 1727765041.896782 punch from 0x17197c to 0x1788d0 (0x6f55 bytes) 011000 1727765056.117578 punch from 0x36ceff to 0x37361b (0x671d bytes) 012000 1727765063.979487 write 0x2104ec thru 0x21464d (0x4162 bytes) 014000 1727765077.877347 fallocate 0x09cd9f thru 0x0a2f37 (0x6199 bytes) 018000 1727765108.997545 mapwrite 0x01a786 thru 0x01de7e (0x36f9 bytes) 020000 1727765121.871579 mapread 0x2b317e thru 0x2bde1d (0xaca0 bytes) 021000 1727765129.396970 mapread 0x345e51 thru 0x34e84e (0x89fe bytes) 022000 1727765135.732045 write 0x37059e thru 0x37e397 (0xddfa bytes) 023000 1727765141.678276 fallocate 0x33827a thru 0x34095e (0x86e5 bytes) 024000 1727765148.712555 write 0x33f307 thru 0x34f2a0 (0xff9a bytes) 025000 1727765155.808069 punch from 0x00e03c to 0x0137fa (0x57bf bytes) 026000 1727765162.533549 trunc from 0x2dc4ba to 0x27e5d2 (0x5dee7 bytes) 029000 1727765183.564188 write 0x4f489d thru 0x4fd748 (0x8eac bytes) 030000 1727765190.288291 trunc from 0x009d1b to 0x353532 (0x349818 bytes) 033000 1727765209.655643 trunc from 0x48b3f8 to 0x1658e8 (0x325b0f bytes) 034000 1727765217.250122 mapread 0x129ddf thru 0x135555 (0xb777 bytes) 035000 1727765226.395620 mapwrite 0x511ca2 thru 0x511f58 (0x2b7 bytes) 037000 1727765240.170326 mapread 0x0c528d thru 0x0ccfe8 (0x7d5c bytes) 038000 1727765248.225015 trunc from 0x4c3531 to 0x492f9e (0x30592 bytes) 039000 1727765255.183350 mapread 0x1365a4 thru 0x1381e6 (0x1c43 bytes) 041000 1727765270.339410 mapwrite 0x207224 thru 0x2116ce (0xa4ab bytes) 043000 1727765283.638355 punch from 0x273b6e to 0x27cfee (0x9481 bytes) 044000 1727765291.141252 punch from 0x26f49c to 0x27bf1f (0xca84 bytes) 046000 1727765304.832584 trunc from 0x2c9aef to 0x005937 (0x2c41b7 bytes) 047000 1727765310.884034 trunc from 0x48dbc3 to 0x437566 (0x5665c bytes) 049000 1727765325.749543 fallocate 0x4e11a2 thru 0x4e4984 (0x37e3 bytes) 050000 1727765330.839844 fallocate 0x1ff60f thru 0x209c3c (0xa62e bytes) 051000 1727765335.698690 mapread 0x1be0a0 thru 0x1c15d2 (0x3533 bytes) 052000 1727765341.567594 punch from 0x20b300 to 0x20cdc1 (0x1ac2 bytes) 053000 1727765348.568808 mapwrite 0x2cb413 thru 0x2d5d4e (0xa93c bytes) 056000 1727765369.184332 punch from 0x02003f to 0x02bdda (0xbd9c bytes) 057000 1727765374.875161 trunc from 0x160902 to 0x191142 (0x30841 bytes) 058000 1727765381.616582 trunc from 0x4d3b12 to 0x14aeec (0x388c25 bytes) 060000 1727765394.684184 punch from 0x137f3e to 0x13d0b6 (0x5179 bytes) 062000 1727765403.784059 mapwrite 0x356786 thru 0x36649b (0xfd16 bytes) 063000 1727765408.968314 read 0x0beb1e thru 0x0ccd49 (0xe22c bytes) 064000 1727765414.757394 read 0x30d4f3 thru 0x3127b3 (0x52c1 bytes) 065000 1727765420.698148 write 0x23d1b6 thru 0x241d9c (0x4be7 bytes) 066000 1727765427.149436 mapwrite 0x3e4c47 thru 0x3f0ba1 (0xbf5b bytes) 067000 1727765432.318199 punch from 0x2317b2 to 0x240112 (0xe961 bytes) 068000 1727765437.932191 fallocate 0x2b25c1 thru 0x2b3d71 (0x17b1 bytes) 069000 1727765444.286202 write 0x16eb21 thru 0x1725bf (0x3a9f bytes) 070000 1727765451.437780 punch from 0x4695b6 to 0x478243 (0xec8e bytes) 071000 1727765459.276353 trunc from 0x4f9b47 to 0x4ca67f (0x2f4c7 bytes) 072000 1727765468.159452 mapwrite 0x2346ae thru 0x236407 (0x1d5a bytes) 073000 1727765474.561425 read 0x23ddef thru 0x24d3f4 (0xf606 bytes) 076000 1727765498.954447 write 0x4a3eec thru 0x4a73ee (0x3503 bytes) 077000 1727765507.649590 punch from 0x024ecc to 0x02ac34 (0x5d69 bytes) 080000 1727765531.180452 punch from 0x3b93f7 to 0x3bd9de (0x45e8 bytes) 081000 1727765539.306383 mapread 0x298a7a thru 0x2a7b81 (0xf108 bytes) 082000 1727765548.116211 trunc from 0x45ed44 to 0x495803 (0x36ac0 bytes) 083000 1727765554.882986 write 0x48f88b thru 0x498428 (0x8b9e bytes) 085000 1727765571.002315 mapread 0x0b8398 thru 0x0c6fb6 (0xec1f bytes) 086000 1727765578.859719 fallocate 0x12eb5b thru 0x13306f (0x4515 bytes) 087000 1727765587.503680 mapread 0x0ad06e thru 0x0bb809 (0xe79c bytes) 088000 1727765595.457511 trunc from 0x51e682 to 0x14cc69 (0x3d1a18 bytes) 090000 1727765610.815202 mapread 0x0f2c1b thru 0x101ad3 (0xeeb9 bytes) 091000 1727765620.008654 read 0x3985de thru 0x3a19ae (0x93d1 bytes) 092000 1727765628.246798 write 0x2a0995 thru 0x2ae402 (0xda6e bytes) 093000 1727765636.227985 fallocate 0x3ae6be thru 0x3b0626 (0x1f69 bytes) 094000 1727765643.131980 mapwrite 0x48592a thru 0x49071f (0xadf6 bytes) 095000 1727765652.903093 mapwrite 0x17c1b6 thru 0x18ad90 (0xebdb bytes) 096000 1727765662.517282 punch from 0x0ee242 to 0x0f21ca (0x3f89 bytes) 098000 1727765678.790488 mapwrite 0x19a651 thru 0x1a3650 (0x9000 bytes) skipping zero size write 099000 1727765686.329711 mapread 0x12ec9a thru 0x1397fb (0xab62 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (723s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 02:54:58 (1727765698) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1727765708.907416 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1727765718.900257 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1727765727.046499 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1727765736.467572 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1727765756.206213 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1727765766.212138 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1727765776.735483 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1727765787.593719 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1727765797.821240 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1727765807.681200 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1727765816.867271 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1727765825.581619 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1727765834.369112 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1727765844.128182 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1727765853.594667 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1727765861.836353 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1727765869.995268 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1727765880.311996 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1727765890.043996 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1727765919.955426 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1727765930.488200 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1727765940.189589 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1727765949.343921 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1727765966.055900 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1727765985.659931 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1727765994.693875 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1727766002.507554 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1727766025.083249 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1727766036.108232 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1727766052.407746 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1727766063.196603 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1727766072.645287 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1727766082.451768 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1727766090.176670 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1727766109.853222 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1727766136.365312 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1727766166.110345 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1727766184.406563 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1727766194.867311 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1727766206.927107 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1727766235.251560 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1727766246.070585 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1727766256.579979 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1727766266.962107 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1727766277.080474 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1727766286.064846 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1727766296.285478 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1727766307.758925 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1727766320.250474 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1727766339.666048 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1727766351.577471 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1727766362.450478 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1727766372.568979 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1727766384.147311 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1727766403.686324 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1727766437.247928 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1727766456.564404 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1727766467.742338 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1727766479.034722 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1727766502.810907 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1727766511.664231 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1727766532.210793 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1727766543.141161 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1727766563.642484 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1727766583.255939 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1727766606.345674 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1727766616.342115 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1727766625.032716 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1727766634.299653 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1727766654.681634 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1727766664.553354 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1727766684.239310 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1727766695.340994 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (1000s) == sanity-benchmark test complete, duration 2416 sec ===== 03:11:38 (1727766698) === sanity-benchmark: start cleanup 03:11:39 (1727766699) === === sanity-benchmark: finish cleanup 03:11:39 (1727766699) ===