-----============= acceptance-small: sanity-benchmark ============----- Fri May 10 05:20:34 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 05:20:40 (1715332840) === oleg303-client.virtnet: executing check_config_client /mnt/lustre oleg303-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg303-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012d7ef800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012d7ef800.idle_timeout=debug disable quota as required oleg303-server: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 05:20:51 (1715332851) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 05:20:52 (1715332852) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7491] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg303-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg303-client.virtnet at Fri May 10 05:20:53 EDT 2024 waiting for dbench pid 9757 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 146 125.04 MB/sec warmup 1 sec latency 86.754 ms 20 295 109.12 MB/sec warmup 2 sec latency 71.856 ms 20 478 111.32 MB/sec warmup 3 sec latency 51.310 ms 20 708 106.11 MB/sec warmup 4 sec latency 78.966 ms 20 905 86.79 MB/sec warmup 5 sec latency 27.007 ms 20 1070 76.20 MB/sec warmup 6 sec latency 45.404 ms 20 1251 66.36 MB/sec warmup 7 sec latency 41.581 ms 20 1538 65.21 MB/sec warmup 8 sec latency 32.074 ms 20 1782 58.43 MB/sec warmup 9 sec latency 33.913 ms 20 2005 53.01 MB/sec warmup 10 sec latency 35.440 ms 20 2216 48.92 MB/sec warmup 11 sec latency 30.491 ms 20 2415 46.74 MB/sec warmup 12 sec latency 45.918 ms 20 2558 44.45 MB/sec warmup 13 sec latency 53.275 ms 20 2867 46.65 MB/sec warmup 14 sec latency 56.227 ms 20 3136 45.45 MB/sec warmup 15 sec latency 52.793 ms 20 3439 45.79 MB/sec warmup 16 sec latency 46.612 ms 20 3649 45.45 MB/sec warmup 17 sec latency 50.506 ms 20 3793 44.11 MB/sec warmup 18 sec latency 54.635 ms 20 3920 42.11 MB/sec warmup 19 sec latency 42.688 ms 20 4035 40.05 MB/sec warmup 20 sec latency 42.336 ms 20 4120 38.18 MB/sec warmup 21 sec latency 112.877 ms 20 4237 36.59 MB/sec warmup 22 sec latency 828.480 ms 20 4378 35.28 MB/sec warmup 23 sec latency 59.334 ms 20 4766 22.18 MB/sec execute 1 sec latency 37.574 ms 20 5015 40.86 MB/sec execute 2 sec latency 45.630 ms 20 5149 28.02 MB/sec execute 3 sec latency 73.774 ms 20 5280 21.55 MB/sec execute 4 sec latency 48.191 ms 20 5408 17.65 MB/sec execute 5 sec latency 46.428 ms 20 5575 15.27 MB/sec execute 6 sec latency 43.958 ms 20 5752 13.74 MB/sec execute 7 sec latency 43.421 ms 20 5958 15.17 MB/sec execute 8 sec latency 42.472 ms 20 6129 15.53 MB/sec execute 9 sec latency 42.720 ms 20 6487 22.66 MB/sec execute 10 sec latency 45.531 ms 20 6849 23.91 MB/sec execute 11 sec latency 43.587 ms 20 7119 27.48 MB/sec execute 12 sec latency 42.434 ms 20 7262 26.27 MB/sec execute 13 sec latency 56.566 ms 20 7383 25.45 MB/sec execute 14 sec latency 58.075 ms 20 7501 24.15 MB/sec execute 15 sec latency 53.883 ms 20 7610 22.66 MB/sec execute 16 sec latency 50.018 ms 20 7747 21.45 MB/sec execute 17 sec latency 94.995 ms 20 7877 20.60 MB/sec execute 18 sec latency 81.422 ms 20 8014 19.88 MB/sec execute 19 sec latency 54.278 ms 20 8192 20.10 MB/sec execute 20 sec latency 40.045 ms 20 8421 20.38 MB/sec execute 21 sec latency 33.587 ms 20 8655 21.15 MB/sec execute 22 sec latency 43.820 ms 20 8820 20.36 MB/sec execute 23 sec latency 39.923 ms 20 9004 19.64 MB/sec execute 24 sec latency 34.781 ms 20 9268 19.11 MB/sec execute 25 sec latency 26.877 ms 20 9527 19.41 MB/sec execute 26 sec latency 34.345 ms 20 9828 21.03 MB/sec execute 27 sec latency 87.668 ms 20 10231 22.27 MB/sec execute 28 sec latency 33.554 ms 20 10616 24.26 MB/sec execute 29 sec latency 52.951 ms 20 10797 24.03 MB/sec execute 30 sec latency 37.616 ms 20 10925 23.82 MB/sec execute 31 sec latency 62.621 ms 20 11030 23.27 MB/sec execute 32 sec latency 53.118 ms 20 11130 22.57 MB/sec execute 33 sec latency 51.339 ms 20 11256 21.93 MB/sec execute 34 sec latency 106.148 ms 20 11386 21.47 MB/sec execute 35 sec latency 65.313 ms 20 11558 21.10 MB/sec execute 36 sec latency 35.908 ms 20 11725 21.11 MB/sec execute 37 sec latency 47.058 ms 20 11883 20.71 MB/sec execute 38 sec latency 40.902 ms 20 12116 21.70 MB/sec execute 39 sec latency 53.337 ms 20 12277 21.23 MB/sec execute 40 sec latency 36.706 ms 20 12425 20.77 MB/sec execute 41 sec latency 42.967 ms 20 12577 20.34 MB/sec execute 42 sec latency 46.745 ms 20 12719 19.95 MB/sec execute 43 sec latency 49.383 ms 20 12902 19.71 MB/sec execute 44 sec latency 37.397 ms 20 13105 19.83 MB/sec execute 45 sec latency 47.818 ms 20 13449 20.88 MB/sec execute 46 sec latency 35.815 ms 20 13846 21.59 MB/sec execute 47 sec latency 37.713 ms 20 14246 22.84 MB/sec execute 48 sec latency 32.636 ms 20 14499 22.89 MB/sec execute 49 sec latency 29.906 ms 20 14697 22.54 MB/sec execute 50 sec latency 24.363 ms 20 14900 22.19 MB/sec execute 51 sec latency 65.839 ms 20 15071 21.93 MB/sec execute 52 sec latency 49.951 ms 20 15267 21.94 MB/sec execute 53 sec latency 38.969 ms 20 15519 22.17 MB/sec execute 54 sec latency 34.631 ms 20 15728 22.36 MB/sec execute 55 sec latency 65.006 ms 20 15883 22.01 MB/sec execute 56 sec latency 52.157 ms 20 16009 21.66 MB/sec execute 57 sec latency 62.509 ms 20 16257 21.38 MB/sec execute 58 sec latency 34.036 ms 20 16557 21.44 MB/sec execute 59 sec latency 26.605 ms 20 16785 21.58 MB/sec execute 60 sec latency 31.882 ms 20 17213 22.61 MB/sec execute 61 sec latency 35.517 ms 20 17655 23.46 MB/sec execute 62 sec latency 37.344 ms 20 17867 23.55 MB/sec execute 63 sec latency 35.353 ms 20 18036 23.50 MB/sec execute 64 sec latency 41.109 ms 20 18188 23.22 MB/sec execute 65 sec latency 36.950 ms 20 18353 22.90 MB/sec execute 66 sec latency 72.308 ms 20 18513 22.65 MB/sec execute 67 sec latency 59.296 ms 20 18673 22.43 MB/sec execute 68 sec latency 39.452 ms 20 18838 22.39 MB/sec execute 69 sec latency 42.833 ms 20 19026 22.43 MB/sec execute 70 sec latency 52.193 ms 20 19207 22.62 MB/sec execute 71 sec latency 50.994 ms 20 19386 22.42 MB/sec execute 72 sec latency 40.852 ms 20 19559 22.15 MB/sec execute 73 sec latency 36.106 ms 20 19753 21.90 MB/sec execute 74 sec latency 34.226 ms 20 19923 21.67 MB/sec execute 75 sec latency 41.333 ms 20 20080 21.59 MB/sec execute 76 sec latency 46.276 ms 20 20210 21.51 MB/sec execute 77 sec latency 52.345 ms 20 20357 21.50 MB/sec execute 78 sec latency 62.290 ms 20 20563 21.86 MB/sec execute 79 sec latency 73.076 ms 20 20807 22.03 MB/sec execute 80 sec latency 72.371 ms 20 21040 22.08 MB/sec execute 81 sec latency 65.284 ms 20 21272 22.46 MB/sec execute 82 sec latency 53.185 ms 20 21396 22.45 MB/sec execute 83 sec latency 57.304 ms 20 21510 22.34 MB/sec execute 84 sec latency 63.106 ms 20 21602 22.20 MB/sec execute 85 sec latency 65.863 ms 20 21702 21.99 MB/sec execute 86 sec latency 61.927 ms 20 21789 21.75 MB/sec execute 87 sec latency 98.901 ms 20 21909 21.52 MB/sec execute 88 sec latency 81.147 ms 20 22039 21.32 MB/sec execute 89 sec latency 59.836 ms 20 22149 21.15 MB/sec execute 90 sec latency 67.476 ms 20 22271 20.98 MB/sec execute 91 sec latency 57.626 ms 20 22409 20.96 MB/sec execute 92 sec latency 49.509 ms 20 22552 20.81 MB/sec execute 93 sec latency 41.539 ms 20 22742 21.12 MB/sec execute 94 sec latency 51.208 ms 20 22868 21.00 MB/sec execute 95 sec latency 94.886 ms 20 23002 20.81 MB/sec execute 96 sec latency 62.920 ms 20 23119 20.62 MB/sec execute 97 sec latency 54.936 ms 20 23231 20.42 MB/sec execute 98 sec latency 56.476 ms 20 23377 20.25 MB/sec execute 99 sec latency 53.416 ms 20 23538 20.14 MB/sec execute 100 sec latency 42.348 ms 20 23683 20.09 MB/sec execute 101 sec latency 51.779 ms 20 23834 20.05 MB/sec execute 102 sec latency 53.104 ms 20 24112 20.47 MB/sec execute 103 sec latency 53.418 ms 20 24390 20.67 MB/sec execute 104 sec latency 53.928 ms 20 24648 20.78 MB/sec execute 105 sec latency 55.057 ms 20 24911 21.15 MB/sec execute 106 sec latency 44.073 ms 20 25098 21.16 MB/sec execute 107 sec latency 36.139 ms 20 25269 21.06 MB/sec execute 108 sec latency 42.536 ms 20 25466 20.88 MB/sec execute 109 sec latency 75.432 ms 20 25688 20.77 MB/sec execute 110 sec latency 55.999 ms 20 25921 20.77 MB/sec execute 111 sec latency 36.088 ms 20 26154 20.83 MB/sec execute 112 sec latency 32.214 ms 20 26396 21.04 MB/sec execute 113 sec latency 45.819 ms 20 26601 20.89 MB/sec execute 114 sec latency 38.877 ms 20 26798 20.73 MB/sec execute 115 sec latency 38.203 ms 20 27015 20.60 MB/sec execute 116 sec latency 34.461 ms 20 27254 20.63 MB/sec execute 117 sec latency 120.404 ms 20 27533 20.87 MB/sec execute 118 sec latency 36.285 ms 20 28005 21.34 MB/sec execute 119 sec latency 32.998 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 81407 16.901 106.140 Close 60516 4.331 29.101 Rename 3491 21.589 73.064 Unlink 15822 5.734 40.555 Qpathinfo 74613 3.905 65.887 Qfileinfo 13320 0.107 14.398 Qfsinfo 13595 0.061 25.238 Sfileinfo 6659 13.608 55.496 Find 29081 0.748 74.344 WriteX 40841 2.121 43.677 ReadX 132225 0.018 5.026 LockX 280 4.502 15.743 UnlockX 280 4.467 17.744 Flush 5555 17.038 120.396 Throughput 21.3391 MB/sec 20 clients 20 procs max_latency=120.404 ms stopping dbench on /mnt/lustre/d0.oleg303-client.virtnet at Fri May 10 05:23:18 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg303-client.virtnet /mnt/lustre/d0.oleg303-client.virtnet /mnt/lustre/d0.oleg303-client.virtnet removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg303-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (150s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 05:23:24 (1715333004) min OST has 3565316kB available, using 5347974kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7491] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5222] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg303-clien 5222M 121000 85 104773 74 315699 60 2715 232 Latency 10113us 116ms 69721us 11173us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg303-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 216 17 5308 23 368 13 223 17 519 11 332 13 Latency 24045us 26256us 26728us 30019us 70662us 27544us 1.97,1.97,oleg303-client.virtnet,1,1715326261,5222M,,,,121000,85,104773,74,,,315699,60,2715,232,10,,,,,216,17,5308,23,368,13,223,17,519,11,332,13,,10113us,116ms,,69721us,11173us,24045us,26256us,26728us,30019us,70662us,27544us debug=0x33f0484 PASS bonnie (296s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 05:28:23 (1715333303) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 1084 -P /tmp -l 5408244 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 1084 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0xefa5f truncating to largest ever: 0x39c2f0 truncating to largest ever: 0x414d7c fallocating to largest ever: 0x459d46 truncating to largest ever: 0x5162c0 truncating to largest ever: 0x51d7a0 001000 1715333308.587801 fallocate 0x217fdc thru 0x218b8e (0xbb3 bytes) fallocating to largest ever: 0x52538b 002000 1715333312.789052 read 0x49ba4c thru 0x4ab22b (0xf7e0 bytes) fallocating to largest ever: 0x5285f4 007000 1715333334.606802 write 0x3f2f08 thru 0x402790 (0xf889 bytes) 010000 1715333346.851930 read 0x10b4e7 thru 0x1122c4 (0x6dde bytes) 013000 1715333358.595875 write 0x133bea thru 0x13e078 (0xa48f bytes) 014000 1715333362.860810 write 0x1d0bbf thru 0x1d40df (0x3521 bytes) 016000 1715333372.244107 punch from 0x27bc2b to 0x288e6d (0xd243 bytes) 018000 1715333381.659094 write 0x009ee0 thru 0x013001 (0x9122 bytes) 019000 1715333385.957398 punch from 0x2470fc to 0x24f99d (0x88a2 bytes) 021000 1715333393.933833 read 0x134b25 thru 0x144928 (0xfe04 bytes) 022000 1715333398.161496 mapwrite 0x3d42e9 thru 0x3d698b (0x26a3 bytes) 023000 1715333402.846385 mapwrite 0x15d6ce thru 0x168193 (0xaac6 bytes) 024000 1715333406.807978 mapread 0x1e72fe thru 0x1eb298 (0x3f9b bytes) 025000 1715333410.655176 fallocate 0x0a9c16 thru 0x0b4f35 (0xb320 bytes) 026000 1715333414.366488 fallocate 0x0e259e thru 0x0ef2eb (0xcd4e bytes) 027000 1715333418.526532 write 0x01bd36 thru 0x01e345 (0x2610 bytes) 028000 1715333422.118410 mapwrite 0x479d3f thru 0x487498 (0xd75a bytes) 029000 1715333425.886619 write 0x25413e thru 0x254a52 (0x915 bytes) 030000 1715333429.132572 trunc from 0x4c1c5a to 0x4c7fac (0x6353 bytes) 031000 1715333432.128418 fallocate 0x38a313 thru 0x38af63 (0xc51 bytes) 033000 1715333439.745868 trunc from 0x40637a to 0x12445e (0x2e1f1b bytes) 034000 1715333443.402620 punch from 0x0fc7af to 0x107c2d (0xb47f bytes) 035000 1715333447.831407 mapread 0x1c4b63 thru 0x1d3ad7 (0xef75 bytes) 036000 1715333451.038593 trunc from 0x4c7b9e to 0x516e9c (0x4f2ff bytes) 037000 1715333454.778526 fallocate 0x4e8f55 thru 0x4f8a1b (0xfac7 bytes) 038000 1715333458.500939 read 0x4111b8 thru 0x414800 (0x3649 bytes) 039000 1715333462.039835 punch from 0x0d239f to 0x0dbc18 (0x987a bytes) 040000 1715333465.951294 read 0x14d8af thru 0x15c404 (0xeb56 bytes) 041000 1715333469.257847 write 0x192e7a thru 0x19bbf8 (0x8d7f bytes) 042000 1715333472.836965 write 0x525692 thru 0x5285f3 (0x2f62 bytes) 043000 1715333475.776229 punch from 0x0ca845 to 0x0d4034 (0x97f0 bytes) 044000 1715333479.153424 trunc from 0x4331d2 to 0x4b663f (0x8346e bytes) 046000 1715333486.317491 mapwrite 0x302285 thru 0x310e2e (0xebaa bytes) 048000 1715333492.053156 read 0x0fc88a thru 0x104b28 (0x829f bytes) 049000 1715333495.475766 mapread 0x118f9f thru 0x1273f9 (0xe45b bytes) 050000 1715333498.563482 mapread 0x4a3294 thru 0x4a5d7a (0x2ae7 bytes) 053000 1715333508.778341 write 0x198765 thru 0x19b30f (0x2bab bytes) 054000 1715333512.604879 mapwrite 0x14707d thru 0x156e1a (0xfd9e bytes) 056000 1715333519.989294 read 0x23b367 thru 0x23ded4 (0x2b6e bytes) 057000 1715333524.494781 mapread 0x08e255 thru 0x09a563 (0xc30f bytes) 058000 1715333528.195754 fallocate 0x0a3461 thru 0x0af880 (0xc420 bytes) 059000 1715333532.010681 mapread 0x2d9a5d thru 0x2e5ccb (0xc26f bytes) 060000 1715333536.456649 fallocate 0x3ed81a thru 0x3f021b (0x2a02 bytes) 061000 1715333540.458550 mapread 0x1cc385 thru 0x1cf5df (0x325b bytes) 062000 1715333546.042073 trunc from 0x46400a to 0x0a3ff8 (0x3c0011 bytes) 065000 1715333555.970934 mapread 0x1cbcca thru 0x1d862e (0xc965 bytes) 066000 1715333559.341194 mapwrite 0x30b8df thru 0x3190a6 (0xd7c8 bytes) 067000 1715333563.004175 mapread 0x039142 thru 0x03ac06 (0x1ac5 bytes) 069000 1715333570.478627 mapread 0x0914a4 thru 0x0971ae (0x5d0b bytes) 070000 1715333574.165375 fallocate 0x2673e5 thru 0x2734c0 (0xc0dc bytes) 072000 1715333582.899038 fallocate 0x3baca6 thru 0x3bdbc0 (0x2f1b bytes) 073000 1715333586.611627 mapread 0x361925 thru 0x364f24 (0x3600 bytes) 074000 1715333590.273939 punch from 0x0764b5 to 0x07e651 (0x819d bytes) 076000 1715333602.571318 mapread 0x0d41a6 thru 0x0e05dc (0xc437 bytes) 078000 1715333609.755235 fallocate 0x03badc thru 0x03fb6c (0x4091 bytes) 080000 1715333618.407391 mapwrite 0x31df3e thru 0x329ffe (0xc0c1 bytes) 084000 1715333634.933569 punch from 0x07b5ea to 0x07b8c4 (0x2db bytes) 085000 1715333639.608021 write 0x3c3bc4 thru 0x3c69d7 (0x2e14 bytes) 086000 1715333643.281310 mapread 0x37b1ce thru 0x37ec2d (0x3a60 bytes) 087000 1715333647.191618 write 0x29887c thru 0x29d81f (0x4fa4 bytes) 088000 1715333651.019886 punch from 0x06075a to 0x060c32 (0x4d9 bytes) 089000 1715333654.916842 mapread 0x2b7f76 thru 0x2c513a (0xd1c5 bytes) 091000 1715333662.666322 mapread 0x191220 thru 0x19b588 (0xa369 bytes) 092000 1715333667.308345 mapwrite 0x032db0 thru 0x038b69 (0x5dba bytes) 093000 1715333671.461485 mapwrite 0x2fcb36 thru 0x2fd022 (0x4ed bytes) 094000 1715333674.490113 fallocate 0x4e57bf thru 0x4f3ca8 (0xe4ea bytes) 095000 1715333678.264637 read 0x0d7485 thru 0x0e63c6 (0xef42 bytes) 096000 1715333682.763704 write 0x395beb thru 0x3a4116 (0xe52c bytes) 097000 1715333687.358388 mapread 0x39921e thru 0x3a01d9 (0x6fbc bytes) 098000 1715333691.362998 trunc from 0x4cbd3d to 0x364f94 (0x166da8 bytes) 099000 1715333695.091286 mapwrite 0x0d916a thru 0x0e9049 (0xfee0 bytes) 100000 1715333699.357884 mapread 0x046584 thru 0x0513e5 (0xae62 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (397s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 05:35:02 (1715333702) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1715333708.775537 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1715333713.993595 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1715333719.283891 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1715333724.240853 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1715333734.052561 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1715333738.912152 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1715333744.434777 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1715333749.485533 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1715333753.999644 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1715333758.359695 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1715333762.849792 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1715333767.199265 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1715333771.480799 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1715333776.494369 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1715333781.902177 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1715333786.837863 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1715333791.830642 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1715333796.663405 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1715333811.974007 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1715333824.724636 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1715333828.376811 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1715333832.148062 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1715333835.805057 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1715333842.985513 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1715333850.377576 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1715333854.804531 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1715333858.667940 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1715333865.899832 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1715333869.698803 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1715333876.017987 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1715333879.572839 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1715333882.913806 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1715333887.085832 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1715333891.597601 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1715333900.464846 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1715333911.400343 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1715333922.485947 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1715333930.590713 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1715333934.637823 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1715333938.340509 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1715333948.197740 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1715333951.588557 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1715333955.014993 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1715333958.593813 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1715333961.987504 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1715333965.474104 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1715333969.334357 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1715333974.066612 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1715333978.181987 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1715333985.125828 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1715333989.243816 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1715333992.481391 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1715333995.776299 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1715333999.427220 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1715334006.209703 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1715334016.552256 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1715334023.964641 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1715334027.497655 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1715334030.744864 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1715334038.153892 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1715334042.083040 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1715334048.197349 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1715334051.218278 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1715334058.074730 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1715334066.406374 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1715334073.797049 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1715334077.273588 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1715334080.369319 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1715334083.703116 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1715334090.946929 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1715334094.318525 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1715334101.017878 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1715334104.447867 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (403s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1271 sec ===== 05:41:46 (1715334106) === sanity-benchmark: start cleanup 05:41:46 (1715334106) === === sanity-benchmark: finish cleanup 05:41:46 (1715334106) ===