-----============= acceptance-small: sanity-benchmark ============----- Fri May 10 08:07:52 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 08:07:56 (1715342876) === oleg354-client.virtnet: executing check_config_client /mnt/lustre oleg354-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg354-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6cbe800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6cbe800.idle_timeout=debug disable quota as required oleg354-server: oleg354-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 08:08:04 (1715342884) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 08:08:05 (1715342885) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7464] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg354-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg354-client.virtnet at Fri May 10 08:08:05 EDT 2024 waiting for dbench pid 9725 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 303 222.84 MB/sec warmup 1 sec latency 48.843 ms 20 703 212.12 MB/sec warmup 2 sec latency 46.792 ms 20 1091 152.82 MB/sec warmup 3 sec latency 19.874 ms 20 1549 130.47 MB/sec warmup 4 sec latency 29.214 ms 20 1976 105.88 MB/sec warmup 5 sec latency 20.749 ms 20 2410 93.55 MB/sec warmup 6 sec latency 26.316 ms 20 2892 94.57 MB/sec warmup 7 sec latency 258.366 ms 20 3376 89.65 MB/sec warmup 8 sec latency 562.492 ms 20 3850 88.44 MB/sec warmup 9 sec latency 20.318 ms 20 4172 80.30 MB/sec warmup 10 sec latency 55.609 ms 20 4488 74.28 MB/sec warmup 11 sec latency 59.080 ms 20 4947 74.23 MB/sec warmup 12 sec latency 21.098 ms 20 5288 69.80 MB/sec warmup 13 sec latency 52.129 ms 20 5734 65.55 MB/sec warmup 14 sec latency 18.823 ms 20 6223 65.91 MB/sec warmup 15 sec latency 25.194 ms 20 7021 70.31 MB/sec warmup 16 sec latency 23.704 ms 20 7433 69.46 MB/sec warmup 17 sec latency 22.783 ms 20 7724 65.88 MB/sec warmup 18 sec latency 41.847 ms 20 8065 63.29 MB/sec warmup 19 sec latency 27.421 ms 20 8499 63.52 MB/sec warmup 20 sec latency 26.021 ms 20 8880 61.45 MB/sec warmup 21 sec latency 20.537 ms 20 9308 59.18 MB/sec warmup 22 sec latency 22.167 ms 20 9792 59.90 MB/sec warmup 23 sec latency 20.460 ms 20 10980 53.44 MB/sec execute 1 sec latency 21.173 ms 20 11270 29.56 MB/sec execute 2 sec latency 49.580 ms 20 11611 25.60 MB/sec execute 3 sec latency 23.472 ms 20 12047 35.21 MB/sec execute 4 sec latency 28.236 ms 20 12424 32.74 MB/sec execute 5 sec latency 22.093 ms 20 12895 30.32 MB/sec execute 6 sec latency 20.168 ms 20 13386 37.27 MB/sec execute 7 sec latency 20.816 ms 20 14126 47.86 MB/sec execute 8 sec latency 23.849 ms 20 14519 48.43 MB/sec execute 9 sec latency 22.802 ms 20 14784 44.08 MB/sec execute 10 sec latency 43.992 ms 20 15104 41.34 MB/sec execute 11 sec latency 27.787 ms 20 15544 43.31 MB/sec execute 12 sec latency 24.070 ms 20 15946 41.98 MB/sec execute 13 sec latency 26.777 ms 20 16383 39.95 MB/sec execute 14 sec latency 21.060 ms 20 16866 42.00 MB/sec execute 15 sec latency 22.661 ms 20 17569 46.88 MB/sec execute 16 sec latency 26.996 ms 20 18022 47.90 MB/sec execute 17 sec latency 23.532 ms 20 18328 45.74 MB/sec execute 18 sec latency 41.789 ms 20 18647 44.05 MB/sec execute 19 sec latency 59.289 ms 20 19066 44.53 MB/sec execute 20 sec latency 19.570 ms 20 19476 44.18 MB/sec execute 21 sec latency 21.790 ms 20 19917 42.65 MB/sec execute 22 sec latency 20.753 ms 20 20391 43.26 MB/sec execute 23 sec latency 19.833 ms 20 21111 46.55 MB/sec execute 24 sec latency 25.267 ms 20 21582 47.87 MB/sec execute 25 sec latency 26.193 ms 20 21864 46.38 MB/sec execute 26 sec latency 37.759 ms 20 22193 45.14 MB/sec execute 27 sec latency 30.660 ms 20 22552 44.82 MB/sec execute 28 sec latency 25.525 ms 20 22979 45.17 MB/sec execute 29 sec latency 23.153 ms 20 23402 43.98 MB/sec execute 30 sec latency 20.777 ms 20 23894 44.32 MB/sec execute 31 sec latency 20.992 ms 20 24646 46.88 MB/sec execute 32 sec latency 21.556 ms 20 25112 47.80 MB/sec execute 33 sec latency 25.070 ms 20 25427 46.72 MB/sec execute 34 sec latency 34.758 ms 20 25738 45.74 MB/sec execute 35 sec latency 39.523 ms 20 26142 45.77 MB/sec execute 36 sec latency 28.940 ms 20 26574 45.76 MB/sec execute 37 sec latency 20.137 ms 20 27007 44.82 MB/sec execute 38 sec latency 21.301 ms 20 27528 45.55 MB/sec execute 39 sec latency 16.671 ms 20 28268 47.55 MB/sec execute 40 sec latency 24.538 ms 20 28721 47.93 MB/sec execute 41 sec latency 19.191 ms 20 28997 46.95 MB/sec execute 42 sec latency 35.280 ms 20 29335 46.19 MB/sec execute 43 sec latency 27.474 ms 20 29774 46.54 MB/sec execute 44 sec latency 23.638 ms 20 30197 46.15 MB/sec execute 45 sec latency 20.674 ms 20 30684 45.61 MB/sec execute 46 sec latency 19.998 ms 20 31266 46.65 MB/sec execute 47 sec latency 20.150 ms 20 31965 48.05 MB/sec execute 48 sec latency 22.868 ms 20 32330 47.95 MB/sec execute 49 sec latency 24.021 ms 20 32626 47.13 MB/sec execute 50 sec latency 39.329 ms 20 32994 46.68 MB/sec execute 51 sec latency 26.909 ms 20 33465 47.10 MB/sec execute 52 sec latency 19.900 ms 20 33846 46.44 MB/sec execute 53 sec latency 20.706 ms 20 34323 46.10 MB/sec execute 54 sec latency 19.214 ms 20 34924 47.15 MB/sec execute 55 sec latency 21.122 ms 20 35592 48.27 MB/sec execute 56 sec latency 21.098 ms 20 35943 47.97 MB/sec execute 57 sec latency 22.871 ms 20 36250 47.27 MB/sec execute 58 sec latency 47.829 ms 20 36614 46.98 MB/sec execute 59 sec latency 30.585 ms 20 37066 47.27 MB/sec execute 60 sec latency 21.198 ms 20 37469 46.64 MB/sec execute 61 sec latency 21.183 ms 20 37944 46.52 MB/sec execute 62 sec latency 19.634 ms 20 38598 47.55 MB/sec execute 63 sec latency 21.904 ms 20 39215 48.42 MB/sec execute 64 sec latency 21.389 ms 20 39530 47.96 MB/sec execute 65 sec latency 32.573 ms 20 39856 47.37 MB/sec execute 66 sec latency 40.794 ms 20 40242 47.22 MB/sec execute 67 sec latency 18.937 ms 20 40676 47.37 MB/sec execute 68 sec latency 26.715 ms 20 41092 46.82 MB/sec execute 69 sec latency 23.264 ms 20 41576 46.84 MB/sec execute 70 sec latency 18.483 ms 20 42257 47.83 MB/sec execute 71 sec latency 22.123 ms 20 42799 48.40 MB/sec execute 72 sec latency 25.553 ms 20 43078 47.94 MB/sec execute 73 sec latency 29.208 ms 20 43406 47.43 MB/sec execute 74 sec latency 36.561 ms 20 43761 47.23 MB/sec execute 75 sec latency 26.873 ms 20 44203 47.41 MB/sec execute 76 sec latency 22.202 ms 20 44590 46.90 MB/sec execute 77 sec latency 23.994 ms 20 45049 46.77 MB/sec execute 78 sec latency 21.599 ms 20 45685 47.61 MB/sec execute 79 sec latency 35.955 ms 20 46290 48.27 MB/sec execute 80 sec latency 23.883 ms 20 46588 47.91 MB/sec execute 81 sec latency 43.636 ms 20 46903 47.44 MB/sec execute 82 sec latency 27.130 ms 20 47254 47.25 MB/sec execute 83 sec latency 23.578 ms 20 47702 47.44 MB/sec execute 84 sec latency 27.931 ms 20 48085 46.97 MB/sec execute 85 sec latency 24.858 ms 20 48575 46.86 MB/sec execute 86 sec latency 17.379 ms 20 49230 47.64 MB/sec execute 87 sec latency 27.666 ms 20 49850 48.26 MB/sec execute 88 sec latency 21.171 ms 20 50144 47.90 MB/sec execute 89 sec latency 34.890 ms 20 50476 47.48 MB/sec execute 90 sec latency 35.966 ms 20 50840 47.32 MB/sec execute 91 sec latency 24.782 ms 20 51288 47.48 MB/sec execute 92 sec latency 30.092 ms 20 51697 47.07 MB/sec execute 93 sec latency 18.839 ms 20 52130 46.97 MB/sec execute 94 sec latency 24.836 ms 20 52761 47.62 MB/sec execute 95 sec latency 24.967 ms 20 53343 48.11 MB/sec execute 96 sec latency 24.772 ms 20 53666 47.89 MB/sec execute 97 sec latency 22.161 ms 20 53964 47.48 MB/sec execute 98 sec latency 35.419 ms 20 54309 47.28 MB/sec execute 99 sec latency 22.888 ms 20 54740 47.43 MB/sec execute 100 sec latency 19.342 ms 20 55103 47.08 MB/sec execute 101 sec latency 20.504 ms 20 55562 46.87 MB/sec execute 102 sec latency 18.612 ms 20 56131 47.37 MB/sec execute 103 sec latency 25.004 ms 20 56807 47.97 MB/sec execute 104 sec latency 23.027 ms 20 57166 47.88 MB/sec execute 105 sec latency 26.550 ms 20 57477 47.49 MB/sec execute 106 sec latency 41.501 ms 20 57824 47.27 MB/sec execute 107 sec latency 23.212 ms 20 58296 47.49 MB/sec execute 108 sec latency 21.723 ms 20 58670 47.14 MB/sec execute 109 sec latency 20.859 ms 20 59126 46.94 MB/sec execute 110 sec latency 20.986 ms 20 59711 47.43 MB/sec execute 111 sec latency 24.238 ms 20 60358 47.97 MB/sec execute 112 sec latency 21.409 ms 20 60709 47.87 MB/sec execute 113 sec latency 19.355 ms 20 60998 47.51 MB/sec execute 114 sec latency 47.016 ms 20 61341 47.29 MB/sec execute 115 sec latency 24.691 ms 20 61786 47.43 MB/sec execute 116 sec latency 19.432 ms 20 62172 47.17 MB/sec execute 117 sec latency 22.188 ms 20 62622 46.96 MB/sec execute 118 sec latency 18.001 ms 20 63169 47.32 MB/sec execute 119 sec latency 22.156 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 184370 7.488 47.819 Close 135439 1.803 19.935 Rename 7815 10.028 40.783 Unlink 37221 2.718 38.080 Qpathinfo 167080 1.784 34.207 Qfileinfo 29115 0.061 5.597 Qfsinfo 30650 0.027 5.599 Sfileinfo 15000 6.028 34.591 Find 64534 0.388 43.462 WriteX 90986 0.872 23.240 ReadX 289187 0.012 5.351 LockX 600 1.978 8.023 UnlockX 600 1.957 8.267 Flush 12899 6.811 59.283 Throughput 47.3192 MB/sec 20 clients 20 procs max_latency=59.289 ms stopping dbench on /mnt/lustre/d0.oleg354-client.virtnet at Fri May 10 08:10:30 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg354-client.virtnet /mnt/lustre/d0.oleg354-client.virtnet /mnt/lustre/d0.oleg354-client.virtnet removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg354-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 08:10:34 (1715343034) min OST has 3330036kB available, using 4995054kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7464] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4877] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg354-clien 4877M 170410 99 142586 93 389192 80 6607 311 Latency 4323us 27423us 37583us 12360us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg354-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 369 15 9381 33 566 12 413 16 1173 12 648 12 Latency 40858us 14074us 30743us 18608us 8465us 27569us 1.97,1.97,oleg354-client.virtnet,1,1715348497,4877M,,,,170410,99,142586,93,,,389192,80,6607,311,10,,,,,369,15,9381,33,566,12,413,16,1173,12,648,12,,4323us,27423us,,37583us,12360us,40858us,14074us,30743us,18608us,8465us,27569us debug=0x33f0484 PASS bonnie (181s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 08:13:37 (1715343217) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 28345 -P /tmp -l 5408244 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 28345 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x350fcd truncating to largest ever: 0x426d27 fallocating to largest ever: 0x48660d fallocating to largest ever: 0x4d132d fallocating to largest ever: 0x520d96 001000 1715343221.095955 write 0x112093 thru 0x117cde (0x5c4c bytes) fallocating to largest ever: 0x521302 002000 1715343223.193862 mapread 0x115311 thru 0x117056 (0x1d46 bytes) truncating to largest ever: 0x523bc9 fallocating to largest ever: 0x5247dd 003000 1715343225.434313 trunc from 0x44f683 to 0x3c9944 (0x85d3e bytes) fallocating to largest ever: 0x525321 004000 1715343227.413997 punch from 0x08b9f9 to 0x092229 (0x6831 bytes) 006000 1715343231.324024 read 0x1fcabe thru 0x20a3e4 (0xd927 bytes) 007000 1715343233.444803 write 0x14c472 thru 0x14f107 (0x2c96 bytes) fallocating to largest ever: 0x5285f4 010000 1715343239.105353 trunc from 0x3c1244 to 0x4f379e (0x13255b bytes) 012000 1715343243.712495 write 0x3f6bb5 thru 0x3faeb1 (0x42fd bytes) 013000 1715343246.693827 trunc from 0x4a320f to 0x185b35 (0x31d6d9 bytes) 016000 1715343257.806704 read 0x165f3c thru 0x17395b (0xda20 bytes) 018000 1715343262.591412 punch from 0x0223f4 to 0x02aca9 (0x88b6 bytes) 021000 1715343272.240389 read 0x204682 thru 0x207efc (0x387b bytes) 022000 1715343274.809745 punch from 0x09cce7 to 0x09f1ae (0x24c8 bytes) 023000 1715343277.073608 write 0x3ec676 thru 0x3ef860 (0x31eb bytes) 024000 1715343280.231770 punch from 0x00f149 to 0x013a16 (0x48ce bytes) 025000 1715343282.557284 punch from 0x0c009c to 0x0c3b65 (0x3aca bytes) 027000 1715343286.969352 mapread 0x12bc78 thru 0x1341a0 (0x8529 bytes) 028000 1715343288.901676 read 0x1b5126 thru 0x1b9425 (0x4300 bytes) 029000 1715343290.747957 mapread 0x0a4399 thru 0x0a658c (0x21f4 bytes) 031000 1715343294.965776 trunc from 0x36849b to 0x2ba4e2 (0xadfb8 bytes) 032000 1715343296.862755 trunc from 0x3f0222 to 0x51c109 (0x12bee8 bytes) 033000 1715343299.015656 fallocate 0x13dff1 thru 0x1486c6 (0xa6d6 bytes) 034000 1715343301.111343 trunc from 0x289abf to 0x078f00 (0x210bbe bytes) 035000 1715343303.325076 fallocate 0x3bbfe5 thru 0x3c2d3c (0x6d58 bytes) 037000 1715343307.478223 trunc from 0x5285f4 to 0x13a919 (0x3edcda bytes) 038000 1715343309.807483 mapwrite 0x260963 thru 0x269489 (0x8b27 bytes) 039000 1715343311.862090 read 0x2e37ca thru 0x2ed915 (0xa14c bytes) 040000 1715343314.027177 read 0x341645 thru 0x348f9b (0x7957 bytes) 041000 1715343316.294602 fallocate 0x41508c thru 0x416237 (0x11ac bytes) 043000 1715343320.111982 punch from 0x1aea29 to 0x1b4285 (0x585d bytes) 045000 1715343324.367059 read 0x14ec7b thru 0x156dc9 (0x814f bytes) 046000 1715343326.316660 punch from 0x4247e0 to 0x4270da (0x28fb bytes) 047000 1715343328.323628 punch from 0x255b43 to 0x25c9cd (0x6e8b bytes) 048000 1715343330.308096 write 0x399e5d thru 0x39fd10 (0x5eb4 bytes) 049000 1715343332.278779 read 0x0583cc thru 0x0665d5 (0xe20a bytes) 051000 1715343336.526369 read 0x169d3d thru 0x1782df (0xe5a3 bytes) 052000 1715343338.597222 punch from 0x0e4377 to 0x0ea93a (0x65c4 bytes) 053000 1715343340.871051 mapread 0x27112d thru 0x2762bf (0x5193 bytes) 054000 1715343342.798424 mapwrite 0x5120d1 thru 0x5153c3 (0x32f3 bytes) 057000 1715343349.277410 mapread 0x15a299 thru 0x161126 (0x6e8e bytes) 058000 1715343351.614938 write 0x3328f3 thru 0x33dff7 (0xb705 bytes) 063000 1715343362.646295 mapwrite 0x3cd7f3 thru 0x3dcc62 (0xf470 bytes) 064000 1715343364.825252 read 0x0f6b42 thru 0x0f97c1 (0x2c80 bytes) skipping zero size write 065000 1715343366.804332 read 0x0b1803 thru 0x0bec9f (0xd49d bytes) 066000 1715343368.861388 fallocate 0x4cda11 thru 0x4dd313 (0xf903 bytes) 067000 1715343370.800979 read 0x058efe thru 0x05ec65 (0x5d68 bytes) 068000 1715343372.868478 punch from 0x401cf2 to 0x4055e4 (0x38f3 bytes) 069000 1715343374.884486 punch from 0x02606b to 0x028c4d (0x2be3 bytes) 071000 1715343379.761852 write 0x170400 thru 0x17ec77 (0xe878 bytes) 072000 1715343382.454049 read 0x22c60c thru 0x22f32d (0x2d22 bytes) 073000 1715343384.452533 mapread 0x1c73f0 thru 0x1cca3d (0x564e bytes) 074000 1715343386.471303 write 0x2286ad thru 0x2297f0 (0x1144 bytes) 076000 1715343390.714452 read 0x21fce4 thru 0x2296b2 (0x99cf bytes) 079000 1715343396.798679 fallocate 0x4d73e0 thru 0x4df0fa (0x7d1b bytes) 080000 1715343398.793763 mapread 0x3737e0 thru 0x37dc24 (0xa445 bytes) 081000 1715343401.336554 punch from 0x2377ce to 0x23bb4e (0x4381 bytes) 082000 1715343403.180854 mapwrite 0x0c3e33 thru 0x0c573f (0x190d bytes) 083000 1715343405.936641 read 0x0d3cb1 thru 0x0db81f (0x7b6f bytes) 084000 1715343408.081727 punch from 0x3ec87e to 0x3ed17b (0x8fe bytes) 085000 1715343410.987563 trunc from 0x35e94c to 0x4a0224 (0x1418d9 bytes) 086000 1715343413.482552 mapwrite 0x1e78b3 thru 0x1e8efd (0x164b bytes) 089000 1715343420.573229 mapwrite 0x257a06 thru 0x25d5ad (0x5ba8 bytes) 090000 1715343423.409666 punch from 0x1de397 to 0x1e65e5 (0x824f bytes) 091000 1715343425.677187 write 0x0eb619 thru 0x0f3cb4 (0x869c bytes) 092000 1715343429.074656 mapread 0x1056de thru 0x11174e (0xc071 bytes) 093000 1715343431.648430 read 0x3084d8 thru 0x317144 (0xec6d bytes) 094000 1715343433.781632 punch from 0x42ffcd to 0x4347f8 (0x482c bytes) 095000 1715343436.123851 read 0x1ce225 thru 0x1d5b3f (0x791b bytes) 099000 1715343444.979569 fallocate 0x159596 thru 0x166fd2 (0xda3d bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (231s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 08:17:30 (1715343450) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1715343453.212559 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1715343455.857493 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1715343458.698345 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1715343461.514620 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1715343468.464464 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1715343472.343823 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1715343475.755944 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1715343478.877653 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1715343481.391966 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1715343483.790523 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1715343486.715980 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1715343490.178857 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1715343493.658223 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1715343497.039378 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1715343499.725087 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1715343502.300973 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1715343505.485474 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1715343509.469702 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1715343513.684278 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1715343522.954835 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1715343525.698586 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1715343528.751066 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1715343532.258886 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1715343538.130905 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1715343543.966701 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1715343546.543372 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1715343550.363330 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1715343557.714442 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1715343561.915681 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1715343567.723597 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1715343571.363812 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1715343575.011714 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1715343579.285642 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1715343583.137860 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1715343590.724086 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1715343602.021289 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1715343614.031520 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1715343621.018977 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1715343624.807145 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1715343628.957083 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1715343639.744414 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1715343643.833076 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1715343648.046361 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1715343651.824424 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1715343655.531660 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1715343659.248772 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1715343663.586767 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1715343667.327933 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1715343670.781144 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1715343677.194164 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1715343680.308253 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1715343683.296418 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1715343686.799815 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1715343690.401540 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1715343697.444538 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1715343709.653192 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1715343719.206834 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1715343723.090600 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1715343727.525031 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1715343736.587159 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1715343740.924889 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1715343748.659537 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1715343753.051419 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1715343762.252227 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1715343770.668035 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1715343778.906367 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1715343782.128272 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1715343785.523310 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1715343789.294105 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1715343796.728417 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1715343801.238805 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1715343809.060000 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1715343813.737912 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (365s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 943 sec ====== 08:23:35 (1715343815) === sanity-benchmark: start cleanup 08:23:36 (1715343816) === === sanity-benchmark: finish cleanup 08:23:36 (1715343816) ===