-----============= acceptance-small: sanity-benchmark ============----- Mon May 13 04:00:22 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 04:00:27 (1715587227) === oleg332-client.virtnet: executing check_config_client /mnt/lustre oleg332-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg332-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6f8f000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6f8f000.idle_timeout=debug disable quota as required oleg332-server: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 04:00:36 (1715587236) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 04:00:37 (1715587237) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7478] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg332-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg332-client.virtnet at Mon May 13 04:00:38 EDT 2024 waiting for dbench pid 9741 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 16 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 148 126.68 MB/sec warmup 1 sec latency 67.737 ms 20 314 114.81 MB/sec warmup 2 sec latency 55.636 ms 20 482 112.06 MB/sec warmup 3 sec latency 53.495 ms 20 695 105.95 MB/sec warmup 4 sec latency 59.048 ms 20 847 86.22 MB/sec warmup 5 sec latency 44.576 ms 20 983 73.16 MB/sec warmup 6 sec latency 49.900 ms 20 1196 65.81 MB/sec warmup 7 sec latency 33.800 ms 20 1425 64.66 MB/sec warmup 8 sec latency 682.960 ms 20 1649 57.89 MB/sec warmup 9 sec latency 1683.074 ms 20 1863 52.46 MB/sec warmup 10 sec latency 2683.193 ms 20 2069 48.15 MB/sec warmup 11 sec latency 3683.380 ms 20 2325 46.21 MB/sec warmup 12 sec latency 4683.496 ms 20 2617 46.36 MB/sec warmup 13 sec latency 5683.590 ms 20 3041 47.89 MB/sec warmup 14 sec latency 6683.846 ms 20 3460 50.25 MB/sec warmup 15 sec latency 7683.940 ms 20 3686 48.65 MB/sec warmup 16 sec latency 8684.188 ms 20 3794 46.09 MB/sec warmup 17 sec latency 9684.498 ms 20 3935 43.58 MB/sec warmup 18 sec latency 10684.755 ms 20 4144 41.73 MB/sec warmup 19 sec latency 11053.130 ms 20 4332 40.09 MB/sec warmup 20 sec latency 37.075 ms 20 4536 39.32 MB/sec warmup 21 sec latency 35.958 ms 20 4807 39.67 MB/sec warmup 22 sec latency 38.458 ms 20 4984 38.57 MB/sec warmup 23 sec latency 142.083 ms 20 5394 8.30 MB/sec execute 1 sec latency 37.820 ms 20 5642 8.96 MB/sec execute 2 sec latency 29.573 ms 20 5871 15.34 MB/sec execute 3 sec latency 36.215 ms 20 6114 21.69 MB/sec execute 4 sec latency 39.293 ms 20 6441 30.29 MB/sec execute 5 sec latency 40.468 ms 20 6821 33.55 MB/sec execute 6 sec latency 42.095 ms 20 7110 36.10 MB/sec execute 7 sec latency 32.620 ms 20 7284 33.85 MB/sec execute 8 sec latency 36.736 ms 20 7448 30.61 MB/sec execute 9 sec latency 32.337 ms 20 7639 28.20 MB/sec execute 10 sec latency 57.129 ms 20 7833 26.46 MB/sec execute 11 sec latency 37.109 ms 20 8015 25.77 MB/sec execute 12 sec latency 41.668 ms 20 8240 25.62 MB/sec execute 13 sec latency 32.471 ms 20 8467 26.94 MB/sec execute 14 sec latency 53.356 ms 20 8649 25.41 MB/sec execute 15 sec latency 46.698 ms 20 8867 24.28 MB/sec execute 16 sec latency 31.496 ms 20 9121 23.34 MB/sec execute 17 sec latency 30.665 ms 20 9393 23.62 MB/sec execute 18 sec latency 28.446 ms 20 9690 25.11 MB/sec execute 19 sec latency 32.551 ms 20 10183 27.54 MB/sec execute 20 sec latency 33.110 ms 20 10573 29.90 MB/sec execute 21 sec latency 28.553 ms 20 10797 29.62 MB/sec execute 22 sec latency 33.345 ms 20 10967 28.59 MB/sec execute 23 sec latency 39.736 ms 20 11197 27.69 MB/sec execute 24 sec latency 48.523 ms 20 11405 26.98 MB/sec execute 25 sec latency 32.377 ms 20 11660 26.92 MB/sec execute 26 sec latency 24.466 ms 20 11952 28.00 MB/sec execute 27 sec latency 34.877 ms 20 12120 27.20 MB/sec execute 28 sec latency 39.592 ms 20 12316 26.40 MB/sec execute 29 sec latency 42.292 ms 20 12544 25.82 MB/sec execute 30 sec latency 31.989 ms 20 12821 25.62 MB/sec execute 31 sec latency 27.610 ms 20 13061 25.69 MB/sec execute 32 sec latency 36.882 ms 20 13481 27.57 MB/sec execute 33 sec latency 35.123 ms 20 13980 28.99 MB/sec execute 34 sec latency 39.236 ms 20 14263 29.37 MB/sec execute 35 sec latency 31.121 ms 20 14442 28.88 MB/sec execute 36 sec latency 31.852 ms 20 14653 28.22 MB/sec execute 37 sec latency 50.501 ms 20 14903 27.75 MB/sec execute 38 sec latency 36.662 ms 20 15142 27.67 MB/sec execute 39 sec latency 42.034 ms 20 15453 28.18 MB/sec execute 40 sec latency 37.026 ms 20 15711 27.93 MB/sec execute 41 sec latency 31.235 ms 20 15980 27.48 MB/sec execute 42 sec latency 27.387 ms 20 16335 27.24 MB/sec execute 43 sec latency 24.850 ms 20 16693 27.74 MB/sec execute 44 sec latency 27.371 ms 20 17169 29.03 MB/sec execute 45 sec latency 29.929 ms 20 17643 30.24 MB/sec execute 46 sec latency 30.367 ms 20 17863 30.12 MB/sec execute 47 sec latency 34.343 ms 20 18050 29.63 MB/sec execute 48 sec latency 31.442 ms 20 18272 29.16 MB/sec execute 49 sec latency 54.234 ms 20 18487 28.77 MB/sec execute 50 sec latency 35.512 ms 20 18728 28.69 MB/sec execute 51 sec latency 30.699 ms 20 19044 29.14 MB/sec execute 52 sec latency 37.922 ms 20 19309 28.84 MB/sec execute 53 sec latency 26.041 ms 20 19631 28.50 MB/sec execute 54 sec latency 24.778 ms 20 19933 28.34 MB/sec execute 55 sec latency 27.084 ms 20 20235 28.49 MB/sec execute 56 sec latency 27.397 ms 20 20739 29.60 MB/sec execute 57 sec latency 30.957 ms 20 21190 30.43 MB/sec execute 58 sec latency 30.116 ms 20 21446 30.47 MB/sec execute 59 sec latency 31.195 ms 20 21660 30.10 MB/sec execute 60 sec latency 26.367 ms 20 21882 29.73 MB/sec execute 61 sec latency 65.352 ms 20 22095 29.42 MB/sec execute 62 sec latency 33.171 ms 20 22349 29.33 MB/sec execute 63 sec latency 34.158 ms 20 22632 29.66 MB/sec execute 64 sec latency 35.811 ms 20 22845 29.39 MB/sec execute 65 sec latency 36.172 ms 20 23051 29.06 MB/sec execute 66 sec latency 37.887 ms 20 23283 28.73 MB/sec execute 67 sec latency 32.391 ms 20 23534 28.66 MB/sec execute 68 sec latency 34.356 ms 20 23788 28.71 MB/sec execute 69 sec latency 36.792 ms 20 24191 29.43 MB/sec execute 70 sec latency 37.124 ms 20 24679 30.18 MB/sec execute 71 sec latency 30.282 ms 20 24948 30.23 MB/sec execute 72 sec latency 31.742 ms 20 25151 29.97 MB/sec execute 73 sec latency 28.611 ms 20 25361 29.64 MB/sec execute 74 sec latency 52.805 ms 20 25570 29.36 MB/sec execute 75 sec latency 31.379 ms 20 25804 29.26 MB/sec execute 76 sec latency 28.737 ms 20 26116 29.53 MB/sec execute 77 sec latency 34.349 ms 20 26364 29.39 MB/sec execute 78 sec latency 31.295 ms 20 26599 29.12 MB/sec execute 79 sec latency 29.935 ms 20 26890 28.87 MB/sec execute 80 sec latency 23.805 ms 20 27189 28.91 MB/sec execute 81 sec latency 27.028 ms 20 27588 29.48 MB/sec execute 82 sec latency 31.029 ms 20 28074 30.03 MB/sec execute 83 sec latency 34.603 ms 20 28413 30.36 MB/sec execute 84 sec latency 28.883 ms 20 28615 30.21 MB/sec execute 85 sec latency 33.607 ms 20 28820 29.93 MB/sec execute 86 sec latency 33.697 ms 20 29036 29.66 MB/sec execute 87 sec latency 53.031 ms 20 29266 29.50 MB/sec execute 88 sec latency 29.777 ms 20 29519 29.46 MB/sec execute 89 sec latency 37.285 ms 20 29814 29.67 MB/sec execute 90 sec latency 32.851 ms 20 30033 29.42 MB/sec execute 91 sec latency 33.220 ms 20 30312 29.22 MB/sec execute 92 sec latency 26.262 ms 20 30614 29.15 MB/sec execute 93 sec latency 142.856 ms 20 30823 29.08 MB/sec execute 94 sec latency 1143.254 ms 20 31154 29.56 MB/sec execute 95 sec latency 2143.967 ms 20 31565 29.83 MB/sec execute 96 sec latency 3144.477 ms 20 31835 30.00 MB/sec execute 97 sec latency 4144.957 ms 20 32012 29.92 MB/sec execute 98 sec latency 5145.054 ms 20 32141 29.69 MB/sec execute 99 sec latency 6145.142 ms 20 32302 29.42 MB/sec execute 100 sec latency 7146.156 ms 20 32485 29.21 MB/sec execute 101 sec latency 8147.603 ms 20 32701 29.07 MB/sec execute 102 sec latency 9147.749 ms 20 32996 29.16 MB/sec execute 103 sec latency 10147.868 ms 20 33291 29.22 MB/sec execute 104 sec latency 11026.292 ms 20 33543 29.06 MB/sec execute 105 sec latency 32.587 ms 20 33838 28.89 MB/sec execute 106 sec latency 31.047 ms 20 34204 29.00 MB/sec execute 107 sec latency 18.944 ms 20 34756 29.60 MB/sec execute 108 sec latency 25.196 ms 20 35259 30.08 MB/sec execute 109 sec latency 26.661 ms 20 35545 30.12 MB/sec execute 110 sec latency 30.249 ms 20 35803 29.93 MB/sec execute 111 sec latency 47.641 ms 20 36067 29.77 MB/sec execute 112 sec latency 33.038 ms 20 36334 29.70 MB/sec execute 113 sec latency 30.204 ms 20 36633 29.84 MB/sec execute 114 sec latency 29.039 ms 20 36862 29.76 MB/sec execute 115 sec latency 32.812 ms 20 37079 29.61 MB/sec execute 116 sec latency 31.055 ms 20 37386 29.44 MB/sec execute 117 sec latency 29.881 ms 20 37691 29.48 MB/sec execute 118 sec latency 29.214 ms 20 38042 29.77 MB/sec execute 119 sec latency 62.208 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 114484 11.950 68.339 Close 84381 3.022 18.219 Rename 4868 15.790 43.821 Unlink 22836 4.087 21.947 Qpathinfo 104358 2.795 49.439 Qfileinfo 18461 0.084 8.185 Qfsinfo 19029 0.039 8.600 Sfileinfo 9256 9.697 42.784 Find 40528 0.555 52.976 WriteX 57096 1.658 11026.286 ReadX 182917 0.015 6.556 LockX 398 3.275 9.218 UnlockX 398 3.339 10.563 Flush 7973 11.918 81.378 Throughput 29.7669 MB/sec 20 clients 20 procs max_latency=11026.292 ms stopping dbench on /mnt/lustre/d0.oleg332-client.virtnet at Mon May 13 04:03:03 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg332-client.virtnet /mnt/lustre/d0.oleg332-client.virtnet /mnt/lustre/d0.oleg332-client.virtnet removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg332-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 04:03:09 (1715587389) min OST has 3548448kB available, using 5322672kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7478] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5197] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg332-clien 5197M 142871 94 125420 92 363161 66 4710 247 Latency 6748us 49098us 40327us 4786us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg332-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 383 17 7974 32 570 13 441 17 1107 12 620 12 Latency 19897us 18700us 27649us 14677us 3486us 23673us 1.97,1.97,oleg332-client.virtnet,1,1715594129,5197M,,,,142871,94,125420,92,,,363161,66,4710,247,10,,,,,383,17,7974,32,570,13,441,17,1107,12,620,12,,6748us,49098us,,40327us,4786us,19897us,18700us,27649us,14677us,3486us,23673us debug=0x33f0484 PASS bonnie (198s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 04:06:28 (1715587588) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 20074 -P /tmp -l 5408244 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 20074 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x464cfd fallocating to largest ever: 0x4fb6d6 truncating to largest ever: 0x526718 fallocating to largest ever: 0x5285f4 001000 1715587592.053139 mapread 0x21dbd8 thru 0x22793f (0x9d68 bytes) 003000 1715587597.532804 read 0x1552fe thru 0x160e53 (0xbb56 bytes) 005000 1715587603.778740 read 0x159670 thru 0x160876 (0x7207 bytes) 009000 1715587613.380556 write 0x2ee49b thru 0x2f792b (0x9491 bytes) 010000 1715587615.365919 punch from 0x3d84d7 to 0x3e7e5b (0xf985 bytes) 011000 1715587617.438341 mapwrite 0x2e7a2c thru 0x2ec8a9 (0x4e7e bytes) 013000 1715587621.656971 mapwrite 0x0009c7 thru 0x00a180 (0x97ba bytes) 015000 1715587625.869953 fallocate 0x291861 thru 0x297969 (0x6109 bytes) 016000 1715587627.881890 trunc from 0x3519c8 to 0x5011f3 (0x1af82c bytes) 019000 1715587634.523907 write 0x3ae2be thru 0x3bb4b6 (0xd1f9 bytes) 020000 1715587637.118195 read 0x158605 thru 0x15abb1 (0x25ad bytes) 021000 1715587639.667625 mapread 0x3b3852 thru 0x3c34a6 (0xfc55 bytes) 022000 1715587642.335356 mapwrite 0x36c01d thru 0x371a16 (0x59fa bytes) 023000 1715587645.066851 mapread 0x0a3b2d thru 0x0acbd7 (0x90ab bytes) 024000 1715587647.629903 mapwrite 0x34d0ee thru 0x358b44 (0xba57 bytes) 025000 1715587649.638367 mapread 0x30c2c5 thru 0x31b1e7 (0xef23 bytes) 026000 1715587651.588362 mapread 0x125d29 thru 0x12cce3 (0x6fbb bytes) 027000 1715587653.875019 punch from 0x0219ce to 0x021b5f (0x192 bytes) 028000 1715587656.043883 punch from 0x3fa09d to 0x4056a9 (0xb60d bytes) 029000 1715587658.191520 punch from 0x265f5d to 0x275bb9 (0xfc5d bytes) 030000 1715587660.280554 mapwrite 0x4c44f2 thru 0x4c71b2 (0x2cc1 bytes) 032000 1715587664.617071 punch from 0x1317eb to 0x13db0b (0xc321 bytes) 033000 1715587666.837188 read 0x07ee40 thru 0x082a8a (0x3c4b bytes) 034000 1715587668.773045 write 0x113a68 thru 0x11ac2c (0x71c5 bytes) 036000 1715587673.010781 punch from 0x064582 to 0x073bf2 (0xf671 bytes) 037000 1715587675.071953 trunc from 0x34be91 to 0x27a98c (0xd1504 bytes) 038000 1715587677.123507 trunc from 0x4b61dc to 0x035a05 (0x4807d6 bytes) 039000 1715587679.240655 trunc from 0x38e1f4 to 0x26863a (0x125bb9 bytes) 040000 1715587681.144476 trunc from 0x51b1fc to 0x216364 (0x304e97 bytes) 041000 1715587682.821089 read 0x013c1c thru 0x01df6b (0xa350 bytes) 042000 1715587685.044689 fallocate 0x150aee thru 0x15a403 (0x9916 bytes) 043000 1715587687.239015 mapread 0x03be43 thru 0x0401a3 (0x4361 bytes) 044000 1715587689.482757 mapwrite 0x1a47c9 thru 0x1b23da (0xdc12 bytes) 045000 1715587691.676395 fallocate 0x3ebf1c thru 0x3f7814 (0xb8f9 bytes) 047000 1715587697.349706 write 0x41f832 thru 0x427260 (0x7a2f bytes) 048000 1715587699.891212 fallocate 0x29c884 thru 0x2a2d04 (0x6481 bytes) 049000 1715587702.124343 punch from 0x058456 to 0x05a1b3 (0x1d5e bytes) 050000 1715587704.379802 read 0x1f817e thru 0x1fef16 (0x6d99 bytes) 051000 1715587706.540556 mapread 0x26b5a8 thru 0x26c4e7 (0xf40 bytes) 052000 1715587708.834693 fallocate 0x490a55 thru 0x49c656 (0xbc02 bytes) 053000 1715587711.151342 mapwrite 0x4e3bb7 thru 0x4f16c0 (0xdb0a bytes) 054000 1715587713.337735 trunc from 0x46c1e2 to 0x134161 (0x338080 bytes) 056000 1715587717.335578 trunc from 0x06e5f2 to 0x517109 (0x4a8b18 bytes) 058000 1715587721.012473 trunc from 0x51b9f9 to 0x16e91a (0x3ad0de bytes) 059000 1715587722.857493 write 0x295d6c thru 0x2a3031 (0xd2c6 bytes) 060000 1715587724.586876 mapwrite 0x2d853b thru 0x2e120f (0x8cd5 bytes) skipping zero size write 062000 1715587728.549471 trunc from 0x336094 to 0x46e460 (0x1383cd bytes) 064000 1715587732.737133 mapread 0x02eec3 thru 0x02f8de (0xa1c bytes) 065000 1715587734.766720 trunc from 0x472cfa to 0x14bdee (0x326f0b bytes) 066000 1715587737.030892 read 0x069965 thru 0x07334c (0x99e8 bytes) 067000 1715587739.406365 mapread 0x3227b3 thru 0x32cdc7 (0xa615 bytes) 068000 1715587741.313564 mapread 0x052d53 thru 0x05a9b7 (0x7c65 bytes) 069000 1715587743.359789 punch from 0x120c4c to 0x1216c5 (0xa7a bytes) 071000 1715587747.048078 punch from 0x49afd8 to 0x49c122 (0x114b bytes) 072000 1715587749.108147 mapwrite 0x01cc10 thru 0x01d266 (0x657 bytes) 074000 1715587753.214325 read 0x2f462b thru 0x2fc6f2 (0x80c8 bytes) 075000 1715587755.447133 trunc from 0x20ffa6 to 0x3dedab (0x1cee06 bytes) 076000 1715587757.590967 read 0x220858 thru 0x220aca (0x273 bytes) 077000 1715587759.750825 punch from 0x362643 to 0x36f92f (0xd2ed bytes) 078000 1715587761.845594 mapread 0x0c9b1f thru 0x0cf97a (0x5e5c bytes) 079000 1715587763.952876 read 0x073647 thru 0x0786a8 (0x5062 bytes) 081000 1715587767.959221 punch from 0x229e2c to 0x23133e (0x7513 bytes) 083000 1715587771.991706 mapwrite 0x2f4473 thru 0x2feaf3 (0xa681 bytes) 084000 1715587774.104474 mapwrite 0x5018d1 thru 0x5026ff (0xe2f bytes) 085000 1715587776.385968 write 0x48c901 thru 0x49b389 (0xea89 bytes) 086000 1715587778.769067 mapwrite 0x4371d9 thru 0x442378 (0xb1a0 bytes) 087000 1715587780.942524 trunc from 0x3eb450 to 0x2b3458 (0x137ff7 bytes) 088000 1715587782.941309 read 0x124a6d thru 0x131ba4 (0xd138 bytes) 089000 1715587784.934351 fallocate 0x0df7eb thru 0x0e7a19 (0x822f bytes) 091000 1715587789.059155 read 0x0c5161 thru 0x0cc705 (0x75a5 bytes) 092000 1715587791.072002 fallocate 0x1cb8c0 thru 0x1cdd96 (0x24d7 bytes) 093000 1715587793.199984 write 0x4c05b3 thru 0x4cb348 (0xad96 bytes) 094000 1715587795.411286 mapwrite 0x28e472 thru 0x28f65e (0x11ed bytes) 096000 1715587800.059739 trunc from 0x4ba0c9 to 0x4a13c1 (0x18d07 bytes) 097000 1715587802.269883 fallocate 0x4a791c thru 0x4b5d63 (0xe448 bytes) 098000 1715587804.390538 punch from 0x4ea857 to 0x4f69f5 (0xc19f bytes) 100000 1715587808.442854 mapwrite 0x05c633 thru 0x064229 (0x7bf7 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (221s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 04:10:10 (1715587810) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1715587813.832259 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1715587816.259862 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1715587818.616743 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1715587821.265621 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1715587826.208154 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1715587828.449035 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1715587830.795198 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1715587833.028383 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1715587835.153397 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1715587837.175103 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1715587839.346350 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1715587841.610932 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1715587843.704871 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1715587845.888847 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1715587848.340630 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1715587850.476195 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1715587852.843957 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1715587855.293840 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1715587858.208966 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1715587865.866285 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1715587868.055152 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1715587870.224078 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1715587872.399315 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1715587876.768584 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1715587881.300739 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1715587883.740579 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1715587886.269982 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1715587891.344105 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1715587893.929675 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1715587898.238748 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1715587900.735292 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1715587902.922795 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1715587905.457539 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1715587907.978521 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1715587912.681667 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1715587920.085536 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1715587926.982684 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1715587931.724304 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1715587934.019391 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1715587936.662051 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1715587944.265796 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1715587947.077174 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1715587949.891824 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1715587952.918396 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1715587955.525794 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1715587957.769697 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1715587959.941693 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1715587962.124549 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1715587964.410739 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1715587968.501358 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1715587971.180241 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1715587973.504777 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1715587975.909943 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1715587978.622620 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1715587983.572010 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1715587991.633187 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1715587997.138233 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1715587999.849013 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1715588002.307616 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1715588007.544455 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1715588010.123464 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1715588014.852107 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1715588017.300305 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1715588022.192759 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1715588026.983013 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1715588032.124405 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1715588034.714638 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1715588037.139345 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1715588039.357698 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1715588044.223463 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1715588046.651414 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1715588051.647312 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1715588054.284232 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (245s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 832 sec ====== 04:14:15 (1715588055) === sanity-benchmark: start cleanup 04:14:16 (1715588056) === === sanity-benchmark: finish cleanup 04:14:16 (1715588056) ===