-----============= acceptance-small: sanity-benchmark ============----- Wed Jun 19 22:48:51 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 22:48:56 (1718851736) === oleg153-client.virtnet: executing check_config_client /mnt/lustre oleg153-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg153-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800ab66d000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ab66d000.idle_timeout=debug disable quota as required oleg153-server: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 22:49:03 (1718851743) === == sanity-benchmark test dbench: dbench ================== 22:49:03 (1718851743) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7549] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg153-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg153-client.virtnet at Wed Jun 19 22:49:04 EDT 2024 waiting for dbench pid 9746 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 20 of 20 processes prepared for launch 0 sec releasing clients 20 257 194.35 MB/sec warmup 1 sec latency 46.884 ms 20 548 189.82 MB/sec warmup 2 sec latency 36.129 ms 20 885 144.42 MB/sec warmup 3 sec latency 42.323 ms 20 1214 115.26 MB/sec warmup 4 sec latency 22.440 ms 20 1610 104.60 MB/sec warmup 5 sec latency 33.716 ms 20 1970 88.18 MB/sec warmup 6 sec latency 25.392 ms 20 2374 79.79 MB/sec warmup 7 sec latency 27.324 ms 20 2794 79.73 MB/sec warmup 8 sec latency 29.969 ms 20 3385 80.00 MB/sec warmup 9 sec latency 30.272 ms 20 3807 79.51 MB/sec warmup 10 sec latency 28.822 ms 20 4060 72.85 MB/sec warmup 11 sec latency 22.453 ms 20 4320 67.39 MB/sec warmup 12 sec latency 60.675 ms 20 4620 64.23 MB/sec warmup 13 sec latency 32.374 ms 20 4999 64.16 MB/sec warmup 14 sec latency 36.535 ms 20 5292 60.49 MB/sec warmup 15 sec latency 27.613 ms 20 5709 57.27 MB/sec warmup 16 sec latency 17.278 ms 20 6137 56.75 MB/sec warmup 17 sec latency 20.730 ms 20 6868 60.46 MB/sec warmup 18 sec latency 25.945 ms 20 7346 61.87 MB/sec warmup 19 sec latency 19.851 ms 20 7632 59.19 MB/sec warmup 20 sec latency 24.865 ms 20 7924 56.87 MB/sec warmup 21 sec latency 46.035 ms 20 8271 55.67 MB/sec warmup 22 sec latency 23.201 ms 20 8683 55.97 MB/sec warmup 23 sec latency 34.975 ms 20 9480 29.41 MB/sec execute 1 sec latency 23.193 ms 20 10020 66.59 MB/sec execute 2 sec latency 25.273 ms 20 10689 79.75 MB/sec execute 3 sec latency 22.116 ms 20 11010 67.70 MB/sec execute 4 sec latency 21.250 ms 20 11278 54.99 MB/sec execute 5 sec latency 34.990 ms 20 11573 48.07 MB/sec execute 6 sec latency 29.958 ms 20 11956 47.99 MB/sec execute 7 sec latency 21.326 ms 20 12325 47.24 MB/sec execute 8 sec latency 23.987 ms 20 12724 42.87 MB/sec execute 9 sec latency 20.082 ms 20 13136 42.29 MB/sec execute 10 sec latency 21.815 ms 20 13759 48.69 MB/sec execute 11 sec latency 32.483 ms 20 14353 52.82 MB/sec execute 12 sec latency 22.115 ms 20 14652 50.39 MB/sec execute 13 sec latency 25.492 ms 20 14955 47.34 MB/sec execute 14 sec latency 44.727 ms 20 15304 46.22 MB/sec execute 15 sec latency 23.673 ms 20 15747 47.39 MB/sec execute 16 sec latency 21.445 ms 20 16086 44.93 MB/sec execute 17 sec latency 20.274 ms 20 16575 44.13 MB/sec execute 18 sec latency 17.196 ms 20 17216 47.91 MB/sec execute 19 sec latency 20.873 ms 20 17889 50.84 MB/sec execute 20 sec latency 18.750 ms 20 18225 49.41 MB/sec execute 21 sec latency 20.040 ms 20 18578 47.67 MB/sec execute 22 sec latency 51.446 ms 20 19012 47.59 MB/sec execute 23 sec latency 22.506 ms 20 19455 47.64 MB/sec execute 24 sec latency 25.537 ms 20 19944 46.20 MB/sec execute 25 sec latency 15.795 ms 20 20501 47.65 MB/sec execute 26 sec latency 21.827 ms 20 21315 51.04 MB/sec execute 27 sec latency 22.632 ms 20 21706 50.71 MB/sec execute 28 sec latency 17.156 ms 20 22058 49.21 MB/sec execute 29 sec latency 38.984 ms 20 22456 48.68 MB/sec execute 30 sec latency 23.479 ms 20 22960 49.21 MB/sec execute 31 sec latency 27.956 ms 20 23422 47.96 MB/sec execute 32 sec latency 23.940 ms 20 23993 48.71 MB/sec execute 33 sec latency 17.027 ms 20 24834 51.59 MB/sec execute 34 sec latency 17.968 ms 20 25219 51.47 MB/sec execute 35 sec latency 20.410 ms 20 25526 50.18 MB/sec execute 36 sec latency 32.028 ms 20 25877 49.40 MB/sec execute 37 sec latency 21.979 ms 20 26360 50.07 MB/sec execute 38 sec latency 20.529 ms 20 26716 49.01 MB/sec execute 39 sec latency 19.988 ms 20 27158 48.26 MB/sec execute 40 sec latency 16.275 ms 20 27634 49.11 MB/sec execute 41 sec latency 23.480 ms 20 28375 50.91 MB/sec execute 42 sec latency 22.573 ms 20 28735 50.74 MB/sec execute 43 sec latency 25.319 ms 20 28989 49.71 MB/sec execute 44 sec latency 52.422 ms 20 29327 48.92 MB/sec execute 45 sec latency 30.753 ms 20 29730 48.90 MB/sec execute 46 sec latency 24.859 ms 20 30122 48.75 MB/sec execute 47 sec latency 27.171 ms 20 30542 47.92 MB/sec execute 48 sec latency 22.142 ms 20 31017 48.17 MB/sec execute 49 sec latency 18.523 ms 20 31690 49.48 MB/sec execute 50 sec latency 27.056 ms 20 32173 50.11 MB/sec execute 51 sec latency 20.895 ms 20 32461 49.39 MB/sec execute 52 sec latency 27.021 ms 20 32762 48.63 MB/sec execute 53 sec latency 34.153 ms 20 33107 48.26 MB/sec execute 54 sec latency 25.860 ms 20 33533 48.57 MB/sec execute 55 sec latency 18.737 ms 20 33885 47.82 MB/sec execute 56 sec latency 21.900 ms 20 34322 47.44 MB/sec execute 57 sec latency 17.583 ms 20 34837 48.26 MB/sec execute 58 sec latency 25.358 ms 20 35494 49.21 MB/sec execute 59 sec latency 24.258 ms 20 35835 49.13 MB/sec execute 60 sec latency 20.755 ms 20 36113 48.40 MB/sec execute 61 sec latency 41.534 ms 20 36404 47.82 MB/sec execute 62 sec latency 30.832 ms 20 36823 48.01 MB/sec execute 63 sec latency 21.572 ms 20 37188 47.75 MB/sec execute 64 sec latency 21.104 ms 20 37579 47.13 MB/sec execute 65 sec latency 23.565 ms 20 38026 47.07 MB/sec execute 66 sec latency 21.341 ms 20 38683 48.11 MB/sec execute 67 sec latency 26.413 ms 20 39238 48.78 MB/sec execute 68 sec latency 19.034 ms 20 39532 48.30 MB/sec execute 69 sec latency 23.733 ms 20 39824 47.73 MB/sec execute 70 sec latency 32.070 ms 20 40169 47.45 MB/sec execute 71 sec latency 29.268 ms 20 40606 47.68 MB/sec execute 72 sec latency 20.386 ms 20 40961 47.15 MB/sec execute 73 sec latency 21.703 ms 20 41388 46.85 MB/sec execute 74 sec latency 18.399 ms 20 41930 47.46 MB/sec execute 75 sec latency 21.417 ms 20 42587 48.26 MB/sec execute 76 sec latency 20.612 ms 20 42949 48.21 MB/sec execute 77 sec latency 23.384 ms 20 43238 47.67 MB/sec execute 78 sec latency 48.821 ms 20 43569 47.33 MB/sec execute 79 sec latency 26.197 ms 20 43971 47.48 MB/sec execute 80 sec latency 23.440 ms 20 44339 47.18 MB/sec execute 81 sec latency 22.396 ms 20 44740 46.72 MB/sec execute 82 sec latency 22.463 ms 20 45161 46.74 MB/sec execute 83 sec latency 19.933 ms 20 45832 47.54 MB/sec execute 84 sec latency 22.676 ms 20 46344 48.05 MB/sec execute 85 sec latency 21.434 ms 20 46639 47.65 MB/sec execute 86 sec latency 26.585 ms 20 46912 47.19 MB/sec execute 87 sec latency 49.284 ms 20 47256 46.96 MB/sec execute 88 sec latency 23.134 ms 20 47691 47.18 MB/sec execute 89 sec latency 22.344 ms 20 48050 46.74 MB/sec execute 90 sec latency 24.814 ms 20 48488 46.52 MB/sec execute 91 sec latency 17.542 ms 20 49018 47.01 MB/sec execute 92 sec latency 21.955 ms 20 49666 47.66 MB/sec execute 93 sec latency 22.610 ms 20 50025 47.63 MB/sec execute 94 sec latency 23.760 ms 20 50260 47.17 MB/sec execute 95 sec latency 46.041 ms 20 50564 46.81 MB/sec execute 96 sec latency 25.737 ms 20 50926 46.74 MB/sec execute 97 sec latency 24.247 ms 20 51317 46.78 MB/sec execute 98 sec latency 23.734 ms 20 51672 46.37 MB/sec execute 99 sec latency 21.260 ms 20 52078 46.18 MB/sec execute 100 sec latency 16.515 ms 20 52647 46.71 MB/sec execute 101 sec latency 24.761 ms 20 53292 47.29 MB/sec execute 102 sec latency 24.718 ms 20 53628 47.19 MB/sec execute 103 sec latency 20.319 ms 20 53911 46.80 MB/sec execute 104 sec latency 40.642 ms 20 54231 46.57 MB/sec execute 105 sec latency 23.019 ms 20 54649 46.67 MB/sec execute 106 sec latency 21.650 ms 20 55017 46.44 MB/sec execute 107 sec latency 20.487 ms 20 55444 46.17 MB/sec execute 108 sec latency 18.055 ms 20 55952 46.44 MB/sec execute 109 sec latency 20.669 ms 20 56644 47.08 MB/sec execute 110 sec latency 19.915 ms 20 57050 47.16 MB/sec execute 111 sec latency 20.858 ms 20 57298 46.83 MB/sec execute 112 sec latency 37.246 ms 20 57628 46.53 MB/sec execute 113 sec latency 27.558 ms 20 57980 46.42 MB/sec execute 114 sec latency 20.393 ms 20 58396 46.51 MB/sec execute 115 sec latency 22.470 ms 20 58746 46.17 MB/sec execute 116 sec latency 20.653 ms 20 59177 46.05 MB/sec execute 117 sec latency 17.747 ms 20 59713 46.43 MB/sec execute 118 sec latency 26.181 ms 20 60282 46.84 MB/sec execute 119 sec latency 25.149 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 177398 7.786 49.277 Close 130489 1.867 16.250 Rename 7578 10.283 32.472 Unlink 35720 2.824 31.903 Qpathinfo 161132 1.849 35.603 Qfileinfo 28279 0.062 5.096 Qfsinfo 29817 0.026 5.952 Sfileinfo 14320 6.282 28.578 Find 62644 0.395 37.413 WriteX 88330 0.909 24.107 ReadX 282754 0.013 4.555 LockX 600 2.044 6.410 UnlockX 600 2.041 5.297 Flush 12318 7.187 52.416 Throughput 46.8423 MB/sec 20 clients 20 procs max_latency=52.422 ms stopping dbench on /mnt/lustre/d0.oleg153-client.virtnet at Wed Jun 19 22:51:28 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg153-client.virtnet /mnt/lustre/d0.oleg153-client.virtnet /mnt/lustre/d0.oleg153-client.virtnet removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg153-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 22:51:31 (1718851891) min OST has 3328836kB available, using 4993254kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7549] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4876] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg153-clien 4876M 145325 99 132079 92 342263 73 5151 299 Latency 5434us 33668us 56425us 3211us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg153-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 493 16 8853 34 714 12 442 16 1057 12 564 12 Latency 25663us 12216us 34504us 26669us 2537us 27744us 1.97,1.97,oleg153-client.virtnet,1,1718858509,4876M,,,,145325,99,132079,92,,,342263,73,5151,299,10,,,,,493,16,8853,34,714,12,442,16,1057,12,564,12,,5434us,33668us,,56425us,3211us,25663us,12216us,34504us,26669us,2537us,27744us debug=0x33f0484 PASS bonnie (182s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 22:54:33 (1718852073) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 16083 -P /tmp -l 5400498 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 16083 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole truncating to largest ever: 0x4d7df3 fallocating to largest ever: 0x519fb5 fallocating to largest ever: 0x51e439 truncating to largest ever: 0x51fbfa 001000 1718852077.551721 mapwrite 0x306889 thru 0x315408 (0xeb80 bytes) fallocating to largest ever: 0x523f5e truncating to largest ever: 0x52632b 002000 1718852080.025111 punch from 0x1f4664 to 0x1f91fe (0x4b9b bytes) fallocating to largest ever: 0x5267b2 003000 1718852081.943759 mapread 0x158f76 thru 0x15a784 (0x180f bytes) 004000 1718852084.366324 write 0x49925f thru 0x4a3e25 (0xabc7 bytes) 006000 1718852089.577996 read 0x1433c2 thru 0x1482d6 (0x4f15 bytes) 007000 1718852091.617181 write 0x1b16e5 thru 0x1bee78 (0xd794 bytes) 009000 1718852095.789195 fallocate 0x2ad559 thru 0x2b0e7b (0x3923 bytes) 010000 1718852097.911158 mapread 0x162b52 thru 0x1669e3 (0x3e92 bytes) 012000 1718852101.762485 fallocate 0x02bb82 thru 0x02ee8b (0x330a bytes) 013000 1718852104.110363 write 0x327934 thru 0x328d30 (0x13fd bytes) 014000 1718852106.211967 trunc from 0x3d65ae to 0x14e6a4 (0x287f09 bytes) skipping zero size write 016000 1718852110.819110 fallocate 0x04a63c thru 0x05a173 (0xfb38 bytes) 019000 1718852118.134908 write 0x0fb86b thru 0x10363d (0x7dd3 bytes) 021000 1718852122.493556 mapread 0x3ba718 thru 0x3c9f3c (0xf825 bytes) 022000 1718852124.384963 mapread 0x1af592 thru 0x1b673e (0x71ad bytes) skipping zero size read 023000 1718852126.237743 mapread 0x0280ef thru 0x03014e (0x8060 bytes) 024000 1718852128.151122 write 0x45a6b4 thru 0x46a201 (0xfb4e bytes) 026000 1718852132.165279 trunc from 0x4744f5 to 0x408899 (0x6bc5b bytes) 031000 1718852141.477708 fallocate 0x4c0a65 thru 0x4c1e4a (0x13e6 bytes) 032000 1718852143.583392 trunc from 0x4b6975 to 0x2ce83c (0x1e8138 bytes) 033000 1718852145.680845 punch from 0x3e8b01 to 0x3eb56b (0x2a6b bytes) 034000 1718852147.451326 mapread 0x020abe thru 0x02c82f (0xbd72 bytes) 035000 1718852149.723316 mapwrite 0x0f2fb5 thru 0x0fdade (0xab2a bytes) 036000 1718852151.568048 mapwrite 0x1ce873 thru 0x1de388 (0xfb16 bytes) skipping zero size read 037000 1718852153.376138 read 0x08638b thru 0x08e931 (0x85a7 bytes) 038000 1718852155.378362 write 0x514933 thru 0x51a6e3 (0x5db1 bytes) 039000 1718852157.172777 mapread 0x3afcd2 thru 0x3bf7e8 (0xfb17 bytes) 040000 1718852158.899956 punch from 0x17acd5 to 0x17d0d4 (0x2400 bytes) 041000 1718852160.685932 write 0x42811d thru 0x42b0fc (0x2fe0 bytes) 043000 1718852164.526389 trunc from 0x2c3d84 to 0x4401dc (0x17c459 bytes) 044000 1718852166.588122 trunc from 0x085367 to 0x4d7417 (0x4520b1 bytes) 046000 1718852170.630532 write 0x293b23 thru 0x2a0018 (0xc4f6 bytes) 047000 1718852172.710103 punch from 0x1e6c3a to 0x1ef6fe (0x8ac5 bytes) 048000 1718852174.672073 punch from 0x26c34e to 0x274560 (0x8213 bytes) 049000 1718852176.535768 trunc from 0x51dfe7 to 0x47536e (0xa8c78 bytes) 051000 1718852180.343741 punch from 0x137e77 to 0x13c338 (0x44c2 bytes) 052000 1718852182.297231 write 0x49d771 thru 0x4a27ac (0x503c bytes) 053000 1718852184.114098 read 0x01525f thru 0x01c8d9 (0x767b bytes) 054000 1718852185.973501 mapwrite 0x093c33 thru 0x09e9a0 (0xad6e bytes) 055000 1718852187.773516 fallocate 0x377c58 thru 0x37fc27 (0x7fd0 bytes) 056000 1718852189.571811 read 0x311037 thru 0x311684 (0x64e bytes) 058000 1718852193.385008 read 0x19ad45 thru 0x1a2ea0 (0x815c bytes) 059000 1718852195.185669 write 0x086fab thru 0x08895f (0x19b5 bytes) 060000 1718852197.235875 mapread 0x00ef19 thru 0x0100e3 (0x11cb bytes) 061000 1718852199.236547 mapread 0x14fe45 thru 0x15cd65 (0xcf21 bytes) 062000 1718852201.504177 punch from 0x4195d5 to 0x422c3c (0x9668 bytes) 063000 1718852203.368385 mapread 0x39e2da thru 0x3a43ee (0x6115 bytes) 064000 1718852205.082606 trunc from 0x154fe9 to 0x327d68 (0x1d2d80 bytes) 065000 1718852206.875730 mapread 0x112984 thru 0x11f170 (0xc7ed bytes) 067000 1718852210.644941 trunc from 0x369236 to 0x27dc52 (0xeb5e3 bytes) 068000 1718852212.526031 read 0x4e80d2 thru 0x4f63dc (0xe30b bytes) 069000 1718852214.325418 trunc from 0x4b28d2 to 0x0aa06f (0x408862 bytes) 070000 1718852216.168872 fallocate 0x2dce61 thru 0x2ec239 (0xf3d9 bytes) 073000 1718852222.468564 punch from 0x129bb6 to 0x13916b (0xf5b6 bytes) 074000 1718852225.871992 read 0x219d16 thru 0x227b29 (0xde14 bytes) 075000 1718852228.900497 fallocate 0x27af35 thru 0x280142 (0x520e bytes) 076000 1718852231.826685 read 0x161081 thru 0x16f0cd (0xe04d bytes) 078000 1718852236.800212 fallocate 0x06fa9d thru 0x0752b9 (0x581d bytes) 080000 1718852242.901738 read 0x01c221 thru 0x02b592 (0xf372 bytes) 081000 1718852245.132445 trunc from 0x3db1dc to 0x14356c (0x297c6f bytes) 082000 1718852248.064518 punch from 0x0756a3 to 0x079824 (0x4182 bytes) 083000 1718852251.049868 punch from 0x06e22e to 0x074e20 (0x6bf3 bytes) 085000 1718852256.848921 mapread 0x12f75f thru 0x133788 (0x402a bytes) 086000 1718852259.701667 trunc from 0x429270 to 0x28e992 (0x19a8dd bytes) 087000 1718852262.682442 write 0x2cd0d5 thru 0x2d98f9 (0xc825 bytes) 088000 1718852265.386909 mapwrite 0x3de1fd thru 0x3e5f1e (0x7d22 bytes) 090000 1718852270.128493 punch from 0x028945 to 0x034851 (0xbf0d bytes) 092000 1718852276.199990 mapread 0x204cd8 thru 0x20f009 (0xa332 bytes) 093000 1718852278.614041 trunc from 0x44cb21 to 0x115d7e (0x336da2 bytes) 094000 1718852280.749111 fallocate 0x363915 thru 0x3674f5 (0x3be1 bytes) 095000 1718852283.495039 write 0x07e9f1 thru 0x086d03 (0x8313 bytes) 097000 1718852288.348659 punch from 0x0e1a5c to 0x0e5499 (0x3a3e bytes) 098000 1718852290.985408 mapwrite 0x16062f thru 0x16eade (0xe4b0 bytes) 100000 1718852296.668505 write 0x44700c thru 0x44e0dd (0x70d2 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (224s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 22:58:18 (1718852298) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1718852301.551054 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1718852305.174935 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1718852309.192346 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1718852313.063256 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1718852320.539264 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1718852323.052792 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1718852325.732304 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1718852328.590751 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1718852331.283145 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1718852333.959615 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1718852337.070296 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1718852339.632179 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1718852341.941068 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1718852344.536980 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1718852347.120397 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1718852349.253329 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1718852351.939442 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1718852354.413030 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1718852356.786903 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1718852365.127783 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1718852367.845628 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1718852370.494451 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1718852372.901111 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1718852378.399931 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1718852383.881888 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1718852386.287602 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1718852389.599198 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1718852396.254907 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1718852399.899038 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1718852405.402364 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1718852409.006020 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1718852411.754361 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1718852414.590554 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1718852417.617882 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1718852424.214685 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1718852432.516092 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1718852440.845445 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1718852446.748210 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1718852449.893330 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1718852452.824700 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1718852463.451662 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1718852467.713353 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1718852472.248886 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1718852476.496685 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1718852480.531495 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1718852483.664407 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1718852487.371051 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1718852491.288198 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1718852494.870568 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1718852501.688670 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1718852506.719008 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1718852510.859105 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1718852514.447117 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1718852518.832303 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1718852527.595961 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1718852538.898999 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1718852547.026113 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1718852551.471191 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1718852554.950603 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1718852564.623271 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1718852568.507793 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1718852576.402417 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1718852580.806699 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1718852588.533308 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1718852596.320486 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1718852605.016323 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1718852609.521439 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1718852613.613840 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1718852616.992213 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1718852625.168176 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1718852628.881687 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1718852636.159011 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1718852640.373302 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (343s) == sanity-benchmark test complete, duration 909 sec ====== 23:04:01 (1718852641) === sanity-benchmark: start cleanup 23:04:02 (1718852642) === === sanity-benchmark: finish cleanup 23:04:02 (1718852642) ===