-----============= acceptance-small: sanity-benchmark ============----- Thu Aug 22 01:28:10 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 01:28:15 (1724304495) === oleg118-client.virtnet: executing check_config_client /mnt/lustre oleg118-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg118-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5cf7800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5cf7800.idle_timeout=debug disable quota as required oleg118-server: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 01:28:22 (1724304502) === == sanity-benchmark test dbench: dbench ================== 01:28:22 (1724304502) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7574] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg118-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg118-client.virtnet at Thu Aug 22 01:28:23 EDT 2024 waiting for dbench pid 9791 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 239 182.89 MB/sec warmup 1 sec latency 49.202 ms 20 523 181.20 MB/sec warmup 2 sec latency 34.625 ms 20 874 144.18 MB/sec warmup 3 sec latency 40.919 ms 20 1231 116.04 MB/sec warmup 4 sec latency 25.885 ms 20 1664 104.79 MB/sec warmup 5 sec latency 23.446 ms 20 2076 88.74 MB/sec warmup 6 sec latency 19.565 ms 20 2426 80.50 MB/sec warmup 7 sec latency 134.138 ms 20 3040 84.13 MB/sec warmup 8 sec latency 24.141 ms 20 3658 86.05 MB/sec warmup 9 sec latency 24.082 ms 20 3970 80.11 MB/sec warmup 10 sec latency 21.575 ms 20 4246 73.20 MB/sec warmup 11 sec latency 62.685 ms 20 4555 68.81 MB/sec warmup 12 sec latency 25.313 ms 20 4976 68.55 MB/sec warmup 13 sec latency 36.251 ms 20 5285 64.81 MB/sec warmup 14 sec latency 25.582 ms 20 5656 60.99 MB/sec warmup 15 sec latency 25.172 ms 20 6072 59.84 MB/sec warmup 16 sec latency 22.699 ms 20 6779 63.31 MB/sec warmup 17 sec latency 27.708 ms 20 7335 65.16 MB/sec warmup 18 sec latency 25.259 ms 20 7627 62.32 MB/sec warmup 19 sec latency 33.703 ms 20 7933 59.75 MB/sec warmup 20 sec latency 37.605 ms 20 8317 58.50 MB/sec warmup 21 sec latency 18.634 ms 20 8734 58.55 MB/sec warmup 22 sec latency 26.142 ms 20 9069 56.26 MB/sec warmup 23 sec latency 24.120 ms 20 9914 82.78 MB/sec execute 1 sec latency 24.927 ms 20 10586 96.80 MB/sec execute 2 sec latency 25.951 ms 20 10925 80.22 MB/sec execute 3 sec latency 21.438 ms 20 11185 61.62 MB/sec execute 4 sec latency 45.329 ms 20 11471 51.35 MB/sec execute 5 sec latency 33.880 ms 20 11775 47.43 MB/sec execute 6 sec latency 29.328 ms 20 12152 49.72 MB/sec execute 7 sec latency 26.826 ms 20 12437 44.13 MB/sec execute 8 sec latency 22.678 ms 20 12687 39.75 MB/sec execute 9 sec latency 352.493 ms 20 13081 39.10 MB/sec execute 10 sec latency 23.041 ms 20 13669 45.59 MB/sec execute 11 sec latency 31.510 ms 20 14251 49.87 MB/sec execute 12 sec latency 22.226 ms 20 14561 48.14 MB/sec execute 13 sec latency 19.682 ms 20 14843 45.10 MB/sec execute 14 sec latency 42.395 ms 20 15135 43.09 MB/sec execute 15 sec latency 28.035 ms 20 15486 43.20 MB/sec execute 16 sec latency 23.063 ms 20 15808 43.08 MB/sec execute 17 sec latency 27.092 ms 20 16063 40.93 MB/sec execute 18 sec latency 30.050 ms 20 16422 39.57 MB/sec execute 19 sec latency 20.665 ms 20 16837 40.49 MB/sec execute 20 sec latency 22.317 ms 20 17451 43.45 MB/sec execute 21 sec latency 30.584 ms 20 17926 45.19 MB/sec execute 22 sec latency 25.483 ms 20 18203 43.94 MB/sec execute 23 sec latency 22.002 ms 20 18474 42.37 MB/sec execute 24 sec latency 48.276 ms 20 18750 41.43 MB/sec execute 25 sec latency 26.772 ms 20 19132 41.90 MB/sec execute 26 sec latency 25.232 ms 20 19482 41.37 MB/sec execute 27 sec latency 20.950 ms 20 19833 40.14 MB/sec execute 28 sec latency 18.566 ms 20 20187 39.83 MB/sec execute 29 sec latency 22.430 ms 20 20715 41.71 MB/sec execute 30 sec latency 29.142 ms 20 21333 43.62 MB/sec execute 31 sec latency 25.699 ms 20 21663 43.46 MB/sec execute 32 sec latency 23.990 ms 20 21910 42.31 MB/sec execute 33 sec latency 39.155 ms 20 22168 41.36 MB/sec execute 34 sec latency 157.040 ms 20 22496 41.14 MB/sec execute 35 sec latency 23.570 ms 20 22871 41.58 MB/sec execute 36 sec latency 31.434 ms 20 23147 40.59 MB/sec execute 37 sec latency 24.494 ms 20 23495 39.80 MB/sec execute 38 sec latency 19.213 ms 20 23918 40.18 MB/sec execute 39 sec latency 29.098 ms 20 24653 42.33 MB/sec execute 40 sec latency 33.030 ms 20 25077 42.94 MB/sec execute 41 sec latency 24.759 ms 20 25343 42.30 MB/sec execute 42 sec latency 47.069 ms 20 25626 41.49 MB/sec execute 43 sec latency 48.111 ms 20 25922 41.03 MB/sec execute 44 sec latency 26.295 ms 20 26285 41.36 MB/sec execute 45 sec latency 26.530 ms 20 26571 40.92 MB/sec execute 46 sec latency 23.885 ms 20 26912 40.21 MB/sec execute 47 sec latency 25.138 ms 20 27287 40.05 MB/sec execute 48 sec latency 25.940 ms 20 27823 41.14 MB/sec execute 49 sec latency 24.278 ms 20 28383 42.24 MB/sec execute 50 sec latency 23.954 ms 20 28688 42.18 MB/sec execute 51 sec latency 24.559 ms 20 28924 41.53 MB/sec execute 52 sec latency 41.956 ms 20 29214 40.92 MB/sec execute 53 sec latency 35.460 ms 20 29533 40.68 MB/sec execute 54 sec latency 25.561 ms 20 29909 41.02 MB/sec execute 55 sec latency 32.290 ms 20 30216 40.47 MB/sec execute 56 sec latency 22.974 ms 20 30569 39.94 MB/sec execute 57 sec latency 21.354 ms 20 30973 40.05 MB/sec execute 58 sec latency 22.146 ms 20 31627 41.32 MB/sec execute 59 sec latency 23.105 ms 20 32121 42.00 MB/sec execute 60 sec latency 24.795 ms 20 32406 41.65 MB/sec execute 61 sec latency 28.276 ms 20 32654 41.07 MB/sec execute 62 sec latency 38.388 ms 20 32937 40.67 MB/sec execute 63 sec latency 27.467 ms 20 33298 40.88 MB/sec execute 64 sec latency 27.396 ms 20 33599 40.71 MB/sec execute 65 sec latency 26.747 ms 20 33900 40.17 MB/sec execute 66 sec latency 23.185 ms 20 34264 39.89 MB/sec execute 67 sec latency 20.904 ms 20 34699 40.33 MB/sec execute 68 sec latency 27.689 ms 20 35293 41.12 MB/sec execute 69 sec latency 34.414 ms 20 35722 41.59 MB/sec execute 70 sec latency 22.879 ms 20 35965 41.17 MB/sec execute 71 sec latency 38.336 ms 20 36204 40.68 MB/sec execute 72 sec latency 46.311 ms 20 36420 40.27 MB/sec execute 73 sec latency 34.153 ms 20 36725 40.16 MB/sec execute 74 sec latency 26.804 ms 20 37031 40.25 MB/sec execute 75 sec latency 30.615 ms 20 37282 39.87 MB/sec execute 76 sec latency 27.915 ms 20 37597 39.45 MB/sec execute 77 sec latency 25.447 ms 20 38000 39.50 MB/sec execute 78 sec latency 25.457 ms 20 38616 40.32 MB/sec execute 79 sec latency 25.176 ms 20 39166 40.99 MB/sec execute 80 sec latency 27.777 ms 20 39484 40.80 MB/sec execute 81 sec latency 21.082 ms 20 39774 40.40 MB/sec execute 82 sec latency 39.811 ms 20 40094 40.21 MB/sec execute 83 sec latency 25.927 ms 20 40481 40.39 MB/sec execute 84 sec latency 21.155 ms 20 40787 40.14 MB/sec execute 85 sec latency 25.056 ms 20 41104 39.76 MB/sec execute 86 sec latency 22.968 ms 20 41487 39.68 MB/sec execute 87 sec latency 23.477 ms 20 42036 40.32 MB/sec execute 88 sec latency 25.782 ms 20 42556 40.90 MB/sec execute 89 sec latency 29.983 ms 20 42882 40.89 MB/sec execute 90 sec latency 26.158 ms 20 43154 40.55 MB/sec execute 91 sec latency 32.303 ms 20 43436 40.23 MB/sec execute 92 sec latency 33.718 ms 20 43774 40.12 MB/sec execute 93 sec latency 26.125 ms 20 44129 40.27 MB/sec execute 94 sec latency 24.054 ms 20 44427 39.96 MB/sec execute 95 sec latency 21.861 ms 20 44788 39.68 MB/sec execute 96 sec latency 20.028 ms 20 45188 39.83 MB/sec execute 97 sec latency 30.551 ms 20 45860 40.58 MB/sec execute 98 sec latency 21.538 ms 20 46322 40.93 MB/sec execute 99 sec latency 29.177 ms 20 46623 40.71 MB/sec execute 100 sec latency 23.966 ms 20 46910 40.38 MB/sec execute 101 sec latency 34.846 ms 20 47218 40.23 MB/sec execute 102 sec latency 28.989 ms 20 47582 40.40 MB/sec execute 103 sec latency 23.467 ms 20 47871 40.16 MB/sec execute 104 sec latency 26.055 ms 20 48224 39.86 MB/sec execute 105 sec latency 18.285 ms 20 48646 39.88 MB/sec execute 106 sec latency 23.890 ms 20 49258 40.50 MB/sec execute 107 sec latency 28.136 ms 20 49788 40.95 MB/sec execute 108 sec latency 25.319 ms 20 50099 40.84 MB/sec execute 109 sec latency 21.857 ms 20 50370 40.53 MB/sec execute 110 sec latency 42.598 ms 20 50621 40.29 MB/sec execute 111 sec latency 31.522 ms 20 50928 40.23 MB/sec execute 112 sec latency 30.713 ms 20 51272 40.32 MB/sec execute 113 sec latency 27.454 ms 20 51563 40.01 MB/sec execute 114 sec latency 22.576 ms 20 51943 39.83 MB/sec execute 115 sec latency 24.074 ms 20 52394 40.08 MB/sec execute 116 sec latency 27.804 ms 20 53068 40.73 MB/sec execute 117 sec latency 27.763 ms 20 53478 40.89 MB/sec execute 118 sec latency 24.153 ms 20 53763 40.64 MB/sec execute 119 sec latency 32.934 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 153970 9.019 48.269 Close 112415 1.927 33.740 Rename 6561 13.259 41.509 Unlink 31715 2.966 37.628 Qpathinfo 139047 2.200 38.491 Qfileinfo 24241 0.069 6.986 Qfsinfo 26046 0.030 5.073 Sfileinfo 12443 8.865 46.302 Find 54179 0.421 30.975 WriteX 76018 0.964 21.574 ReadX 243990 0.015 5.578 LockX 520 2.058 5.054 UnlockX 520 2.151 5.551 Flush 10868 7.948 352.484 Throughput 40.6421 MB/sec 20 clients 20 procs max_latency=352.493 ms stopping dbench on /mnt/lustre/d0.oleg118-client.virtnet at Thu Aug 22 01:30:48 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg118-client.virtnet /mnt/lustre/d0.oleg118-client.virtnet /mnt/lustre/d0.oleg118-client.virtnet removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg118-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 01:30:50 (1724304650) min OST has 3365472kB available, using 5048208kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7574] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4929] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg118-clien 4929M 152664 98 135861 93 393943 80 6121 295 Latency 5165us 37770us 44373us 3328us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg118-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 474 16 9092 36 664 12 475 16 1187 12 678 12 Latency 18065us 11793us 17835us 18463us 2208us 18180us 1.97,1.97,oleg118-client.virtnet,1,1724311424,4929M,,,,152664,98,135861,93,,,393943,80,6121,295,10,,,,,474,16,9092,36,664,12,475,16,1187,12,678,12,,5165us,37770us,,44373us,3328us,18065us,11793us,17835us,18463us,2208us,18180us debug=0x33f0484 PASS bonnie (175s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 01:33:45 (1724304825) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 22182 -P /tmp -l 5392626 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 22182 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read fallocating to largest ever: 0x29e6ed fallocating to largest ever: 0x2c61b2 fallocating to largest ever: 0x3abd48 truncating to largest ever: 0x3b960a fallocating to largest ever: 0x49f0fa fallocating to largest ever: 0x5011c8 truncating to largest ever: 0x50f5fd truncating to largest ever: 0x517dee 001000 1724304828.745514 read 0x2ad553 thru 0x2af6a1 (0x214f bytes) fallocating to largest ever: 0x518abd fallocating to largest ever: 0x5248f2 002000 1724304830.680295 mapread 0x3752ee thru 0x38105c (0xbd6f bytes) 004000 1724304834.546303 write 0x382d6e thru 0x38cb57 (0x9dea bytes) 006000 1724304838.944620 trunc from 0x461c43 to 0x120fc8 (0x340c7a bytes) 007000 1724304841.547969 trunc from 0x4d4bf0 to 0x40decd (0xc6d22 bytes) 008000 1724304843.545124 read 0x1c0b76 thru 0x1cb1f0 (0xa67b bytes) 009000 1724304845.845493 read 0x1030dd thru 0x108db5 (0x5cd9 bytes) 010000 1724304847.583597 read 0x05f3a3 thru 0x06e95a (0xf5b8 bytes) skipping zero size read 012000 1724304851.904212 mapwrite 0x1d9e0e thru 0x1e38cf (0x9ac2 bytes) 013000 1724304853.862155 punch from 0x1a93a8 to 0x1aed52 (0x59ab bytes) 015000 1724304857.763754 trunc from 0x438222 to 0x04b790 (0x3eca91 bytes) 017000 1724304862.036548 trunc from 0x380e02 to 0x3ab503 (0x2a702 bytes) 020000 1724304869.060148 trunc from 0x4e31f6 to 0x50e06d (0x2ae78 bytes) 021000 1724304874.047680 punch from 0x07335c to 0x080efb (0xdba0 bytes) 022000 1724304878.226012 mapwrite 0x317327 thru 0x318822 (0x14fc bytes) 025000 1724304892.841041 read 0x228210 thru 0x22bf36 (0x3d27 bytes) 026000 1724304896.081235 fallocate 0x12dcfb thru 0x133543 (0x5849 bytes) 027000 1724304900.856094 punch from 0x00f93c to 0x013af8 (0x41bd bytes) 028000 1724304904.982646 trunc from 0x401624 to 0x159491 (0x2a8192 bytes) 029000 1724304908.501675 write 0x066e6a thru 0x069281 (0x2418 bytes) 031000 1724304915.638702 write 0x34bd76 thru 0x350d1f (0x4faa bytes) 032000 1724304920.045573 read 0x0b27fc thru 0x0b7806 (0x500b bytes) 034000 1724304930.672500 write 0x2c2e7a thru 0x2cd99c (0xab23 bytes) 037000 1724304941.718180 mapwrite 0x00b5b6 thru 0x013687 (0x80d2 bytes) 038000 1724304944.687269 punch from 0x08452a to 0x0870ad (0x2b84 bytes) 039000 1724304947.546772 mapwrite 0x1c0fa3 thru 0x1c8aeb (0x7b49 bytes) 040000 1724304950.185959 fallocate 0x34a884 thru 0x3500cf (0x584c bytes) 042000 1724304955.828487 punch from 0x0fd0ff to 0x0fdff7 (0xef9 bytes) 044000 1724304962.635113 fallocate 0x297c09 thru 0x2a2415 (0xa80d bytes) 045000 1724304965.350133 read 0x282fd9 thru 0x28d95e (0xa986 bytes) 046000 1724304968.398547 mapread 0x42b7fe thru 0x42db9b (0x239e bytes) 047000 1724304970.846973 trunc from 0x168777 to 0x33c9b0 (0x1d423a bytes) 048000 1724304974.551879 read 0x02648b thru 0x030c4a (0xa7c0 bytes) 049000 1724304977.921944 write 0x20c2fc thru 0x2191de (0xcee3 bytes) 050000 1724304982.258433 mapread 0x34dbf2 thru 0x35bb9f (0xdfae bytes) 051000 1724304985.447945 mapwrite 0x2ac2e2 thru 0x2ae168 (0x1e87 bytes) 052000 1724304988.624890 fallocate 0x1447be thru 0x149a79 (0x52bc bytes) 054000 1724304995.203766 mapwrite 0x123e87 thru 0x129be1 (0x5d5b bytes) 055000 1724304999.012609 punch from 0x376230 to 0x384a5b (0xe82c bytes) 056000 1724305002.738245 trunc from 0x446b1c to 0x4dbfa6 (0x9548b bytes) 058000 1724305010.949651 trunc from 0x500072 to 0x1f184d (0x30e824 bytes) 059000 1724305014.757514 trunc from 0x46965a to 0x20382b (0x265e2e bytes) 060000 1724305018.900581 punch from 0x1ba24a to 0x1c4124 (0x9edb bytes) 061000 1724305022.252772 read 0x1b7f33 thru 0x1c2092 (0xa160 bytes) 062000 1724305025.914947 trunc from 0x45847d to 0x10ded0 (0x34a5ac bytes) 064000 1724305034.201075 trunc from 0x2a42b9 to 0x18466d (0x11fc4b bytes) 065000 1724305038.051731 mapwrite 0x152a7b thru 0x15f43f (0xc9c5 bytes) 066000 1724305043.879023 read 0x2d27be thru 0x2d46c0 (0x1f03 bytes) 068000 1724305066.218677 read 0x035f4d thru 0x03c56f (0x6623 bytes) 069000 1724305074.626948 write 0x05eb79 thru 0x066ebf (0x8347 bytes) 070000 1724305079.542339 fallocate 0x09ee76 thru 0x0a5c37 (0x6dc2 bytes) 071000 1724305086.243779 trunc from 0x2bea2a to 0x06aa6b (0x253fbe bytes) 073000 1724305099.391063 mapread 0x07b2a8 thru 0x0879b0 (0xc709 bytes) 076000 1724305119.737430 trunc from 0x260b8e to 0x2291e3 (0x379aa bytes) 077000 1724305126.866805 read 0x09afcc thru 0x0a17cd (0x6802 bytes) 079000 1724305138.239548 write 0x0eadde thru 0x0ec1e7 (0x140a bytes) 081000 1724305150.143334 mapread 0x11995d thru 0x11c617 (0x2cbb bytes) 084000 1724305169.150255 write 0x1ba6b4 thru 0x1bfcd7 (0x5624 bytes) 085000 1724305175.615972 read 0x02c05c thru 0x03aa8c (0xea31 bytes) 086000 1724305182.098436 write 0x470d15 thru 0x475c3d (0x4f29 bytes) 087000 1724305188.938749 mapwrite 0x1922e0 thru 0x19eb45 (0xc866 bytes) 088000 1724305196.669095 punch from 0x1d01fc to 0x1d9673 (0x9478 bytes) 089000 1724305203.810620 write 0x4bcff9 thru 0x4bfa29 (0x2a31 bytes) 090000 1724305211.949548 punch from 0x068c37 to 0x0782eb (0xf6b5 bytes) 091000 1724305219.365489 read 0x2a1b01 thru 0x2adb86 (0xc086 bytes) 092000 1724305227.900112 fallocate 0x4ca8ad thru 0x4cc576 (0x1cca bytes) 093000 1724305234.540690 mapwrite 0x463a98 thru 0x46985f (0x5dc8 bytes) 095000 1724305245.905229 mapread 0x1c494c thru 0x1cbc96 (0x734b bytes) 097000 1724305256.948549 mapwrite 0x217c49 thru 0x2190d5 (0x148d bytes) 098000 1724305261.849287 mapread 0x033675 thru 0x03b15c (0x7ae8 bytes) 099000 1724305268.274794 trunc from 0x3eb418 to 0x50fa5b (0x124644 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (451s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 01:41:17 (1724305277) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1724305285.197582 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1724305292.537243 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1724305300.425432 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1724305308.141750 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1724305322.425331 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1724305328.963105 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1724305336.308943 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1724305343.176533 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1724305350.115529 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1724305356.142157 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1724305361.709889 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1724305368.239605 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1724305377.510473 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1724305390.667012 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1724305400.048034 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1724305407.693497 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1724305416.554242 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1724305425.631242 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1724305434.826494 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1724305463.792222 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1724305472.836119 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1724305481.031645 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1724305487.983428 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1724305502.954866 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1724305517.283375 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1724305525.878122 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1724305535.301527 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1724305554.716316 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1724305564.618407 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1724305579.631517 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1724305588.681158 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1724305596.717569 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1724305606.802208 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1724305616.970295 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1724305636.312934 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1724305666.383555 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1724305691.329093 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1724305706.477553 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1724305714.278581 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1724305722.283095 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1724305742.926805 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1724305750.651243 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1724305758.443951 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1724305766.680175 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1724305774.841733 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1724305781.415652 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1724305789.115140 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1724305796.389637 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1724305804.111683 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1724305816.545897 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1724305825.492752 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1724305833.399564 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1724305841.036737 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1724305850.393494 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1724305867.702024 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1724305893.016810 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1724305912.989236 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1724305922.677749 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1724305931.788092 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1724305953.477176 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1724305964.670257 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1724305982.924070 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1724305991.713609 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1724306010.226180 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1724306027.602254 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1724306042.964367 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1724306051.138027 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1724306058.037678 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1724306063.833010 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1724306077.572028 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1724306084.363002 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1724306100.281516 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1724306109.017367 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (835s) == sanity-benchmark test complete, duration 1620 sec ===== 01:55:11 (1724306111) === sanity-benchmark: start cleanup 01:55:12 (1724306112) === === sanity-benchmark: finish cleanup 01:55:12 (1724306112) ===