-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:46 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:51 (1734015831) === oleg335-client.virtnet: executing check_config_client /mnt/lustre oleg335-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg335-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800ab6e1000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ab6e1000.idle_timeout=debug disable quota as required oleg335-server: oleg335-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:03 (1734015843) === == sanity-benchmark test dbench: dbench ================== 10:04:04 (1734015844) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6882] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg335-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg335-client.virtnet at Thu Dec 12 10:04:06 EST 2024 waiting for dbench pid 9445 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 11 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 75 67.31 MB/sec warmup 1 sec latency 109.094 ms 20 158 66.13 MB/sec warmup 2 sec latency 154.021 ms 20 226 58.18 MB/sec warmup 3 sec latency 119.635 ms 20 293 54.23 MB/sec warmup 4 sec latency 124.604 ms 20 359 51.34 MB/sec warmup 5 sec latency 119.542 ms 20 446 52.26 MB/sec warmup 6 sec latency 94.280 ms 20 545 53.97 MB/sec warmup 7 sec latency 106.896 ms 20 666 52.78 MB/sec warmup 8 sec latency 114.343 ms 20 733 47.31 MB/sec warmup 9 sec latency 84.428 ms 20 788 42.80 MB/sec warmup 10 sec latency 112.448 ms 20 858 39.22 MB/sec warmup 11 sec latency 95.053 ms 20 906 36.14 MB/sec warmup 12 sec latency 119.991 ms 20 960 33.53 MB/sec warmup 13 sec latency 102.243 ms 20 1041 32.61 MB/sec warmup 14 sec latency 82.263 ms 20 1123 30.61 MB/sec warmup 15 sec latency 76.758 ms 20 1179 28.75 MB/sec warmup 16 sec latency 111.644 ms 20 1240 27.14 MB/sec warmup 17 sec latency 98.399 ms 20 1379 28.47 MB/sec warmup 18 sec latency 98.758 ms 20 1440 27.37 MB/sec warmup 19 sec latency 143.199 ms 20 1497 26.03 MB/sec warmup 20 sec latency 84.171 ms 20 1565 24.86 MB/sec warmup 21 sec latency 84.923 ms 20 1621 23.77 MB/sec warmup 22 sec latency 91.008 ms 20 1675 22.78 MB/sec warmup 23 sec latency 126.750 ms 20 1807 1.13 MB/sec execute 1 sec latency 113.625 ms 20 1860 1.06 MB/sec execute 2 sec latency 104.156 ms 20 1935 1.13 MB/sec execute 3 sec latency 81.331 ms 20 2008 1.24 MB/sec execute 4 sec latency 72.867 ms 20 2057 1.33 MB/sec execute 5 sec latency 101.472 ms 20 2116 1.33 MB/sec execute 6 sec latency 116.611 ms 20 2172 1.31 MB/sec execute 7 sec latency 92.255 ms 20 2229 1.89 MB/sec execute 8 sec latency 144.520 ms 20 2325 3.08 MB/sec execute 9 sec latency 122.566 ms 20 2386 3.42 MB/sec execute 10 sec latency 120.059 ms 20 2433 3.50 MB/sec execute 11 sec latency 116.316 ms 20 2492 3.85 MB/sec execute 12 sec latency 128.657 ms 20 2576 4.35 MB/sec execute 13 sec latency 127.323 ms 20 2707 6.22 MB/sec execute 14 sec latency 102.718 ms 20 2842 8.23 MB/sec execute 15 sec latency 355.990 ms 20 2884 8.45 MB/sec execute 16 sec latency 1356.114 ms 20 2912 8.02 MB/sec execute 17 sec latency 2315.398 ms 20 2997 8.07 MB/sec execute 18 sec latency 1889.380 ms 20 3142 8.22 MB/sec execute 19 sec latency 150.586 ms 20 3279 8.71 MB/sec execute 20 sec latency 127.081 ms 20 3389 9.45 MB/sec execute 21 sec latency 101.989 ms 20 3479 10.13 MB/sec execute 22 sec latency 405.926 ms 20 3561 10.29 MB/sec execute 23 sec latency 94.620 ms 20 3640 10.29 MB/sec execute 24 sec latency 86.719 ms 20 3700 10.10 MB/sec execute 25 sec latency 97.033 ms 20 3752 10.10 MB/sec execute 26 sec latency 194.591 ms 20 3804 9.93 MB/sec execute 27 sec latency 115.808 ms 20 3853 9.64 MB/sec execute 28 sec latency 86.995 ms 20 3900 9.43 MB/sec execute 29 sec latency 101.977 ms 20 3945 9.19 MB/sec execute 30 sec latency 118.527 ms 20 3976 8.89 MB/sec execute 31 sec latency 158.706 ms 20 4015 8.61 MB/sec execute 32 sec latency 99.250 ms 20 4058 8.36 MB/sec execute 33 sec latency 102.905 ms 20 4126 8.12 MB/sec execute 34 sec latency 92.823 ms 20 4186 7.94 MB/sec execute 35 sec latency 129.830 ms 20 4254 7.78 MB/sec execute 36 sec latency 128.609 ms 20 4311 7.65 MB/sec execute 37 sec latency 105.337 ms 20 4367 7.52 MB/sec execute 38 sec latency 116.180 ms 20 4428 7.40 MB/sec execute 39 sec latency 101.443 ms 20 4481 7.28 MB/sec execute 40 sec latency 101.789 ms 20 4527 7.17 MB/sec execute 41 sec latency 110.754 ms 20 4589 7.23 MB/sec execute 42 sec latency 117.715 ms 20 4663 7.29 MB/sec execute 43 sec latency 95.196 ms 20 4727 7.20 MB/sec execute 44 sec latency 126.547 ms 20 4783 7.07 MB/sec execute 45 sec latency 135.990 ms 20 4868 7.40 MB/sec execute 46 sec latency 113.727 ms 20 4946 7.73 MB/sec execute 47 sec latency 123.785 ms 20 5011 7.86 MB/sec execute 48 sec latency 145.857 ms 20 5058 7.71 MB/sec execute 49 sec latency 102.494 ms 20 5110 7.57 MB/sec execute 50 sec latency 98.970 ms 20 5152 7.44 MB/sec execute 51 sec latency 100.002 ms 20 5194 7.31 MB/sec execute 52 sec latency 163.145 ms 20 5248 7.19 MB/sec execute 53 sec latency 110.785 ms 20 5290 7.07 MB/sec execute 54 sec latency 126.257 ms 20 5338 6.96 MB/sec execute 55 sec latency 111.005 ms 20 5380 6.84 MB/sec execute 56 sec latency 96.364 ms 20 5427 6.74 MB/sec execute 57 sec latency 131.989 ms 20 5499 6.65 MB/sec execute 58 sec latency 101.805 ms 20 5562 6.56 MB/sec execute 59 sec latency 96.639 ms 20 5610 6.47 MB/sec execute 60 sec latency 113.607 ms 20 5674 6.39 MB/sec execute 61 sec latency 88.677 ms 20 5739 6.31 MB/sec execute 62 sec latency 80.376 ms 20 5813 6.32 MB/sec execute 63 sec latency 79.678 ms 20 5908 6.45 MB/sec execute 64 sec latency 84.349 ms 20 5969 6.44 MB/sec execute 65 sec latency 103.227 ms 20 6031 6.43 MB/sec execute 66 sec latency 125.462 ms 20 6108 6.49 MB/sec execute 67 sec latency 127.707 ms 20 6227 6.75 MB/sec execute 68 sec latency 116.589 ms 20 6388 7.33 MB/sec execute 69 sec latency 95.489 ms 20 6503 7.47 MB/sec execute 70 sec latency 142.917 ms 20 6613 7.48 MB/sec execute 71 sec latency 116.857 ms 20 6787 7.61 MB/sec execute 72 sec latency 137.491 ms 20 6932 7.91 MB/sec execute 73 sec latency 103.367 ms 20 7058 8.22 MB/sec execute 74 sec latency 76.670 ms 20 7148 8.36 MB/sec execute 75 sec latency 100.273 ms 20 7212 8.29 MB/sec execute 76 sec latency 91.483 ms 20 7271 8.29 MB/sec execute 77 sec latency 115.486 ms 20 7331 8.33 MB/sec execute 78 sec latency 123.941 ms 20 7377 8.25 MB/sec execute 79 sec latency 92.620 ms 20 7418 8.16 MB/sec execute 80 sec latency 91.057 ms 20 7470 8.11 MB/sec execute 81 sec latency 84.706 ms 20 7515 8.02 MB/sec execute 82 sec latency 132.767 ms 20 7547 7.92 MB/sec execute 83 sec latency 185.287 ms 20 7588 7.83 MB/sec execute 84 sec latency 144.840 ms 20 7643 7.74 MB/sec execute 85 sec latency 92.818 ms 20 7694 7.66 MB/sec execute 86 sec latency 158.392 ms 20 7760 7.59 MB/sec execute 87 sec latency 129.597 ms 20 7821 7.54 MB/sec execute 88 sec latency 144.926 ms 20 7881 7.49 MB/sec execute 89 sec latency 96.349 ms 20 7942 7.44 MB/sec execute 90 sec latency 101.468 ms 20 7997 7.39 MB/sec execute 91 sec latency 119.539 ms 20 8045 7.33 MB/sec execute 92 sec latency 105.059 ms 20 8101 7.32 MB/sec execute 93 sec latency 124.800 ms 20 8177 7.38 MB/sec execute 94 sec latency 100.041 ms 20 8247 7.35 MB/sec execute 95 sec latency 101.354 ms 20 8311 7.29 MB/sec execute 96 sec latency 99.593 ms 20 8385 7.33 MB/sec execute 97 sec latency 112.322 ms 20 8489 7.63 MB/sec execute 98 sec latency 108.773 ms 20 8552 7.67 MB/sec execute 99 sec latency 148.260 ms 20 8604 7.60 MB/sec execute 100 sec latency 100.499 ms 20 8655 7.53 MB/sec execute 101 sec latency 100.419 ms 20 8691 7.47 MB/sec execute 102 sec latency 119.597 ms 20 8734 7.40 MB/sec execute 103 sec latency 131.400 ms 20 8787 7.34 MB/sec execute 104 sec latency 110.330 ms 20 8834 7.27 MB/sec execute 105 sec latency 126.173 ms 20 8883 7.21 MB/sec execute 106 sec latency 108.325 ms 20 8926 7.15 MB/sec execute 107 sec latency 81.972 ms 20 8986 7.10 MB/sec execute 108 sec latency 101.982 ms 20 9074 7.05 MB/sec execute 109 sec latency 72.812 ms 20 9130 7.00 MB/sec execute 110 sec latency 93.274 ms 20 9193 6.95 MB/sec execute 111 sec latency 94.375 ms 20 9261 6.90 MB/sec execute 112 sec latency 99.370 ms 20 9334 6.89 MB/sec execute 113 sec latency 75.137 ms 20 9452 6.97 MB/sec execute 114 sec latency 72.248 ms 20 9528 6.97 MB/sec execute 115 sec latency 91.646 ms 20 9624 7.01 MB/sec execute 116 sec latency 81.825 ms 20 9746 7.14 MB/sec execute 117 sec latency 108.013 ms 20 9910 7.45 MB/sec execute 118 sec latency 97.726 ms 20 10064 7.62 MB/sec execute 119 sec latency 81.217 ms 20 cleanup 120 sec 20 cleanup 121 sec 6 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 28490 49.049 194.578 Close 21270 10.894 49.083 Rename 1239 72.202 173.159 Unlink 5454 15.105 65.762 Qpathinfo 27089 11.472 123.150 Qfileinfo 4925 0.213 26.169 Qfsinfo 4594 0.123 13.688 Sfileinfo 2320 43.285 158.386 Find 10099 2.368 97.941 WriteX 14631 4.480 90.340 ReadX 47398 0.026 5.201 LockX 120 17.457 64.634 UnlockX 120 18.413 62.215 Flush 1949 46.873 2315.392 Throughput 7.62006 MB/sec 20 clients 20 procs max_latency=2315.398 ms stopping dbench on /mnt/lustre/d0.oleg335-client.virtnet at Thu Dec 12 10:06:32 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg335-client.virtnet /mnt/lustre/d0.oleg335-client.virtnet /mnt/lustre/d0.oleg335-client.virtnet removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg335-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (154s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:38 (1734015998) min OST has 3436396kB available, using 5154594kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6882] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5033] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg335-clien 5033M 92788 66 61189 50 146968 31 1519 208 Latency 17237us 220ms 144ms 38516us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg335-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 249 19 7780 34 477 14 332 19 1003 12 578 13 Latency 23468us 11944us 19235us 23133us 2784us 16884us 1.97,1.97,oleg335-client.virtnet,1,1734006028,5033M,,,,92788,66,61189,50,,,146968,31,1519,208,10,,,,,249,19,7780,34,477,14,332,19,1003,12,578,13,,17237us,220ms,,144ms,38516us,23468us,11944us,19235us,23133us,2784us,16884us debug=0x33f0484 PASS bonnie (312s) == sanity-benchmark test iozone: iozone ================== 10:11:50 (1734016310) Waiting for MDT destroys to complete oleg335-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg335-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg335-client: oleg335-server: ssh exited with exit code 1 pdsh@oleg335-client: oleg335-server: ssh exited with exit code 1 min OST has 3605620kB available, using 5408430kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6882] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:00 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 407429 248704 126064 122756 49508 109118 iozone test complete. Waiting for MDT destroys to complete oleg335-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg335-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg335-client: oleg335-server: ssh exited with exit code 1 pdsh@oleg335-client: oleg335-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg335-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg335-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg335-client: oleg335-server: ssh exited with exit code 1 pdsh@oleg335-client: oleg335-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:17:04 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 83352 72167 75669 76254 75896 73686 iozone test complete. Waiting for MDT destroys to complete oleg335-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg335-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg335-client: oleg335-server: ssh exited with exit code 1 pdsh@oleg335-client: oleg335-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (752s) == sanity-benchmark test fsx: fsx ======================== 10:24:22 (1734017062) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 21112 -P /tmp -l 5408430 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 21112 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x11e7e9 fallocating to largest ever: 0x470f82 truncating to largest ever: 0x48a2b6 fallocating to largest ever: 0x4c75f4 truncating to largest ever: 0x51b10d 001000 1734017066.380704 trunc from 0x4e7c8c to 0x4fff9b (0x18310 bytes) truncating to largest ever: 0x524809 fallocating to largest ever: 0x5286ae 002000 1734017069.327904 read 0x45c6a4 thru 0x46b24f (0xebac bytes) 003000 1734017072.384857 mapread 0x05a574 thru 0x05d9e8 (0x3475 bytes) 005000 1734017078.888701 mapread 0x51c8f1 thru 0x52629a (0x99aa bytes) 006000 1734017081.815272 mapwrite 0x18a6a2 thru 0x190630 (0x5f8f bytes) 007000 1734017085.088845 punch from 0x36d0d0 to 0x371444 (0x4375 bytes) 008000 1734017088.152386 mapwrite 0x471047 thru 0x47c5dc (0xb596 bytes) 009000 1734017091.240982 mapread 0x1d82bc thru 0x1e3691 (0xb3d6 bytes) 010000 1734017094.131916 fallocate 0x41f9df thru 0x41fa5b (0x7d bytes) 012000 1734017100.577331 trunc from 0x511de2 to 0x3beb31 (0x1532b0 bytes) 013000 1734017104.148176 punch from 0x20627b to 0x206e2a (0xbb0 bytes) 014000 1734017107.416939 read 0x041956 thru 0x04898c (0x7037 bytes) 015000 1734017111.050166 trunc from 0x3cbc4b to 0x4c5306 (0xf96bc bytes) 016000 1734017114.383564 trunc from 0x3a36c1 to 0x38b002 (0x186be bytes) 017000 1734017117.114441 read 0x2ea03a thru 0x2f1adf (0x7aa6 bytes) 018000 1734017120.198656 fallocate 0x3dbcd8 thru 0x3e8ee1 (0xd20a bytes) 020000 1734017126.160805 mapread 0x39512f thru 0x39ae8c (0x5d5e bytes) 021000 1734017129.013432 read 0x225621 thru 0x22a9f4 (0x53d4 bytes) 022000 1734017131.760583 punch from 0x00f9a8 to 0x01a24b (0xa8a4 bytes) 023000 1734017134.943951 write 0x25ded8 thru 0x2680c3 (0xa1ec bytes) 024000 1734017137.708873 mapread 0x00642c thru 0x0095ff (0x31d4 bytes) 026000 1734017143.153899 trunc from 0x4b3e59 to 0x527cad (0x73e55 bytes) 027000 1734017145.897950 mapread 0x41cc7c thru 0x42c9b5 (0xfd3a bytes) 028000 1734017148.554739 trunc from 0x030236 to 0x281935 (0x251700 bytes) 029000 1734017151.763858 mapwrite 0x24471c thru 0x253f42 (0xf827 bytes) 031000 1734017157.477972 punch from 0x43c56e to 0x44a135 (0xdbc8 bytes) 032000 1734017160.355240 write 0x2ca908 thru 0x2cfdf6 (0x54ef bytes) 033000 1734017163.099533 fallocate 0x0311c8 thru 0x040f94 (0xfdcd bytes) 035000 1734017169.012713 write 0x08edce thru 0x09a4cd (0xb700 bytes) 036000 1734017171.608837 trunc from 0x37bc6b to 0x3af7c7 (0x33b5d bytes) 038000 1734017176.893494 mapwrite 0x022a22 thru 0x02666e (0x3c4d bytes) 039000 1734017179.732459 punch from 0x0d4472 to 0x0d4cc6 (0x855 bytes) 040000 1734017182.628931 mapread 0x1d5265 thru 0x1deb19 (0x98b5 bytes) 041000 1734017185.149132 mapread 0x2eb1ae thru 0x2f3da7 (0x8bfa bytes) 042000 1734017188.103606 fallocate 0x13e731 thru 0x13e8dd (0x1ad bytes) 045000 1734017197.289448 punch from 0x1a172f to 0x1ab02d (0x98ff bytes) 046000 1734017200.216838 trunc from 0x4a8cec to 0x37e44f (0x12a89c bytes) 047000 1734017203.470338 mapread 0x0f2395 thru 0x0f8963 (0x65cf bytes) 048000 1734017206.307430 write 0x1d99ba thru 0x1dea82 (0x50c9 bytes) 050000 1734017212.491698 punch from 0x15175b to 0x1546e3 (0x2f89 bytes) 051000 1734017215.645044 mapwrite 0x44e916 thru 0x45730a (0x89f5 bytes) 052000 1734017218.592315 write 0x0e043b thru 0x0ec436 (0xbffc bytes) 054000 1734017224.879888 write 0x3fd692 thru 0x40c104 (0xea73 bytes) 056000 1734017230.998990 fallocate 0x207931 thru 0x2177ea (0xfeba bytes) 058000 1734017236.835421 fallocate 0x332cf6 thru 0x340485 (0xd790 bytes) 059000 1734017240.278363 punch from 0x155f55 to 0x15c9ba (0x6a66 bytes) 064000 1734017256.346991 trunc from 0x50e5f0 to 0x18cc07 (0x3819e8 bytes) 065000 1734017259.625469 fallocate 0x0f31b3 thru 0x0f3d8b (0xbd9 bytes) 067000 1734017266.375714 trunc from 0x4f7f3f to 0x499e3f (0x5e0ff bytes) 068000 1734017269.753854 trunc from 0x4a2e1b to 0x224594 (0x27e886 bytes) 069000 1734017273.562598 trunc from 0x45bdf2 to 0x11b7af (0x340642 bytes) 070000 1734017277.379368 mapwrite 0x11f397 thru 0x125e83 (0x6aed bytes) 071000 1734017280.902915 trunc from 0x4ca872 to 0x2415e3 (0x28928e bytes) 073000 1734017287.335492 read 0x0aa891 thru 0x0b74c4 (0xcc34 bytes) 074000 1734017290.491421 read 0x46a4b9 thru 0x472480 (0x7fc8 bytes) 075000 1734017293.421461 punch from 0x003efa to 0x004d61 (0xe68 bytes) 076000 1734017297.122377 trunc from 0x3c250a to 0x48dea8 (0xcb99f bytes) 077000 1734017300.526078 trunc from 0x386c83 to 0x3433f7 (0x4388b bytes) 078000 1734017303.549280 mapwrite 0x449669 thru 0x44d040 (0x39d8 bytes) 079000 1734017307.442862 mapwrite 0x4393d6 thru 0x443d66 (0xa991 bytes) 080000 1734017310.715808 read 0x09bdef thru 0x0a974a (0xd95c bytes) 081000 1734017313.915371 punch from 0x14f458 to 0x15d6bf (0xe268 bytes) 082000 1734017316.910685 write 0x4d16fb thru 0x4d5b4d (0x4453 bytes) 083000 1734017319.741543 read 0x4920d3 thru 0x499075 (0x6fa3 bytes) 084000 1734017322.610529 read 0x1283b5 thru 0x1301dc (0x7e28 bytes) 085000 1734017325.467394 read 0x310068 thru 0x311935 (0x18ce bytes) 086000 1734017328.418146 fallocate 0x11c0f8 thru 0x11d706 (0x160f bytes) 087000 1734017331.031187 fallocate 0x39a84b thru 0x39a8fc (0xb2 bytes) 088000 1734017333.972842 mapread 0x083fae thru 0x0939f2 (0xfa45 bytes) 090000 1734017339.243241 fallocate 0x33d7a8 thru 0x349e80 (0xc6d9 bytes) 091000 1734017341.899102 trunc from 0x0c1a07 to 0x0fd42f (0x3ba29 bytes) 092000 1734017344.318765 trunc from 0x45cef6 to 0x51d094 (0xc019f bytes) 093000 1734017346.825296 mapread 0x2a2911 thru 0x2a61b7 (0x38a7 bytes) skipping zero size write 094000 1734017349.503174 write 0x21416c thru 0x21fa07 (0xb89c bytes) 095000 1734017352.050130 punch from 0x2968a4 to 0x29ad7f (0x44dc bytes) 096000 1734017354.414768 write 0x2bfcf2 thru 0x2c92a3 (0x95b2 bytes) 097000 1734017357.088838 write 0x2a609e thru 0x2b5c8d (0xfbf0 bytes) 098000 1734017359.694750 punch from 0x49150f to 0x491915 (0x407 bytes) 099000 1734017362.033699 read 0x3e699f thru 0x3e9747 (0x2da9 bytes) 100000 1734017364.298604 write 0x127b60 thru 0x12dd2e (0x61cf bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 2837976 (2772 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 3805184.. 3805187: 4: 0001: net 1: 12.. 67: 3801660.. 3801715: 56: 0001: unwritten,net 2: 68.. 79: 3805316.. 3805327: 12: 0001: net 3: 116.. 159: 3801344.. 3801387: 44: 0001: unwritten,net 4: 160.. 183: 3801456.. 3801479: 24: 0001: net 5: 184.. 195: 3807460.. 3807471: 12: 0001: net 6: 196.. 203: 3807324.. 3807331: 8: 0001: net 7: 204.. 207: 3807472.. 3807475: 4: 0001: net 8: 220.. 243: 3807364.. 3807387: 24: 0001: net 9: 252.. 283: 3803152.. 3803183: 32: 0001: net 10: 284.. 339: 3805328.. 3805383: 56: 0001: net 11: 500.. 563: 3807476.. 3807539: 64: 0001: net 12: 580.. 599: 3805624.. 3805643: 20: 0001: net 13: 684.. 711: 3805468.. 3805495: 28: 0001: net 14: 744.. 807: 3807816.. 3807879: 64: 0001: unwritten,net 15: 812.. 847: 3801536.. 3801571: 36: 0001: unwritten,net 16: 1280.. 1295: 3801764.. 3801779: 16: 0001: unwritten,net 17: 1296.. 1323: 3801780.. 3801807: 28: 0001: net 18: 1324.. 1339: 3801808.. 3801823: 16: 0001: unwritten,net 19: 1480.. 1519: 3801572.. 3801611: 40: 0001: net 20: 1544.. 1571: 3814320.. 3814347: 28: 0001: net 21: 1600.. 1659: 3814508.. 3814567: 60: 0001: unwritten,net 22: 1704.. 1751: 3814612.. 3814659: 48: 0001: net 23: 1792.. 1839: 3807540.. 3807587: 48: 0001: net 24: 1992.. 2011: 3801240.. 3801259: 20: 0001: net 25: 2012.. 2039: 3801408.. 3801435: 28: 0001: unwritten,net 26: 2676.. 2683: 3807880.. 3807887: 8: 0001: unwritten,net 27: 2756.. 2771: 3801716.. 3801731: 16: 0001: last,net,eof /mnt/lustre/f0.fsxfile: 25 extents found debug=0x33f0484 PASS fsx (303s) == sanity-benchmark test complete, duration 1538 sec ===== 10:29:25 (1734017365) === sanity-benchmark: start cleanup 10:29:25 (1734017365) === === sanity-benchmark: finish cleanup 10:29:26 (1734017366) ===