-----============= acceptance-small: sanity-benchmark ============----- Sat Sep 14 04:50:01 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 04:50:07 (1726303807) === oleg137-client.virtnet: executing check_config_client /mnt/lustre oleg137-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg137-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b59a1000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b59a1000.idle_timeout=debug disable quota as required oleg137-server: oleg137-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 04:50:17 (1726303817) === == sanity-benchmark test dbench: dbench ================== 04:50:17 (1726303817) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6994] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg137-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg137-client.virtnet at Sat Sep 14 04:50:18 EDT 2024 waiting for dbench pid 9007 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 115 106.09 MB/sec warmup 1 sec latency 143.158 ms 20 228 88.03 MB/sec warmup 2 sec latency 93.009 ms 20 341 82.00 MB/sec warmup 3 sec latency 71.157 ms 20 488 85.23 MB/sec warmup 4 sec latency 65.650 ms 20 667 84.63 MB/sec warmup 5 sec latency 187.738 ms 20 733 71.03 MB/sec warmup 6 sec latency 148.163 ms 20 809 61.40 MB/sec warmup 7 sec latency 123.929 ms 20 915 54.32 MB/sec warmup 8 sec latency 138.585 ms 20 1002 49.11 MB/sec warmup 9 sec latency 149.941 ms 20 1125 45.93 MB/sec warmup 10 sec latency 120.642 ms 20 1238 42.21 MB/sec warmup 11 sec latency 74.496 ms 20 1410 43.34 MB/sec warmup 12 sec latency 159.159 ms 20 1502 40.07 MB/sec warmup 13 sec latency 195.770 ms 20 1603 37.35 MB/sec warmup 14 sec latency 153.577 ms 20 1692 34.96 MB/sec warmup 15 sec latency 133.112 ms 20 1811 32.90 MB/sec warmup 16 sec latency 140.926 ms 20 1939 31.10 MB/sec warmup 17 sec latency 92.188 ms 20 2071 29.56 MB/sec warmup 18 sec latency 62.703 ms 20 2196 28.29 MB/sec warmup 19 sec latency 136.928 ms 20 2348 27.88 MB/sec warmup 20 sec latency 133.305 ms 20 2456 26.99 MB/sec warmup 21 sec latency 150.811 ms 20 2598 26.95 MB/sec warmup 22 sec latency 199.733 ms 20 2844 28.28 MB/sec warmup 23 sec latency 149.937 ms 20 3305 26.70 MB/sec execute 1 sec latency 208.810 ms 20 3526 35.89 MB/sec execute 2 sec latency 140.082 ms 20 3710 34.62 MB/sec execute 3 sec latency 49.175 ms 20 3838 29.65 MB/sec execute 4 sec latency 50.895 ms 20 3946 24.55 MB/sec execute 5 sec latency 44.095 ms 20 4037 20.64 MB/sec execute 6 sec latency 71.627 ms 20 4111 17.80 MB/sec execute 7 sec latency 196.764 ms 20 4225 15.88 MB/sec execute 8 sec latency 148.836 ms 20 4296 14.51 MB/sec execute 9 sec latency 178.282 ms 20 4358 13.37 MB/sec execute 10 sec latency 177.089 ms 20 4429 12.46 MB/sec execute 11 sec latency 201.456 ms 20 4511 11.94 MB/sec execute 12 sec latency 177.405 ms 20 4615 11.91 MB/sec execute 13 sec latency 132.667 ms 20 4756 12.29 MB/sec execute 14 sec latency 135.516 ms 20 4894 13.02 MB/sec execute 15 sec latency 142.166 ms 20 5039 14.11 MB/sec execute 16 sec latency 159.808 ms 20 5161 13.40 MB/sec execute 17 sec latency 107.100 ms 20 5285 12.77 MB/sec execute 18 sec latency 82.507 ms 20 5408 12.20 MB/sec execute 19 sec latency 76.052 ms 20 5540 11.72 MB/sec execute 20 sec latency 57.294 ms 20 5691 11.39 MB/sec execute 21 sec latency 63.341 ms 20 5832 11.42 MB/sec execute 22 sec latency 123.341 ms 20 5971 11.63 MB/sec execute 23 sec latency 145.426 ms 20 6161 12.47 MB/sec execute 24 sec latency 100.112 ms 20 6453 14.59 MB/sec execute 25 sec latency 136.422 ms 20 6739 15.19 MB/sec execute 26 sec latency 125.285 ms 20 7050 16.77 MB/sec execute 27 sec latency 112.846 ms 20 7252 17.33 MB/sec execute 28 sec latency 51.816 ms 20 7387 17.27 MB/sec execute 29 sec latency 40.649 ms 20 7505 16.86 MB/sec execute 30 sec latency 38.039 ms 20 7616 16.34 MB/sec execute 31 sec latency 66.628 ms 20 7691 15.87 MB/sec execute 32 sec latency 206.318 ms 20 7796 15.48 MB/sec execute 33 sec latency 178.071 ms 20 7875 15.14 MB/sec execute 34 sec latency 149.943 ms 20 7955 14.81 MB/sec execute 35 sec latency 178.804 ms 20 8058 14.60 MB/sec execute 36 sec latency 126.138 ms 20 8174 14.54 MB/sec execute 37 sec latency 127.345 ms 20 8318 14.64 MB/sec execute 38 sec latency 114.662 ms 20 8461 14.91 MB/sec execute 39 sec latency 129.724 ms 20 8599 15.21 MB/sec execute 40 sec latency 91.364 ms 20 8688 14.87 MB/sec execute 41 sec latency 132.263 ms 20 8774 14.55 MB/sec execute 42 sec latency 100.422 ms 20 8877 14.25 MB/sec execute 43 sec latency 88.386 ms 20 8989 13.97 MB/sec execute 44 sec latency 74.540 ms 20 9096 13.71 MB/sec execute 45 sec latency 150.729 ms 20 9247 13.54 MB/sec execute 46 sec latency 113.350 ms 20 9411 13.57 MB/sec execute 47 sec latency 128.845 ms 20 9554 13.66 MB/sec execute 48 sec latency 136.430 ms 20 9759 14.18 MB/sec execute 49 sec latency 124.247 ms 20 10011 14.89 MB/sec execute 50 sec latency 192.742 ms 20 10257 15.22 MB/sec execute 51 sec latency 132.704 ms 20 10503 15.70 MB/sec execute 52 sec latency 119.400 ms 20 10678 16.00 MB/sec execute 53 sec latency 90.417 ms 20 10828 16.15 MB/sec execute 54 sec latency 45.890 ms 20 10961 16.09 MB/sec execute 55 sec latency 43.600 ms 20 11098 15.86 MB/sec execute 56 sec latency 36.541 ms 20 11250 15.62 MB/sec execute 57 sec latency 122.077 ms 20 11385 15.44 MB/sec execute 58 sec latency 113.257 ms 20 11479 15.25 MB/sec execute 59 sec latency 116.180 ms 20 11604 15.13 MB/sec execute 60 sec latency 116.157 ms 20 11792 15.23 MB/sec execute 61 sec latency 85.263 ms 20 11981 15.44 MB/sec execute 62 sec latency 96.028 ms 20 12164 15.73 MB/sec execute 63 sec latency 75.853 ms 20 12304 15.52 MB/sec execute 64 sec latency 78.376 ms 20 12414 15.31 MB/sec execute 65 sec latency 87.234 ms 20 12527 15.11 MB/sec execute 66 sec latency 74.279 ms 20 12635 14.92 MB/sec execute 67 sec latency 77.142 ms 20 12781 14.79 MB/sec execute 68 sec latency 102.808 ms 20 12937 14.75 MB/sec execute 69 sec latency 116.162 ms 20 13075 14.77 MB/sec execute 70 sec latency 102.812 ms 20 13260 14.98 MB/sec execute 71 sec latency 135.667 ms 20 13505 15.42 MB/sec execute 72 sec latency 140.233 ms 20 13772 15.81 MB/sec execute 73 sec latency 111.949 ms 20 14015 16.13 MB/sec execute 74 sec latency 119.541 ms 20 14197 16.32 MB/sec execute 75 sec latency 159.015 ms 20 14350 16.47 MB/sec execute 76 sec latency 79.685 ms 20 14476 16.39 MB/sec execute 77 sec latency 40.734 ms 20 14608 16.27 MB/sec execute 78 sec latency 38.647 ms 20 14726 16.10 MB/sec execute 79 sec latency 197.441 ms 20 14873 15.94 MB/sec execute 80 sec latency 112.348 ms 20 14995 15.81 MB/sec execute 81 sec latency 150.484 ms 20 15125 15.71 MB/sec execute 82 sec latency 106.509 ms 20 15256 15.68 MB/sec execute 83 sec latency 111.473 ms 20 15434 15.77 MB/sec execute 84 sec latency 97.851 ms 20 15614 16.01 MB/sec execute 85 sec latency 89.781 ms 20 15758 15.98 MB/sec execute 86 sec latency 99.631 ms 20 15880 15.82 MB/sec execute 87 sec latency 81.730 ms 20 16009 15.66 MB/sec execute 88 sec latency 91.787 ms 20 16139 15.51 MB/sec execute 89 sec latency 60.424 ms 20 16339 15.43 MB/sec execute 90 sec latency 58.490 ms 20 16550 15.47 MB/sec execute 91 sec latency 87.154 ms 20 16715 15.56 MB/sec execute 92 sec latency 117.775 ms 20 16926 15.78 MB/sec execute 93 sec latency 118.790 ms 20 17197 16.21 MB/sec execute 94 sec latency 128.875 ms 20 17494 16.44 MB/sec execute 95 sec latency 111.575 ms 20 17763 16.81 MB/sec execute 96 sec latency 74.685 ms 20 17935 16.87 MB/sec execute 97 sec latency 70.909 ms 20 18080 16.84 MB/sec execute 98 sec latency 39.970 ms 20 18225 16.70 MB/sec execute 99 sec latency 137.929 ms 20 18362 16.56 MB/sec execute 100 sec latency 121.001 ms 20 18483 16.43 MB/sec execute 101 sec latency 143.010 ms 20 18581 16.32 MB/sec execute 102 sec latency 153.506 ms 20 18709 16.26 MB/sec execute 103 sec latency 115.080 ms 20 18879 16.30 MB/sec execute 104 sec latency 101.220 ms 20 19081 16.40 MB/sec execute 105 sec latency 75.904 ms 20 19272 16.56 MB/sec execute 106 sec latency 130.014 ms 20 19394 16.43 MB/sec execute 107 sec latency 93.568 ms 20 19521 16.30 MB/sec execute 108 sec latency 74.616 ms 20 19648 16.17 MB/sec execute 109 sec latency 61.402 ms 20 19814 16.06 MB/sec execute 110 sec latency 69.163 ms 20 19985 16.00 MB/sec execute 111 sec latency 85.587 ms 20 20186 16.07 MB/sec execute 112 sec latency 85.765 ms 20 20409 16.23 MB/sec execute 113 sec latency 113.032 ms 20 20728 16.57 MB/sec execute 114 sec latency 113.126 ms 20 21042 16.91 MB/sec execute 115 sec latency 118.924 ms 20 21409 17.28 MB/sec execute 116 sec latency 83.100 ms 20 21660 17.38 MB/sec execute 117 sec latency 22.063 ms 20 21828 17.26 MB/sec execute 118 sec latency 136.839 ms 20 21983 17.15 MB/sec execute 119 sec latency 91.602 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 66469 19.649 92.168 Close 48168 3.945 26.130 Rename 2745 28.097 90.868 Unlink 14021 5.644 30.333 Qpathinfo 59600 4.680 65.652 Qfileinfo 10053 0.120 12.737 Qfsinfo 11316 0.044 11.379 Sfileinfo 5136 17.077 55.569 Find 23344 0.737 53.774 WriteX 32079 1.399 30.125 ReadX 102817 0.018 3.826 LockX 200 5.681 14.550 UnlockX 200 5.185 13.266 Flush 4666 66.680 208.802 Throughput 17.1477 MB/sec 20 clients 20 procs max_latency=208.810 ms stopping dbench on /mnt/lustre/d0.oleg137-client.virtnet at Sat Sep 14 04:52:43 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg137-client.virtnet /mnt/lustre/d0.oleg137-client.virtnet /mnt/lustre/d0.oleg137-client.virtnet removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg137-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (150s) == sanity-benchmark test bonnie: bonnie++ ================ 04:52:47 (1726303967) min OST has 3332096kB available, using 4998144kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6994] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4881] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg137-clien 4881M 143059 93 115091 78 307439 54 1598 149 Latency 8597us 38663us 46600us 309ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg137-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 231 18 4426 21 321 14 246 19 819 12 398 14 Latency 21005us 35221us 68616us 18995us 6641us 17750us 1.97,1.97,oleg137-client.virtnet,1,1726310807,4881M,,,,143059,93,115091,78,,,307439,54,1598,149,10,,,,,231,18,4426,21,321,14,246,19,819,12,398,14,,8597us,38663us,,46600us,309ms,21005us,35221us,68616us,18995us,6641us,17750us debug=0x33f0484 PASS bonnie (265s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 04:57:12 (1726304232) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 21082 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 21082 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1acf87 truncating to largest ever: 0x4409fd truncating to largest ever: 0x466355 truncating to largest ever: 0x50ba4b truncating to largest ever: 0x54edd0 truncating to largest ever: 0x55b882 003000 1726304246.838715 trunc from 0x389e87 to 0x37d801 (0xc685 bytes) truncating to largest ever: 0x55f902 truncating to largest ever: 0x562919 004000 1726304251.595339 mapread 0x25f4aa thru 0x26ba65 (0xc5bc bytes) 005000 1726304255.342024 read 0x09b69f thru 0x0ab349 (0xfcab bytes) 007000 1726304264.171486 trunc from 0x436464 to 0x30905a (0x12d409 bytes) 008000 1726304269.255300 read 0x017f04 thru 0x023a29 (0xbb26 bytes) 011000 1726304282.275613 mapread 0x3712f0 thru 0x37a5c0 (0x92d1 bytes) 012000 1726304286.361017 write 0x26b079 thru 0x279c93 (0xec1b bytes) 014000 1726304293.198694 mapwrite 0x07ad27 thru 0x085d02 (0xafdc bytes) 015000 1726304296.752704 write 0x0aa2f5 thru 0x0b4e49 (0xab55 bytes) 016000 1726304300.418076 mapread 0x3f1a9b thru 0x3f7255 (0x57bb bytes) 019000 1726304311.764260 trunc from 0x4a633b to 0x1e5a8d (0x2c08ad bytes) 020000 1726304315.358846 trunc from 0x432c67 to 0x31f0e0 (0x113b86 bytes) 021000 1726304319.073346 mapwrite 0x18fe37 thru 0x19a597 (0xa761 bytes) 022000 1726304322.552426 trunc from 0x561920 to 0x456e93 (0x10aa8c bytes) 024000 1726304330.339316 read 0x2023f9 thru 0x20ffbc (0xdbc4 bytes) 026000 1726304338.232275 trunc from 0x0c9368 to 0x17e8d6 (0xb556f bytes) 027000 1726304341.410381 trunc from 0x55b7e5 to 0x28ebbc (0x2ccc28 bytes) 029000 1726304348.308983 mapread 0x44a846 thru 0x459782 (0xef3d bytes) 030000 1726304352.230746 read 0x2cd2c9 thru 0x2cd765 (0x49d bytes) 033000 1726304364.671312 read 0x146410 thru 0x147b06 (0x16f7 bytes) 034000 1726304368.672639 mapread 0x1f5f34 thru 0x1fdeb8 (0x7f85 bytes) 037000 1726304378.933259 trunc from 0x4a950b to 0x294800 (0x214d0a bytes) 039000 1726304386.164676 write 0x0e6193 thru 0x0eb17c (0x4fea bytes) 040000 1726304390.095852 write 0x329718 thru 0x32cce6 (0x35cf bytes) 041000 1726304393.753973 mapwrite 0x026938 thru 0x036896 (0xff5f bytes) 042000 1726304397.046062 mapread 0x3675b3 thru 0x375bb0 (0xe5fe bytes) 044000 1726304404.007913 read 0x29b1cf thru 0x2a9554 (0xe386 bytes) 046000 1726304410.502136 read 0x01d334 thru 0x028b27 (0xb7f4 bytes) 048000 1726304416.340208 write 0x0c43f1 thru 0x0cadf4 (0x6a04 bytes) skipping zero size write truncating to largest ever: 0x562c06 049000 1726304419.687585 write 0x0564dd thru 0x0584b0 (0x1fd4 bytes) 051000 1726304425.532294 mapwrite 0x379bda thru 0x37c730 (0x2b57 bytes) 055000 1726304439.266175 trunc from 0x542f48 to 0x00587b (0x53d6cc bytes) 056000 1726304442.330053 trunc from 0x2914c4 to 0x0159aa (0x27bb19 bytes) 059000 1726304452.512939 mapwrite 0x1b49a2 thru 0x1bc472 (0x7ad1 bytes) 060000 1726304455.711993 write 0x1aef97 thru 0x1b17e3 (0x284d bytes) 065000 1726304470.873676 read 0x39fc4a thru 0x3aa76a (0xab21 bytes) 066000 1726304474.216825 trunc from 0x5574ac to 0x2debf1 (0x2788ba bytes) 067000 1726304477.352073 trunc from 0x3e792f to 0x32a6cc (0xbd262 bytes) 068000 1726304480.250808 mapwrite 0x209c83 thru 0x212d0d (0x908b bytes) 069000 1726304483.400417 trunc from 0x296af8 to 0x27a62f (0x1c4c8 bytes) 071000 1726304490.131957 write 0x4e7fde thru 0x4f2746 (0xa769 bytes) 072000 1726304492.840604 mapwrite 0x2e35bf thru 0x2f2840 (0xf282 bytes) 073000 1726304495.864783 mapwrite 0x46e986 thru 0x47726b (0x88e6 bytes) 075000 1726304503.183543 write 0x121ab4 thru 0x12bec3 (0xa410 bytes) 076000 1726304506.011842 mapwrite 0x43568f thru 0x4388f2 (0x3264 bytes) 077000 1726304509.334060 read 0x1ade52 thru 0x1b51cf (0x737e bytes) 078000 1726304512.155390 write 0x2a2e51 thru 0x2a3f64 (0x1114 bytes) 080000 1726304517.239189 mapwrite 0x020a68 thru 0x02f904 (0xee9d bytes) 083000 1726304524.761215 read 0x087d1f thru 0x096cf2 (0xefd4 bytes) 084000 1726304527.367028 write 0x1cbebe thru 0x1d75e1 (0xb724 bytes) 085000 1726304529.722517 trunc from 0x2fb8a8 to 0x3e0534 (0xe4c8d bytes) 086000 1726304532.396845 mapread 0x07c692 thru 0x087a26 (0xb395 bytes) 089000 1726304542.445935 mapread 0x05840f thru 0x064e40 (0xca32 bytes) 092000 1726304551.904352 write 0x106d64 thru 0x109f13 (0x31b0 bytes) 093000 1726304554.881048 write 0x4b9385 thru 0x4b99e9 (0x665 bytes) 094000 1726304557.991136 trunc from 0x09ed30 to 0x2e47f3 (0x245ac4 bytes) 096000 1726304563.705770 read 0x299ddb thru 0x29c7b1 (0x29d7 bytes) 097000 1726304566.689227 read 0x03fc81 thru 0x04bb79 (0xbef9 bytes) 098000 1726304569.463661 trunc from 0x4e5f72 to 0x1606b1 (0x3858c0 bytes) 099000 1726304572.496840 mapwrite 0x3dbebb thru 0x3e8ad6 (0xcc1c bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (344s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 05:02:56 (1726304576) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1726304587.961059 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1726304595.766413 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1726304599.439196 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1726304613.004671 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1726304616.026622 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1726304629.505222 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1726304633.056845 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1726304639.844947 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1726304647.296411 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1726304650.575185 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1726304657.037029 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1726304660.496870 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1726304673.567701 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1726304679.284283 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1726304688.603937 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1726304698.883930 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1726304702.148397 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1726304715.720586 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1726304719.031750 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1726304728.093848 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1726304730.786653 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1726304733.870688 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1726304742.218950 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1726304747.553890 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1726304752.935365 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1726304756.212560 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1726304785.929235 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1726304795.349424 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1726304799.107352 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1726304802.113025 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1726304805.284928 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1726304814.395038 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1726304817.166937 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1726304827.268709 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1726304830.936177 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1726304839.654400 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1726304848.863158 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1726304852.225508 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1726304861.144517 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1726304877.359080 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1726304880.191239 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1726304886.195730 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1726304892.467044 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (320s) == sanity-benchmark test complete, duration 1095 sec ===== 05:08:16 (1726304896) === sanity-benchmark: start cleanup 05:08:16 (1726304896) === === sanity-benchmark: finish cleanup 05:08:16 (1726304896) ===