-----============= acceptance-small: sanity-benchmark ============----- Tue Nov 5 05:16:53 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 05:17:02 (1730801822) === oleg157-client.virtnet: executing check_config_client /mnt/lustre oleg157-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg157-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6ced800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6ced800.idle_timeout=debug disable quota as required oleg157-server: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 05:17:18 (1730801838) === == sanity-benchmark test dbench: dbench ================== 05:17:19 (1730801839) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7591] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg157-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg157-client.virtnet at Tue Nov 5 05:17:21 EST 2024 waiting for dbench pid 10283 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 10 37 28.57 MB/sec warmup 1 sec latency 136.103 ms 20 165 68.41 MB/sec warmup 2 sec latency 125.477 ms 20 284 70.48 MB/sec warmup 3 sec latency 82.625 ms 20 410 72.65 MB/sec warmup 4 sec latency 70.143 ms 20 536 73.77 MB/sec warmup 5 sec latency 79.484 ms 20 691 70.64 MB/sec warmup 6 sec latency 97.206 ms 20 792 61.20 MB/sec warmup 7 sec latency 57.806 ms 20 881 54.14 MB/sec warmup 8 sec latency 67.133 ms 20 942 48.43 MB/sec warmup 9 sec latency 73.215 ms 20 1040 45.24 MB/sec warmup 10 sec latency 85.892 ms 20 1140 41.79 MB/sec warmup 11 sec latency 95.564 ms 20 1230 38.50 MB/sec warmup 12 sec latency 63.350 ms 20 1403 39.79 MB/sec warmup 13 sec latency 66.965 ms 20 1479 37.19 MB/sec warmup 14 sec latency 85.317 ms 20 1560 34.81 MB/sec warmup 15 sec latency 70.535 ms 20 1648 32.73 MB/sec warmup 16 sec latency 70.731 ms 20 1771 30.92 MB/sec warmup 17 sec latency 71.483 ms 20 1855 29.28 MB/sec warmup 18 sec latency 76.481 ms 20 1949 27.83 MB/sec warmup 19 sec latency 80.646 ms 20 2033 26.55 MB/sec warmup 20 sec latency 68.724 ms 20 2147 25.42 MB/sec warmup 21 sec latency 67.806 ms 20 2265 24.76 MB/sec warmup 22 sec latency 63.106 ms 20 2390 24.32 MB/sec warmup 23 sec latency 72.304 ms 20 2616 18.98 MB/sec execute 1 sec latency 78.129 ms 20 2864 41.25 MB/sec execute 2 sec latency 77.029 ms 20 3001 33.44 MB/sec execute 3 sec latency 249.434 ms 20 3259 32.12 MB/sec execute 4 sec latency 71.608 ms 20 3491 36.63 MB/sec execute 5 sec latency 67.148 ms 20 3653 33.87 MB/sec execute 6 sec latency 51.818 ms 20 3775 31.77 MB/sec execute 7 sec latency 68.868 ms 20 3837 28.15 MB/sec execute 8 sec latency 82.750 ms 20 3904 25.49 MB/sec execute 9 sec latency 77.514 ms 20 3968 23.10 MB/sec execute 10 sec latency 94.139 ms 20 4054 21.01 MB/sec execute 11 sec latency 60.217 ms 20 4160 19.33 MB/sec execute 12 sec latency 89.316 ms 20 4242 18.09 MB/sec execute 13 sec latency 113.522 ms 20 4332 17.09 MB/sec execute 14 sec latency 107.853 ms 20 4421 16.24 MB/sec execute 15 sec latency 69.880 ms 20 4498 15.47 MB/sec execute 16 sec latency 78.524 ms 20 4579 15.12 MB/sec execute 17 sec latency 98.961 ms 20 4693 15.09 MB/sec execute 18 sec latency 76.456 ms 20 4788 14.54 MB/sec execute 19 sec latency 55.742 ms 20 4921 15.74 MB/sec execute 20 sec latency 81.521 ms 20 5038 15.84 MB/sec execute 21 sec latency 103.469 ms 20 5143 15.21 MB/sec execute 22 sec latency 49.917 ms 20 5235 14.62 MB/sec execute 23 sec latency 78.720 ms 20 5325 14.07 MB/sec execute 24 sec latency 60.687 ms 20 5412 13.56 MB/sec execute 25 sec latency 56.803 ms 20 5536 13.13 MB/sec execute 26 sec latency 54.274 ms 20 5647 12.77 MB/sec execute 27 sec latency 65.479 ms 20 5764 12.44 MB/sec execute 28 sec latency 53.982 ms 20 5914 12.73 MB/sec execute 29 sec latency 53.433 ms 20 5988 12.48 MB/sec execute 30 sec latency 91.722 ms 20 6112 12.64 MB/sec execute 31 sec latency 92.187 ms 20 6372 14.16 MB/sec execute 32 sec latency 60.561 ms 20 6549 14.59 MB/sec execute 33 sec latency 59.649 ms 20 6862 15.19 MB/sec execute 34 sec latency 61.763 ms 20 7093 16.49 MB/sec execute 35 sec latency 55.436 ms 20 7254 16.41 MB/sec execute 36 sec latency 43.463 ms 20 7395 16.42 MB/sec execute 37 sec latency 47.421 ms 20 7505 16.13 MB/sec execute 38 sec latency 57.081 ms 20 7619 15.73 MB/sec execute 39 sec latency 67.922 ms 20 7768 15.42 MB/sec execute 40 sec latency 86.268 ms 20 7894 15.18 MB/sec execute 41 sec latency 63.369 ms 20 8016 14.97 MB/sec execute 42 sec latency 54.983 ms 20 8164 15.09 MB/sec execute 43 sec latency 48.413 ms 20 8311 14.89 MB/sec execute 44 sec latency 50.752 ms 20 8507 15.69 MB/sec execute 45 sec latency 50.669 ms 20 8652 15.57 MB/sec execute 46 sec latency 47.868 ms 20 8751 15.28 MB/sec execute 47 sec latency 61.828 ms 20 8872 15.00 MB/sec execute 48 sec latency 56.951 ms 20 9017 14.75 MB/sec execute 49 sec latency 43.653 ms 20 9179 14.53 MB/sec execute 50 sec latency 42.249 ms 20 9352 14.44 MB/sec execute 51 sec latency 47.552 ms 20 9500 14.49 MB/sec execute 52 sec latency 53.226 ms 20 9649 14.54 MB/sec execute 53 sec latency 58.168 ms 20 9923 15.47 MB/sec execute 54 sec latency 76.489 ms 20 10173 15.81 MB/sec execute 55 sec latency 60.808 ms 20 10434 16.10 MB/sec execute 56 sec latency 55.446 ms 20 10643 16.79 MB/sec execute 57 sec latency 61.879 ms 20 10750 16.68 MB/sec execute 58 sec latency 71.591 ms 20 10842 16.66 MB/sec execute 59 sec latency 81.044 ms 20 10918 16.47 MB/sec execute 60 sec latency 88.810 ms 20 10992 16.29 MB/sec execute 61 sec latency 79.018 ms 20 11069 16.05 MB/sec execute 62 sec latency 80.380 ms 20 11157 15.80 MB/sec execute 63 sec latency 58.962 ms 20 11291 15.60 MB/sec execute 64 sec latency 70.454 ms 20 11413 15.43 MB/sec execute 65 sec latency 61.892 ms 20 11535 15.29 MB/sec execute 66 sec latency 48.572 ms 20 11648 15.23 MB/sec execute 67 sec latency 51.777 ms 20 11786 15.22 MB/sec execute 68 sec latency 124.504 ms 20 11964 15.41 MB/sec execute 69 sec latency 44.046 ms 20 12120 15.63 MB/sec execute 70 sec latency 69.900 ms 20 12240 15.48 MB/sec execute 71 sec latency 46.904 ms 20 12365 15.30 MB/sec execute 72 sec latency 50.554 ms 20 12484 15.11 MB/sec execute 73 sec latency 52.174 ms 20 12642 14.95 MB/sec execute 74 sec latency 45.791 ms 20 12804 14.81 MB/sec execute 75 sec latency 41.184 ms 20 12975 14.86 MB/sec execute 76 sec latency 51.172 ms 20 13111 14.87 MB/sec execute 77 sec latency 57.203 ms 20 13348 15.28 MB/sec execute 78 sec latency 71.877 ms 20 13602 15.70 MB/sec execute 79 sec latency 52.723 ms 20 13907 15.92 MB/sec execute 80 sec latency 55.112 ms 20 14149 16.44 MB/sec execute 81 sec latency 49.250 ms 20 14293 16.46 MB/sec execute 82 sec latency 62.015 ms 20 14420 16.49 MB/sec execute 83 sec latency 50.435 ms 20 14525 16.37 MB/sec execute 84 sec latency 55.022 ms 20 14627 16.20 MB/sec execute 85 sec latency 55.235 ms 20 14717 16.02 MB/sec execute 86 sec latency 95.198 ms 20 14843 15.87 MB/sec execute 87 sec latency 82.946 ms 20 14954 15.74 MB/sec execute 88 sec latency 76.365 ms 20 15061 15.63 MB/sec execute 89 sec latency 63.369 ms 20 15154 15.51 MB/sec execute 90 sec latency 58.795 ms 20 15278 15.54 MB/sec execute 91 sec latency 64.120 ms 20 15404 15.43 MB/sec execute 92 sec latency 62.844 ms 20 15601 15.81 MB/sec execute 93 sec latency 46.501 ms 20 15716 15.75 MB/sec execute 94 sec latency 74.990 ms 20 15809 15.60 MB/sec execute 95 sec latency 55.627 ms 20 15910 15.45 MB/sec execute 96 sec latency 61.715 ms 20 15994 15.31 MB/sec execute 97 sec latency 61.345 ms 20 16065 15.17 MB/sec execute 98 sec latency 117.508 ms 20 16172 15.03 MB/sec execute 99 sec latency 68.943 ms 20 16268 14.91 MB/sec execute 100 sec latency 71.955 ms 20 16375 14.80 MB/sec execute 101 sec latency 59.943 ms 20 16513 14.82 MB/sec execute 102 sec latency 58.806 ms 20 16623 14.79 MB/sec execute 103 sec latency 64.794 ms 20 16734 14.78 MB/sec execute 104 sec latency 94.213 ms 20 16942 15.09 MB/sec execute 105 sec latency 69.553 ms 20 17166 15.32 MB/sec execute 106 sec latency 53.638 ms 20 17419 15.46 MB/sec execute 107 sec latency 85.440 ms 20 17591 15.62 MB/sec execute 108 sec latency 70.635 ms 20 17755 15.80 MB/sec execute 109 sec latency 61.971 ms 20 17854 15.76 MB/sec execute 110 sec latency 72.084 ms 20 17938 15.74 MB/sec execute 111 sec latency 89.222 ms 20 18008 15.65 MB/sec execute 112 sec latency 76.928 ms 20 18084 15.56 MB/sec execute 113 sec latency 86.907 ms 20 18147 15.44 MB/sec execute 114 sec latency 107.109 ms 20 18232 15.31 MB/sec execute 115 sec latency 63.706 ms 20 18335 15.18 MB/sec execute 116 sec latency 97.280 ms 20 18419 15.08 MB/sec execute 117 sec latency 104.081 ms 20 18525 14.99 MB/sec execute 118 sec latency 80.697 ms 20 18623 14.91 MB/sec execute 119 sec latency 82.539 ms 20 cleanup 120 sec 15 cleanup 121 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 55766 24.664 113.514 Close 40292 5.914 43.269 Rename 2386 35.505 117.497 Unlink 11849 7.869 44.280 Qpathinfo 50108 5.902 74.973 Qfileinfo 8634 0.122 10.586 Qfsinfo 9729 0.072 13.784 Sfileinfo 4412 24.936 108.695 Find 19742 1.051 68.980 WriteX 27433 2.807 47.393 ReadX 90111 0.024 10.050 LockX 200 6.434 22.827 UnlockX 200 5.863 18.568 Flush 4078 23.542 249.428 Throughput 14.9054 MB/sec 20 clients 20 procs max_latency=249.434 ms stopping dbench on /mnt/lustre/d0.oleg157-client.virtnet at Tue Nov 5 05:19:46 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg157-client.virtnet /mnt/lustre/d0.oleg157-client.virtnet /mnt/lustre/d0.oleg157-client.virtnet removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg157-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (153s) == sanity-benchmark test bonnie: bonnie++ ================ 05:19:52 (1730801992) min OST has 3535960kB available, using 5303940kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7591] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5179] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg157-clien 5179M 103283 74 80968 61 248728 46 2199 211 Latency 13766us 144ms 79560us 87330us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg157-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 188 17 3786 18 262 13 216 17 579 11 310 13 Latency 22732us 40757us 35614us 25027us 9466us 29881us 1.97,1.97,oleg157-client.virtnet,1,1730797027,5179M,,,,103283,74,80968,61,,,248728,46,2199,211,10,,,,,188,17,3786,18,262,13,216,17,579,11,310,13,,13766us,144ms,,79560us,87330us,22732us,40757us,35614us,25027us,9466us,29881us debug=0x33f0484 PASS bonnie (344s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 05:25:36 (1730802336) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 17387 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 17387 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x19633 skipping zero length punch hole fallocating to largest ever: 0x2faf96 fallocating to largest ever: 0x407f6a truncating to largest ever: 0x4ae610 truncating to largest ever: 0x503bbb fallocating to largest ever: 0x515576 fallocating to largest ever: 0x51d6fd fallocating to largest ever: 0x523713 fallocating to largest ever: 0x5285e2 002000 1730802345.228529 punch from 0x1c332d to 0x1c6365 (0x3039 bytes) 003000 1730802349.690147 punch from 0x025191 to 0x030ea9 (0xbd19 bytes) 005000 1730802357.629771 read 0x34faac thru 0x35dfca (0xe51f bytes) 006000 1730802361.621190 read 0x17818d thru 0x17a1ab (0x201f bytes) 007000 1730802365.356537 punch from 0x148c85 to 0x14d83c (0x4bb8 bytes) 008000 1730802368.949104 fallocate 0x376e48 thru 0x383b68 (0xcd21 bytes) 011000 1730802378.421883 mapwrite 0x1da572 thru 0x1e4611 (0xa0a0 bytes) 012000 1730802381.897407 fallocate 0x1cac40 thru 0x1d14ba (0x687b bytes) 013000 1730802384.965566 write 0x121fd5 thru 0x12cd77 (0xada3 bytes) 014000 1730802388.354085 trunc from 0x50c4b9 to 0x50ef42 (0x2a8a bytes) 016000 1730802397.251922 write 0x439f58 thru 0x43a02a (0xd3 bytes) 018000 1730802403.516870 read 0x174f93 thru 0x1780ec (0x315a bytes) 021000 1730802413.068283 read 0x1d5195 thru 0x1e26ac (0xd518 bytes) 022000 1730802416.277757 punch from 0x0616da to 0x068735 (0x705c bytes) 024000 1730802422.842836 trunc from 0x5126d5 to 0x0605a3 (0x4b2131 bytes) 025000 1730802426.005493 punch from 0x42a1ef to 0x42ad27 (0xb39 bytes) 026000 1730802428.790355 write 0x2957e0 thru 0x29bd77 (0x6598 bytes) 029000 1730802438.555882 punch from 0x0eb4ac to 0x0eb549 (0x9e bytes) 032000 1730802448.380293 read 0x05fb9a thru 0x064206 (0x466d bytes) 034000 1730802455.571820 mapwrite 0x3ef008 thru 0x3f9319 (0xa312 bytes) 035000 1730802458.965834 mapread 0x00c3d3 thru 0x010291 (0x3ebf bytes) 036000 1730802462.067701 punch from 0x149526 to 0x14e4b4 (0x4f8f bytes) 037000 1730802465.195923 punch from 0x389a6c to 0x38c8ff (0x2e94 bytes) 038000 1730802468.291560 write 0x4e2464 thru 0x4e91e4 (0x6d81 bytes) 039000 1730802471.595005 read 0x265b78 thru 0x26a50a (0x4993 bytes) 041000 1730802478.476811 mapread 0x1e6bb0 thru 0x1e9fb7 (0x3408 bytes) 044000 1730802488.942812 punch from 0x272f62 to 0x27790a (0x49a9 bytes) 045000 1730802493.430116 read 0x0f2ed9 thru 0x0fc6d0 (0x97f8 bytes) 046000 1730802497.166269 punch from 0x00ccc5 to 0x00ff65 (0x32a1 bytes) 048000 1730802503.097802 mapwrite 0x4434c1 thru 0x446f6b (0x3aab bytes) 049000 1730802506.178169 mapread 0x1562ad thru 0x157438 (0x118c bytes) 050000 1730802508.744421 trunc from 0x3f0e02 to 0x327f37 (0xc8eca bytes) 051000 1730802511.815830 fallocate 0x1b9442 thru 0x1c2b70 (0x972f bytes) 052000 1730802514.232250 mapread 0x0dfc4a thru 0x0e7cb6 (0x806d bytes) 053000 1730802517.080748 write 0x07f902 thru 0x08ebf0 (0xf2ef bytes) 055000 1730802523.350148 fallocate 0x49cb8f thru 0x4a527d (0x86ef bytes) 056000 1730802526.655645 read 0x0b2304 thru 0x0b4f35 (0x2c32 bytes) 058000 1730802534.359273 mapwrite 0x4d2c34 thru 0x4da37c (0x7749 bytes) 060000 1730802541.335496 fallocate 0x317dee thru 0x31d132 (0x5345 bytes) 061000 1730802544.314932 punch from 0x3a8975 to 0x3afca0 (0x732c bytes) 062000 1730802547.519721 read 0x165805 thru 0x16d309 (0x7b05 bytes) 063000 1730802549.885294 read 0x0c12d5 thru 0x0d02af (0xefdb bytes) 064000 1730802552.982339 read 0x018167 thru 0x01a451 (0x22eb bytes) 065000 1730802556.041195 read 0x02bb57 thru 0x0340e1 (0x858b bytes) 066000 1730802559.379148 fallocate 0x4e7b44 thru 0x4ec5b0 (0x4a6d bytes) 068000 1730802565.913812 trunc from 0x4c5220 to 0x3cc391 (0xf8e8e bytes) 070000 1730802571.780549 read 0x1b2f69 thru 0x1c1670 (0xe708 bytes) 071000 1730802575.019986 read 0x006bc0 thru 0x0138ab (0xccec bytes) 072000 1730802578.065197 mapwrite 0x32844d thru 0x32852c (0xe0 bytes) 073000 1730802581.541674 read 0x062dcb thru 0x070dda (0xe010 bytes) 074000 1730802584.870113 mapwrite 0x305868 thru 0x3069e6 (0x117f bytes) 075000 1730802588.251174 trunc from 0x14d24a to 0x20ed15 (0xc1acc bytes) 077000 1730802595.548985 trunc from 0x5285e2 to 0x154423 (0x3d41be bytes) 078000 1730802598.622357 fallocate 0x15adb8 thru 0x168c23 (0xde6c bytes) 080000 1730802604.067680 mapwrite 0x099506 thru 0x0a6643 (0xd13e bytes) 081000 1730802606.586485 fallocate 0x1411e7 thru 0x14b705 (0xa51f bytes) 082000 1730802610.357813 fallocate 0x15aa13 thru 0x15fa43 (0x5031 bytes) 087000 1730802626.137786 punch from 0x0f3ee6 to 0x0f670a (0x2825 bytes) 088000 1730802629.870069 mapwrite 0x09b650 thru 0x0a3342 (0x7cf3 bytes) 090000 1730802637.821986 fallocate 0x14bb41 thru 0x154297 (0x8757 bytes) 092000 1730802644.414414 punch from 0x3aefbd to 0x3b007b (0x10bf bytes) 094000 1730802650.351375 read 0x188e47 thru 0x193e97 (0xb051 bytes) 095000 1730802653.011320 fallocate 0x1efdf0 thru 0x1fbbed (0xbdfe bytes) 097000 1730802658.684859 fallocate 0x007809 thru 0x0172e5 (0xfadd bytes) 098000 1730802661.135519 trunc from 0x50b88c to 0x0b804a (0x453841 bytes) 100000 1730802666.108749 trunc from 0x518c1d to 0x386b74 (0x1920a8 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (331s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 05:31:07 (1730802667) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1730802671.378263 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1730802675.119844 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1730802678.644919 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1730802682.091158 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1730802688.918740 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1730802691.890472 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1730802695.127967 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1730802698.378027 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1730802701.616471 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1730802704.508464 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1730802707.603249 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1730802710.478296 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1730802713.240675 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1730802716.178043 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1730802719.128276 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1730802721.539555 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1730802724.315533 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1730802727.160647 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1730802729.883055 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1730802738.846573 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1730802742.030955 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1730802745.271402 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1730802748.540841 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1730802755.541499 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1730802762.719342 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1730802766.507459 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1730802770.057235 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1730802777.398074 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1730802780.735160 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1730802786.534436 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1730802790.098756 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1730802793.634247 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1730802797.059479 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1730802800.231602 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1730802805.193950 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1730802814.242162 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1730802823.565545 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1730802830.446445 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1730802833.794242 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1730802837.148516 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1730802845.590201 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1730802848.704261 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1730802851.644933 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1730802854.682518 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1730802857.812277 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1730802860.513889 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1730802863.598221 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1730802866.381912 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1730802869.307469 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1730802874.433956 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1730802878.059670 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1730802881.643000 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1730802885.179170 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1730802889.628171 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1730802898.169100 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1730802908.738191 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1730802916.453087 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1730802920.053658 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1730802923.707288 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1730802930.283930 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1730802933.881486 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1730802939.830728 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1730802942.696444 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1730802948.283493 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1730802954.031004 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1730802959.929237 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1730802962.818602 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1730802965.797581 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1730802968.915285 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1730802975.217389 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1730802978.061543 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1730802983.579737 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1730802986.601664 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (320s) == sanity-benchmark test complete, duration 1173 sec ===== 05:36:27 (1730802987) === sanity-benchmark: start cleanup 05:36:28 (1730802988) === === sanity-benchmark: finish cleanup 05:36:28 (1730802988) ===