-----============= acceptance-small: sanity-benchmark ============----- Sun Aug 4 14:09:59 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 14:10:03 (1722795003) === oleg338-client.virtnet: executing check_config_client /mnt/lustre oleg338-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg338-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6ffd800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6ffd800.idle_timeout=debug disable quota as required oleg338-server: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 14:10:10 (1722795010) === == sanity-benchmark test dbench: dbench ================== 14:10:10 (1722795010) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7553] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg338-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg338-client.virtnet at Sun Aug 4 14:10:11 EDT 2024 waiting for dbench pid 9751 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 265 199.80 MB/sec warmup 1 sec latency 49.337 ms 20 565 193.52 MB/sec warmup 2 sec latency 37.205 ms 20 869 144.10 MB/sec warmup 3 sec latency 39.015 ms 20 1150 114.97 MB/sec warmup 4 sec latency 32.676 ms 20 1512 104.24 MB/sec warmup 5 sec latency 28.965 ms 20 1855 87.84 MB/sec warmup 6 sec latency 26.213 ms 20 2214 76.61 MB/sec warmup 7 sec latency 22.637 ms 20 2465 71.13 MB/sec warmup 8 sec latency 335.049 ms 20 3089 75.27 MB/sec warmup 9 sec latency 27.736 ms 20 3685 77.59 MB/sec warmup 10 sec latency 28.777 ms 20 3966 72.83 MB/sec warmup 11 sec latency 23.471 ms 20 4245 67.09 MB/sec warmup 12 sec latency 43.375 ms 20 4508 62.99 MB/sec warmup 13 sec latency 39.320 ms 20 4861 61.55 MB/sec warmup 14 sec latency 24.518 ms 20 5202 60.39 MB/sec warmup 15 sec latency 24.626 ms 20 5496 56.93 MB/sec warmup 16 sec latency 25.112 ms 20 5837 54.64 MB/sec warmup 17 sec latency 24.717 ms 20 6239 55.23 MB/sec warmup 18 sec latency 23.475 ms 20 6930 58.02 MB/sec warmup 19 sec latency 34.611 ms 20 7342 58.75 MB/sec warmup 20 sec latency 22.436 ms 20 7614 56.37 MB/sec warmup 21 sec latency 19.856 ms 20 7853 54.13 MB/sec warmup 22 sec latency 50.091 ms 20 8101 52.49 MB/sec warmup 23 sec latency 26.013 ms 20 8748 22.06 MB/sec execute 1 sec latency 32.130 ms 20 9018 13.25 MB/sec execute 2 sec latency 22.826 ms 20 9343 13.40 MB/sec execute 3 sec latency 20.616 ms 20 9680 20.55 MB/sec execute 4 sec latency 23.879 ms 20 10326 38.46 MB/sec execute 5 sec latency 28.598 ms 20 10783 46.14 MB/sec execute 6 sec latency 23.296 ms 20 11042 42.70 MB/sec execute 7 sec latency 22.129 ms 20 11279 37.72 MB/sec execute 8 sec latency 42.088 ms 20 11480 34.52 MB/sec execute 9 sec latency 251.954 ms 20 11757 33.66 MB/sec execute 10 sec latency 30.524 ms 20 12113 36.22 MB/sec execute 11 sec latency 28.765 ms 20 12335 33.75 MB/sec execute 12 sec latency 35.257 ms 20 12532 31.41 MB/sec execute 13 sec latency 39.421 ms 20 12805 29.76 MB/sec execute 14 sec latency 56.215 ms 20 13131 30.03 MB/sec execute 15 sec latency 25.127 ms 20 13652 34.47 MB/sec execute 16 sec latency 43.348 ms 20 14256 38.24 MB/sec execute 17 sec latency 26.863 ms 20 14556 37.78 MB/sec execute 18 sec latency 25.191 ms 20 14808 36.00 MB/sec execute 19 sec latency 39.318 ms 20 15084 34.80 MB/sec execute 20 sec latency 35.744 ms 20 15388 34.57 MB/sec execute 21 sec latency 28.628 ms 20 15740 35.68 MB/sec execute 22 sec latency 30.418 ms 20 15989 34.31 MB/sec execute 23 sec latency 25.789 ms 20 16300 33.16 MB/sec execute 24 sec latency 22.622 ms 20 16650 33.22 MB/sec execute 25 sec latency 20.936 ms 20 17204 35.79 MB/sec execute 26 sec latency 31.006 ms 20 17768 38.01 MB/sec execute 27 sec latency 28.607 ms 20 18061 37.87 MB/sec execute 28 sec latency 22.496 ms 20 18318 36.74 MB/sec execute 29 sec latency 39.278 ms 20 18595 35.89 MB/sec execute 30 sec latency 34.586 ms 20 18904 35.71 MB/sec execute 31 sec latency 26.556 ms 20 19281 36.47 MB/sec execute 32 sec latency 27.177 ms 20 19572 35.52 MB/sec execute 33 sec latency 23.793 ms 20 19935 34.74 MB/sec execute 34 sec latency 19.369 ms 20 20330 35.03 MB/sec execute 35 sec latency 21.637 ms 20 20986 37.26 MB/sec execute 36 sec latency 23.400 ms 20 21515 38.72 MB/sec execute 37 sec latency 24.065 ms 20 21815 38.10 MB/sec execute 38 sec latency 19.644 ms 20 22086 37.33 MB/sec execute 39 sec latency 41.458 ms 20 22412 37.02 MB/sec execute 40 sec latency 26.063 ms 20 22828 37.74 MB/sec execute 41 sec latency 26.489 ms 20 23144 37.03 MB/sec execute 42 sec latency 24.542 ms 20 23519 36.47 MB/sec execute 43 sec latency 19.759 ms 20 23894 36.73 MB/sec execute 44 sec latency 32.801 ms 20 24515 38.30 MB/sec execute 45 sec latency 25.717 ms 20 25004 39.28 MB/sec execute 46 sec latency 24.297 ms 20 25273 38.93 MB/sec execute 47 sec latency 25.600 ms 20 25511 38.20 MB/sec execute 48 sec latency 40.833 ms 20 25777 37.66 MB/sec execute 49 sec latency 31.342 ms 20 26066 37.48 MB/sec execute 50 sec latency 29.812 ms 20 26402 37.85 MB/sec execute 51 sec latency 27.358 ms 20 26689 37.26 MB/sec execute 52 sec latency 22.846 ms 20 27048 36.77 MB/sec execute 53 sec latency 18.680 ms 20 27425 36.93 MB/sec execute 54 sec latency 27.651 ms 20 28028 38.18 MB/sec execute 55 sec latency 26.811 ms 20 28535 39.05 MB/sec execute 56 sec latency 31.017 ms 20 28833 38.81 MB/sec execute 57 sec latency 21.495 ms 20 29108 38.23 MB/sec execute 58 sec latency 38.534 ms 20 29377 37.85 MB/sec execute 59 sec latency 31.295 ms 20 29737 38.03 MB/sec execute 60 sec latency 26.715 ms 20 30059 37.99 MB/sec execute 61 sec latency 26.868 ms 20 30324 37.45 MB/sec execute 62 sec latency 25.757 ms 20 30640 37.08 MB/sec execute 63 sec latency 22.760 ms 20 31038 37.41 MB/sec execute 64 sec latency 23.119 ms 20 31642 38.32 MB/sec execute 65 sec latency 27.902 ms 20 32108 38.98 MB/sec execute 66 sec latency 27.398 ms 20 32366 38.72 MB/sec execute 67 sec latency 24.242 ms 20 32604 38.20 MB/sec execute 68 sec latency 46.729 ms 20 32884 37.84 MB/sec execute 69 sec latency 30.506 ms 20 33247 37.97 MB/sec execute 70 sec latency 22.351 ms 20 33586 38.02 MB/sec execute 71 sec latency 25.871 ms 20 33871 37.56 MB/sec execute 72 sec latency 22.599 ms 20 34246 37.30 MB/sec execute 73 sec latency 21.266 ms 20 34634 37.61 MB/sec execute 74 sec latency 56.588 ms 20 35269 38.49 MB/sec execute 75 sec latency 24.937 ms 20 35713 38.99 MB/sec execute 76 sec latency 20.738 ms 20 35972 38.67 MB/sec execute 77 sec latency 23.038 ms 20 36177 38.22 MB/sec execute 78 sec latency 61.946 ms 20 36414 37.89 MB/sec execute 79 sec latency 38.930 ms 20 36697 37.80 MB/sec execute 80 sec latency 26.061 ms 20 37067 38.03 MB/sec execute 81 sec latency 23.639 ms 20 37349 37.63 MB/sec execute 82 sec latency 23.996 ms 20 37686 37.31 MB/sec execute 83 sec latency 20.711 ms 20 38089 37.46 MB/sec execute 84 sec latency 21.167 ms 20 38677 38.24 MB/sec execute 85 sec latency 33.168 ms 20 39166 38.78 MB/sec execute 86 sec latency 22.197 ms 20 39456 38.60 MB/sec execute 87 sec latency 26.280 ms 20 39684 38.21 MB/sec execute 88 sec latency 41.025 ms 20 39957 37.93 MB/sec execute 89 sec latency 37.445 ms 20 40251 37.84 MB/sec execute 90 sec latency 34.088 ms 20 40583 38.02 MB/sec execute 91 sec latency 33.736 ms 20 40828 37.68 MB/sec execute 92 sec latency 32.524 ms 20 41138 37.36 MB/sec execute 93 sec latency 29.424 ms 20 41472 37.28 MB/sec execute 94 sec latency 22.648 ms 20 41956 37.83 MB/sec execute 95 sec latency 26.862 ms 20 42549 38.42 MB/sec execute 96 sec latency 28.446 ms 20 42860 38.48 MB/sec execute 97 sec latency 32.398 ms 20 43119 38.19 MB/sec execute 98 sec latency 42.655 ms 20 43395 37.90 MB/sec execute 99 sec latency 41.491 ms 20 43676 37.77 MB/sec execute 100 sec latency 29.694 ms 20 43997 37.86 MB/sec execute 101 sec latency 33.356 ms 20 44288 37.72 MB/sec execute 102 sec latency 23.431 ms 20 44562 37.40 MB/sec execute 103 sec latency 28.262 ms 20 44914 37.25 MB/sec execute 104 sec latency 22.497 ms 20 45372 37.63 MB/sec execute 105 sec latency 24.240 ms 20 46013 38.28 MB/sec execute 106 sec latency 27.479 ms 20 46414 38.45 MB/sec execute 107 sec latency 20.571 ms 20 46686 38.20 MB/sec execute 108 sec latency 43.781 ms 20 46985 37.95 MB/sec execute 109 sec latency 38.216 ms 20 47279 37.83 MB/sec execute 110 sec latency 30.317 ms 20 47673 38.06 MB/sec execute 111 sec latency 24.241 ms 20 47971 37.79 MB/sec execute 112 sec latency 23.374 ms 20 48320 37.56 MB/sec execute 113 sec latency 20.632 ms 20 48715 37.64 MB/sec execute 114 sec latency 21.555 ms 20 49344 38.27 MB/sec execute 115 sec latency 28.192 ms 20 49839 38.67 MB/sec execute 116 sec latency 26.064 ms 20 50138 38.52 MB/sec execute 117 sec latency 33.104 ms 20 50436 38.26 MB/sec execute 118 sec latency 35.061 ms 20 50747 38.15 MB/sec execute 119 sec latency 25.872 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 147740 9.405 61.940 Close 108517 2.041 16.253 Rename 6239 13.831 44.324 Unlink 29788 3.048 37.174 Qpathinfo 133790 2.284 32.308 Qfileinfo 23342 0.069 7.188 Qfsinfo 24487 0.028 4.553 Sfileinfo 12004 9.317 50.248 Find 51683 0.418 31.020 WriteX 72876 1.010 18.580 ReadX 231606 0.014 3.499 LockX 480 2.210 6.497 UnlockX 480 2.218 5.716 Flush 10329 8.284 251.948 Throughput 38.1471 MB/sec 20 clients 20 procs max_latency=251.954 ms stopping dbench on /mnt/lustre/d0.oleg338-client.virtnet at Sun Aug 4 14:12:35 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg338-client.virtnet /mnt/lustre/d0.oleg338-client.virtnet /mnt/lustre/d0.oleg338-client.virtnet removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg338-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (147s) == sanity-benchmark test bonnie: bonnie++ ================ 14:12:37 (1722795157) min OST has 3381008kB available, using 5071512kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7553] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4952] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg338-clien 4952M 161750 98 142645 93 398625 81 6441 287 Latency 5300us 30517us 37113us 6967us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg338-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 547 16 8876 33 736 12 474 17 1296 12 757 12 Latency 15192us 12698us 17151us 14034us 4713us 19358us 1.97,1.97,oleg338-client.virtnet,1,1722805977,4952M,,,,161750,98,142645,93,,,398625,81,6441,287,10,,,,,547,16,8876,33,736,12,474,17,1296,12,757,12,,5300us,30517us,,37113us,6967us,15192us,12698us,17151us,14034us,4713us,19358us debug=0x33f0484 PASS bonnie (164s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 14:15:22 (1722795322) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 1028 -P /tmp -l 5401746 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 1028 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole skipping zero size read fallocating to largest ever: 0x4fb477 fallocating to largest ever: 0x501bff truncating to largest ever: 0x517c6f 001000 1722795325.573413 trunc from 0x36d0f0 to 0x4f1977 (0x184888 bytes) truncating to largest ever: 0x522a09 truncating to largest ever: 0x52563e 002000 1722795327.708275 mapwrite 0x4439f1 thru 0x452b02 (0xf112 bytes) fallocating to largest ever: 0x526c92 003000 1722795329.771171 write 0x349e1f thru 0x350624 (0x6806 bytes) 004000 1722795331.872297 fallocate 0x0edf5a thru 0x0eefcc (0x1073 bytes) 005000 1722795333.935880 mapread 0x0bbedc thru 0x0c3e74 (0x7f99 bytes) 006000 1722795336.042923 punch from 0x217633 to 0x221413 (0x9de1 bytes) 008000 1722795340.149354 punch from 0x085db0 to 0x09279a (0xc9eb bytes) 009000 1722795342.178510 trunc from 0x32803c to 0x0fcc89 (0x22b3b2 bytes) skipping zero size write 010000 1722795344.207069 mapread 0x2532f2 thru 0x25fe9b (0xcbaa bytes) 012000 1722795348.066512 fallocate 0x208902 thru 0x20f1f6 (0x68f5 bytes) 013000 1722795350.178638 punch from 0x3b25d7 to 0x3c122c (0xec56 bytes) 014000 1722795352.185613 fallocate 0x51fa80 thru 0x526c91 (0x7212 bytes) 018000 1722795360.528979 mapread 0x3db95b thru 0x3e4540 (0x8be6 bytes) 019000 1722795362.613175 mapread 0x1088a3 thru 0x10e7c9 (0x5f27 bytes) 020000 1722795364.636989 read 0x33e5e4 thru 0x34c0d4 (0xdaf1 bytes) 021000 1722795366.692254 write 0x07f4eb thru 0x07ff7e (0xa94 bytes) 022000 1722795368.846455 mapwrite 0x36a865 thru 0x37661b (0xbdb7 bytes) 023000 1722795370.887125 mapread 0x114157 thru 0x11f9f8 (0xb8a2 bytes) 024000 1722795372.689258 punch from 0x1b4098 to 0x1be545 (0xa4ae bytes) 025000 1722795374.711923 fallocate 0x50295c thru 0x5061be (0x3863 bytes) 026000 1722795376.463801 fallocate 0x3f3064 thru 0x3ff10b (0xc0a8 bytes) 027000 1722795378.728790 punch from 0x1f6091 to 0x1fe7bc (0x872c bytes) 028000 1722795380.912470 mapwrite 0x27f2cc thru 0x28ea14 (0xf749 bytes) 030000 1722795384.703887 write 0x30a49e thru 0x31271b (0x827e bytes) 031000 1722795387.019029 mapwrite 0x3933c8 thru 0x3a10ce (0xdd07 bytes) 032000 1722795389.379724 read 0x1a8c69 thru 0x1b6714 (0xdaac bytes) 033000 1722795391.614695 trunc from 0x4145e3 to 0x24de82 (0x1c6760 bytes) 035000 1722795395.694554 fallocate 0x133e7d thru 0x135379 (0x14fd bytes) 036000 1722795397.586227 read 0x2c576b thru 0x2c5ee7 (0x77d bytes) 037000 1722795399.319530 read 0x0b7655 thru 0x0c436d (0xcd19 bytes) 039000 1722795403.109338 mapwrite 0x0af0c2 thru 0x0be5d0 (0xf50f bytes) 040000 1722795404.917681 fallocate 0x4312c8 thru 0x43a9ff (0x9738 bytes) 041000 1722795406.755853 mapread 0x0e8307 thru 0x0ea485 (0x217f bytes) 042000 1722795408.602122 punch from 0x08087c to 0x08f9c7 (0xf14c bytes) 043000 1722795410.698145 write 0x4e0e8d thru 0x4edc17 (0xcd8b bytes) 044000 1722795412.649512 fallocate 0x4c7401 thru 0x4d2de6 (0xb9e6 bytes) 045000 1722795414.744074 trunc from 0x2728b6 to 0x0a6d5c (0x1cbb59 bytes) 047000 1722795418.552642 mapread 0x3aaefb thru 0x3b82dd (0xd3e3 bytes) 048000 1722795420.439561 read 0x01b69b thru 0x024768 (0x90ce bytes) 049000 1722795422.528843 trunc from 0x468d61 to 0x28f694 (0x1d96cc bytes) 051000 1722795426.070023 mapwrite 0x42354d thru 0x430da0 (0xd854 bytes) 055000 1722795434.401782 fallocate 0x33b71b thru 0x34478c (0x9072 bytes) 056000 1722795436.689478 fallocate 0x449a59 thru 0x44b829 (0x1dd1 bytes) 057000 1722795438.767370 read 0x39c001 thru 0x3a5672 (0x9672 bytes) 058000 1722795440.890161 read 0x078214 thru 0x082610 (0xa3fd bytes) 059000 1722795442.844596 mapwrite 0x4c5c0c thru 0x4d0135 (0xa52a bytes) 060000 1722795444.758085 read 0x12e5eb thru 0x130e9d (0x28b3 bytes) 061000 1722795446.716207 trunc from 0x508bd6 to 0x45a3cf (0xae806 bytes) 063000 1722795450.515389 read 0x117b7b thru 0x1216d4 (0x9b5a bytes) 066000 1722795456.244549 mapwrite 0x22dad9 thru 0x23a1f9 (0xc721 bytes) 068000 1722795460.037564 punch from 0x156548 to 0x15ca03 (0x64bc bytes) 069000 1722795462.137417 mapwrite 0x4c678b thru 0x4cc4d0 (0x5d46 bytes) 070000 1722795463.731236 trunc from 0x3a74dd to 0x25f906 (0x147bd6 bytes) 071000 1722795465.606481 mapwrite 0x3e9f93 thru 0x3f7604 (0xd672 bytes) 072000 1722795467.470114 write 0x0fe860 thru 0x10073e (0x1edf bytes) 074000 1722795471.493185 write 0x10cb36 thru 0x1103b4 (0x387f bytes) 075000 1722795473.518439 fallocate 0x3920d7 thru 0x39f6b8 (0xd5e2 bytes) 077000 1722795477.831720 mapwrite 0x42642c thru 0x42b3c6 (0x4f9b bytes) 078000 1722795479.948193 fallocate 0x12f903 thru 0x135c6f (0x636d bytes) 080000 1722795484.011452 read 0x30b7b2 thru 0x30c2fc (0xb4b bytes) 081000 1722795485.915259 mapread 0x427091 thru 0x427dce (0xd3e bytes) 082000 1722795487.721049 read 0x22111e thru 0x2216c0 (0x5a3 bytes) 083000 1722795489.426987 mapwrite 0x392d20 thru 0x39ee05 (0xc0e6 bytes) 084000 1722795491.488957 fallocate 0x174198 thru 0x174879 (0x6e2 bytes) 085000 1722795493.376432 write 0x2d85c9 thru 0x2da2a1 (0x1cd9 bytes) 086000 1722795495.306135 write 0x25d6cd thru 0x26b5ed (0xdf21 bytes) 088000 1722795499.548351 write 0x515c24 thru 0x51a15d (0x453a bytes) 089000 1722795501.870495 mapwrite 0x2a7749 thru 0x2a9479 (0x1d31 bytes) 090000 1722795504.172225 write 0x086bd6 thru 0x093839 (0xcc64 bytes) 092000 1722795508.434236 read 0x4776e0 thru 0x47d8c0 (0x61e1 bytes) 093000 1722795510.631023 write 0x4d490c thru 0x4d7f61 (0x3656 bytes) 094000 1722795512.467721 mapread 0x2877c7 thru 0x28d9a3 (0x61dd bytes) 095000 1722795514.413506 trunc from 0x525119 to 0x4039b4 (0x121764 bytes) 096000 1722795516.480528 mapwrite 0x1e7914 thru 0x1e98aa (0x1f97 bytes) 098000 1722795520.379006 read 0x0b609e thru 0x0b7b5f (0x1ac2 bytes) 100000 1722795524.837264 write 0x07afae thru 0x088bd1 (0xdc24 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (203s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 14:18:45 (1722795525) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1722795528.941434 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1722795531.335023 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1722795533.731278 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1722795536.254824 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1722795541.194773 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1722795543.686170 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1722795546.377158 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1722795548.980779 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1722795551.441629 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1722795553.771265 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1722795556.843973 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1722795559.329399 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1722795561.589748 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1722795564.263425 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1722795566.768882 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1722795568.930131 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1722795572.598674 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1722795576.640723 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1722795579.343738 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1722795588.013224 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1722795590.523983 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1722795593.331993 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1722795596.651108 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1722795602.998559 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1722795609.375001 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1722795612.469725 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1722795615.432149 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1722795622.142242 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1722795625.261039 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1722795630.139635 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1722795633.457872 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1722795636.074011 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1722795639.180519 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1722795642.689263 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1722795648.973779 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1722795659.409409 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1722795667.064513 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1722795672.413702 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1722795675.318363 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1722795678.059721 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1722795685.161828 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1722795687.619510 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1722795690.148929 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1722795693.313426 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1722795696.399529 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1722795699.038466 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1722795702.415303 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1722795706.166166 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1722795710.376897 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1722795716.202576 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1722795719.078732 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1722795721.712196 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1722795725.181688 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1722795729.070505 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1722795735.336749 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1722795744.299580 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1722795750.702030 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1722795755.166689 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1722795758.209452 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1722795765.085919 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1722795768.164199 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1722795773.549343 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1722795776.983702 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1722795783.743648 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1722795788.865969 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1722795794.728917 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1722795798.195189 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1722795801.217819 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1722795804.388631 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1722795812.071949 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1722795815.365114 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1722795820.864340 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1722795823.794387 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (299s) == sanity-benchmark test complete, duration 825 sec ====== 14:23:44 (1722795824) === sanity-benchmark: start cleanup 14:23:45 (1722795825) === === sanity-benchmark: finish cleanup 14:23:45 (1722795825) ===