-----============= acceptance-small: sanity-benchmark ============----- Wed May 29 15:51:35 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 15:51:43 (1717012303) === oleg307-client.virtnet: executing check_config_client /mnt/lustre oleg307-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg307-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b673d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b673d800.idle_timeout=debug disable quota as required oleg307-server: oleg307-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 15:51:55 (1717012315) === == sanity-benchmark test dbench: dbench ================== 15:51:55 (1717012315) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7554] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg307-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg307-client.virtnet at Wed May 29 15:51:57 EDT 2024 waiting for dbench pid 9757 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 16 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 83 72.77 MB/sec warmup 1 sec latency 96.714 ms 20 210 82.10 MB/sec warmup 2 sec latency 107.405 ms 20 308 75.08 MB/sec warmup 3 sec latency 96.236 ms 20 403 71.24 MB/sec warmup 4 sec latency 90.772 ms 20 504 70.16 MB/sec warmup 5 sec latency 96.622 ms 20 689 70.49 MB/sec warmup 6 sec latency 103.846 ms 20 833 61.45 MB/sec warmup 7 sec latency 79.513 ms 20 1015 55.83 MB/sec warmup 8 sec latency 59.788 ms 20 1193 51.13 MB/sec warmup 9 sec latency 52.656 ms 20 1404 51.40 MB/sec warmup 10 sec latency 74.926 ms 20 1590 47.48 MB/sec warmup 11 sec latency 68.488 ms 20 1782 43.80 MB/sec warmup 12 sec latency 67.583 ms 20 2134 41.09 MB/sec warmup 13 sec latency 37.609 ms 20 2450 40.33 MB/sec warmup 14 sec latency 36.779 ms 20 2877 43.42 MB/sec warmup 15 sec latency 46.132 ms 20 3125 42.49 MB/sec warmup 16 sec latency 58.684 ms 20 3585 45.24 MB/sec warmup 17 sec latency 48.516 ms 20 3793 44.09 MB/sec warmup 18 sec latency 74.103 ms 20 3932 42.12 MB/sec warmup 19 sec latency 66.266 ms 20 4111 40.06 MB/sec warmup 20 sec latency 36.338 ms 20 4300 38.45 MB/sec warmup 21 sec latency 81.278 ms 20 4485 37.11 MB/sec warmup 22 sec latency 86.580 ms 20 4717 36.60 MB/sec warmup 23 sec latency 54.072 ms 20 5118 4.53 MB/sec execute 1 sec latency 747.974 ms 20 5745 11.44 MB/sec execute 2 sec latency 39.494 ms 20 6037 16.66 MB/sec execute 3 sec latency 40.356 ms 20 6282 24.55 MB/sec execute 4 sec latency 62.728 ms 20 6549 30.83 MB/sec execute 5 sec latency 71.149 ms 20 6819 29.79 MB/sec execute 6 sec latency 83.572 ms 20 7116 35.56 MB/sec execute 7 sec latency 66.646 ms 20 7360 34.68 MB/sec execute 8 sec latency 41.654 ms 20 7479 31.43 MB/sec execute 9 sec latency 55.017 ms 20 7577 28.36 MB/sec execute 10 sec latency 56.898 ms 20 7707 25.94 MB/sec execute 11 sec latency 116.583 ms 20 7835 24.17 MB/sec execute 12 sec latency 105.837 ms 20 7989 22.86 MB/sec execute 13 sec latency 78.870 ms 20 8152 22.35 MB/sec execute 14 sec latency 73.524 ms 20 8296 21.68 MB/sec execute 15 sec latency 89.527 ms 20 8460 22.24 MB/sec execute 16 sec latency 83.767 ms 20 8659 22.74 MB/sec execute 17 sec latency 87.075 ms 20 8838 21.65 MB/sec execute 18 sec latency 102.304 ms 20 9074 20.76 MB/sec execute 19 sec latency 102.569 ms 20 9360 20.49 MB/sec execute 20 sec latency 72.066 ms 20 9520 20.26 MB/sec execute 21 sec latency 81.957 ms 20 9618 19.92 MB/sec execute 22 sec latency 99.556 ms 20 9867 21.45 MB/sec execute 23 sec latency 75.907 ms 20 10090 22.25 MB/sec execute 24 sec latency 78.465 ms 20 10375 22.63 MB/sec execute 25 sec latency 74.191 ms 20 10724 24.55 MB/sec execute 26 sec latency 51.224 ms 20 10910 24.43 MB/sec execute 27 sec latency 51.062 ms 20 11042 23.77 MB/sec execute 28 sec latency 42.459 ms 20 11166 22.96 MB/sec execute 29 sec latency 55.938 ms 20 11330 22.32 MB/sec execute 30 sec latency 91.258 ms 20 11449 21.79 MB/sec execute 31 sec latency 245.089 ms 20 11632 21.53 MB/sec execute 32 sec latency 69.480 ms 20 11883 21.79 MB/sec execute 33 sec latency 48.757 ms 20 12181 22.60 MB/sec execute 34 sec latency 60.157 ms 20 12440 22.08 MB/sec execute 35 sec latency 70.096 ms 20 12789 21.81 MB/sec execute 36 sec latency 59.840 ms 20 13046 21.79 MB/sec execute 37 sec latency 68.238 ms 20 13167 21.65 MB/sec execute 38 sec latency 75.598 ms 20 13468 22.74 MB/sec execute 39 sec latency 67.757 ms 20 13753 23.20 MB/sec execute 40 sec latency 62.901 ms 20 14043 23.61 MB/sec execute 41 sec latency 58.198 ms 20 14295 24.38 MB/sec execute 42 sec latency 75.254 ms 20 14423 24.16 MB/sec execute 43 sec latency 101.063 ms 20 14489 23.70 MB/sec execute 44 sec latency 115.500 ms 20 14561 23.25 MB/sec execute 45 sec latency 88.934 ms 20 14624 22.78 MB/sec execute 46 sec latency 91.957 ms 20 14667 22.30 MB/sec execute 47 sec latency 203.593 ms 20 14762 21.85 MB/sec execute 48 sec latency 108.200 ms 20 14892 21.48 MB/sec execute 49 sec latency 103.804 ms 20 15022 21.17 MB/sec execute 50 sec latency 91.744 ms 20 15190 21.03 MB/sec execute 51 sec latency 61.932 ms 20 15437 21.18 MB/sec execute 52 sec latency 50.028 ms 20 15681 21.65 MB/sec execute 53 sec latency 75.945 ms 20 15902 21.36 MB/sec execute 54 sec latency 83.729 ms 20 16203 21.12 MB/sec execute 55 sec latency 80.646 ms 20 16514 21.06 MB/sec execute 56 sec latency 71.693 ms 20 16665 20.99 MB/sec execute 57 sec latency 66.436 ms 20 16872 21.30 MB/sec execute 58 sec latency 65.806 ms 20 17150 21.92 MB/sec execute 59 sec latency 77.285 ms 20 17362 21.93 MB/sec execute 60 sec latency 76.142 ms 20 17641 22.33 MB/sec execute 61 sec latency 201.556 ms 20 17879 22.70 MB/sec execute 62 sec latency 63.891 ms 20 18011 22.61 MB/sec execute 63 sec latency 70.588 ms 20 18092 22.30 MB/sec execute 64 sec latency 57.250 ms 20 18176 22.00 MB/sec execute 65 sec latency 74.292 ms 20 18251 21.67 MB/sec execute 66 sec latency 162.158 ms 20 18328 21.37 MB/sec execute 67 sec latency 170.339 ms 20 18506 21.15 MB/sec execute 68 sec latency 76.994 ms 20 18678 21.02 MB/sec execute 69 sec latency 78.535 ms 20 18814 20.89 MB/sec execute 70 sec latency 82.655 ms 20 19003 20.94 MB/sec execute 71 sec latency 68.714 ms 20 19199 21.20 MB/sec execute 72 sec latency 103.713 ms 20 19411 21.03 MB/sec execute 73 sec latency 65.298 ms 20 19727 20.87 MB/sec execute 74 sec latency 70.085 ms 20 20030 20.75 MB/sec execute 75 sec latency 70.204 ms 20 20203 20.73 MB/sec execute 76 sec latency 75.920 ms 20 20351 20.79 MB/sec execute 77 sec latency 63.524 ms 20 20546 20.97 MB/sec execute 78 sec latency 96.108 ms 20 20806 21.36 MB/sec execute 79 sec latency 76.472 ms 20 21028 21.44 MB/sec execute 80 sec latency 87.795 ms 20 21240 21.55 MB/sec execute 81 sec latency 75.773 ms 20 21471 21.85 MB/sec execute 82 sec latency 80.246 ms 20 21596 21.78 MB/sec execute 83 sec latency 74.590 ms 20 21702 21.57 MB/sec execute 84 sec latency 58.375 ms 20 21798 21.33 MB/sec execute 85 sec latency 64.204 ms 20 21902 21.10 MB/sec execute 86 sec latency 98.654 ms 20 22070 20.92 MB/sec execute 87 sec latency 73.359 ms 20 22234 20.81 MB/sec execute 88 sec latency 61.319 ms 20 22466 20.81 MB/sec execute 89 sec latency 59.879 ms 20 22739 21.09 MB/sec execute 90 sec latency 68.334 ms 20 22909 21.03 MB/sec execute 91 sec latency 227.553 ms 20 23253 20.91 MB/sec execute 92 sec latency 81.387 ms 20 23659 20.96 MB/sec execute 93 sec latency 59.619 ms 20 23812 20.88 MB/sec execute 94 sec latency 64.543 ms 20 24145 21.43 MB/sec execute 95 sec latency 59.454 ms 20 24585 21.87 MB/sec execute 96 sec latency 46.768 ms 20 25003 22.39 MB/sec execute 97 sec latency 44.315 ms 20 25181 22.36 MB/sec execute 98 sec latency 52.283 ms 20 25305 22.18 MB/sec execute 99 sec latency 53.662 ms 20 25458 21.97 MB/sec execute 100 sec latency 77.665 ms 20 25655 21.82 MB/sec execute 101 sec latency 57.116 ms 20 25834 21.74 MB/sec execute 102 sec latency 64.174 ms 20 26014 21.69 MB/sec execute 103 sec latency 72.599 ms 20 26250 21.84 MB/sec execute 104 sec latency 49.088 ms 20 26485 21.90 MB/sec execute 105 sec latency 77.507 ms 20 26731 21.74 MB/sec execute 106 sec latency 87.943 ms 20 27027 21.67 MB/sec execute 107 sec latency 83.087 ms 20 27242 21.60 MB/sec execute 108 sec latency 77.540 ms 20 27380 21.56 MB/sec execute 109 sec latency 68.442 ms 20 27647 21.87 MB/sec execute 110 sec latency 63.767 ms 20 27913 22.09 MB/sec execute 111 sec latency 79.779 ms 20 28177 22.24 MB/sec execute 112 sec latency 72.502 ms 20 28426 22.40 MB/sec execute 113 sec latency 73.177 ms 20 28612 22.48 MB/sec execute 114 sec latency 68.365 ms 20 28726 22.38 MB/sec execute 115 sec latency 81.820 ms 20 28832 22.22 MB/sec execute 116 sec latency 54.445 ms 20 28959 22.04 MB/sec execute 117 sec latency 94.176 ms 20 29126 21.89 MB/sec execute 118 sec latency 109.670 ms 20 29334 21.80 MB/sec execute 119 sec latency 84.519 ms 20 cleanup 120 sec 12 cleanup 121 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 85431 11.780 203.581 Close 62726 1.919 85.919 Rename 3585 33.221 103.698 Unlink 17265 10.763 92.157 Qpathinfo 77108 5.818 149.096 Qfileinfo 13452 0.127 22.644 Qfsinfo 14171 0.067 21.186 Sfileinfo 6836 24.982 116.577 Find 29836 1.069 104.361 WriteX 42169 3.248 61.680 ReadX 133059 0.016 11.859 LockX 280 7.110 19.152 UnlockX 280 7.467 20.198 Flush 6015 28.030 747.946 Throughput 21.8029 MB/sec 20 clients 20 procs max_latency=747.974 ms stopping dbench on /mnt/lustre/d0.oleg307-client.virtnet at Wed May 29 15:54:22 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg307-client.virtnet /mnt/lustre/d0.oleg307-client.virtnet /mnt/lustre/d0.oleg307-client.virtnet removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg307-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (151s) == sanity-benchmark test bonnie: bonnie++ ================ 15:54:26 (1717012466) min OST has 3426312kB available, using 5139468kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7554] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5019] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg307-clien 5019M 131630 84 101452 69 263936 45 1326 182 Latency 19418us 91421us 80060us 16285us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg307-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 215 17 4935 21 308 12 200 16 487 10 261 12 Latency 39135us 34399us 51882us 29386us 20668us 65808us 1.97,1.97,oleg307-client.virtnet,1,1717022122,5019M,,,,131630,84,101452,69,,,263936,45,1326,182,10,,,,,215,17,4935,21,308,12,200,16,487,10,261,12,,19418us,91421us,,80060us,16285us,39135us,34399us,51882us,29386us,20668us,65808us debug=0x33f0484 PASS bonnie (316s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 15:59:43 (1717012783) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 22226 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 22226 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x39e428 fallocating to largest ever: 0x4e952c fallocating to largest ever: 0x4f8a6a truncating to largest ever: 0x51e7fd fallocating to largest ever: 0x5285e2 001000 1717012789.234794 trunc from 0x3576b9 to 0x0d21ec (0x2854cc bytes) 002000 1717012794.126448 mapwrite 0x2575b7 thru 0x25b1c4 (0x3c0e bytes) 003000 1717012799.299743 write 0x3d1185 thru 0x3de4e1 (0xd35d bytes) 006000 1717012815.870548 read 0x4f125e thru 0x4fd221 (0xbfc4 bytes) 007000 1717012821.785677 trunc from 0x4cf530 to 0x053393 (0x47c19c bytes) 008000 1717012826.826265 punch from 0x04ddd4 to 0x05d629 (0xf856 bytes) 012000 1717012845.438569 read 0x31d83f thru 0x322a9b (0x525d bytes) 014000 1717012855.678850 mapwrite 0x2d9cb0 thru 0x2deff4 (0x5345 bytes) 015000 1717012860.890063 mapread 0x0f94fd thru 0x107849 (0xe34d bytes) 016000 1717012866.958395 mapread 0x3b6487 thru 0x3b7702 (0x127c bytes) 017000 1717012871.398762 mapread 0x0201a8 thru 0x0255ef (0x5448 bytes) 018000 1717012876.608376 fallocate 0x1542b6 thru 0x159cd9 (0x5a24 bytes) 019000 1717012881.371425 read 0x4d35fa thru 0x4e0131 (0xcb38 bytes) 021000 1717012890.087017 punch from 0x1dcb81 to 0x1e0107 (0x3587 bytes) 022000 1717012896.358567 read 0x0dd248 thru 0x0e99c1 (0xc77a bytes) 023000 1717012902.605700 mapread 0x23e261 thru 0x23f804 (0x15a4 bytes) 024000 1717012907.126928 trunc from 0x476c46 to 0x491469 (0x1a824 bytes) 025000 1717012911.884641 punch from 0x06b7a3 to 0x07a925 (0xf183 bytes) 026000 1717012917.407508 mapwrite 0x4084ae thru 0x414944 (0xc497 bytes) 027000 1717012921.961641 read 0x171391 thru 0x17a4d3 (0x9143 bytes) 028000 1717012926.599428 write 0x261786 thru 0x27144c (0xfcc7 bytes) 029000 1717012931.380369 mapwrite 0x266b8f thru 0x274fd1 (0xe443 bytes) 030000 1717012936.730511 punch from 0x161c8c to 0x16377c (0x1af1 bytes) 031000 1717012941.551607 mapread 0x0b6ece thru 0x0c1de4 (0xaf17 bytes) 032000 1717012946.219990 read 0x14b0c4 thru 0x15093a (0x5877 bytes) 033000 1717012951.037640 write 0x4e6f2f thru 0x4eebfa (0x7ccc bytes) 034000 1717012955.747784 read 0x190378 thru 0x1961f3 (0x5e7c bytes) 035000 1717012960.875399 punch from 0x135128 to 0x13ee80 (0x9d59 bytes) 036000 1717012965.733673 read 0x4187fe thru 0x424707 (0xbf0a bytes) 040000 1717012984.825765 punch from 0x24217b to 0x247dfd (0x5c83 bytes) 041000 1717012990.845511 mapwrite 0x356884 thru 0x3633a1 (0xcb1e bytes) 042000 1717012996.037090 trunc from 0x347fc4 to 0x1e3e89 (0x16413a bytes) 043000 1717013001.240848 trunc from 0x033fc9 to 0x3eaac5 (0x3b6afd bytes) 044000 1717013007.118546 read 0x22180a thru 0x22b152 (0x9949 bytes) 045000 1717013012.029288 mapwrite 0x4eb304 thru 0x4ef171 (0x3e6e bytes) 049000 1717013029.813160 mapread 0x16b779 thru 0x177954 (0xc1dc bytes) 050000 1717013034.059463 trunc from 0x443a87 to 0x3108b4 (0x1331d2 bytes) 052000 1717013043.106391 punch from 0x186627 to 0x18958d (0x2f67 bytes) 054000 1717013051.062149 mapread 0x40fc0c thru 0x418060 (0x8455 bytes) 055000 1717013055.450606 punch from 0x03671c to 0x041fcf (0xb8b4 bytes) 056000 1717013060.384456 fallocate 0x0ddc60 thru 0x0e4bed (0x6f8e bytes) 057000 1717013064.543976 write 0x33be0a thru 0x341805 (0x59fc bytes) 058000 1717013068.476984 mapread 0x1e522f thru 0x1e8969 (0x373b bytes) 060000 1717013075.635243 write 0x498954 thru 0x4a5173 (0xc820 bytes) 061000 1717013078.840552 punch from 0x3b8533 to 0x3c2d67 (0xa835 bytes) 062000 1717013082.397237 trunc from 0x40e116 to 0x22153d (0x1ecbd8 bytes) 063000 1717013085.940727 mapread 0x1b4864 thru 0x1c0edd (0xc67a bytes) 065000 1717013093.235735 read 0x29142c thru 0x294cd1 (0x38a6 bytes) 066000 1717013097.015313 read 0x0841b6 thru 0x08e34d (0xa198 bytes) 067000 1717013102.155861 write 0x1334d3 thru 0x139efa (0x6a28 bytes) 070000 1717013113.425394 trunc from 0x4d39af to 0x20e553 (0x2c545b bytes) 072000 1717013123.338014 mapwrite 0x25c6df thru 0x262fa4 (0x68c6 bytes) 073000 1717013128.117264 punch from 0x1e5e91 to 0x1e6ae5 (0xc55 bytes) 075000 1717013136.619307 punch from 0x4e286b to 0x4eb7cd (0x8f63 bytes) 076000 1717013141.363659 read 0x2539b9 thru 0x25c568 (0x8bb0 bytes) 078000 1717013150.605731 trunc from 0x343bb7 to 0x33f763 (0x4453 bytes) 079000 1717013155.474289 read 0x422af2 thru 0x42b950 (0x8e5f bytes) 080000 1717013159.903427 fallocate 0x2b95c1 thru 0x2c5944 (0xc384 bytes) 084000 1717013176.474374 mapread 0x0bf57a thru 0x0c8d0e (0x9795 bytes) 085000 1717013180.720665 mapwrite 0x342b60 thru 0x34ed09 (0xc1aa bytes) 087000 1717013187.845217 fallocate 0x4d0bc4 thru 0x4d937c (0x87b9 bytes) 088000 1717013192.778838 write 0x2d054f thru 0x2d99e8 (0x949a bytes) 090000 1717013202.863337 write 0x054653 thru 0x05a063 (0x5a11 bytes) 091000 1717013207.792180 read 0x132a7b thru 0x140ef5 (0xe47b bytes) 092000 1717013212.585913 mapwrite 0x371cd6 thru 0x378de4 (0x710f bytes) 094000 1717013222.859143 write 0x39eacd thru 0x3a5ffe (0x7532 bytes) 095000 1717013227.776536 read 0x195405 thru 0x1961de (0xdda bytes) 096000 1717013233.635806 write 0x34e856 thru 0x351823 (0x2fce bytes) 097000 1717013239.165072 mapread 0x3ce6ca thru 0x3d348f (0x4dc6 bytes) 098000 1717013243.696513 fallocate 0x0c2837 thru 0x0c993d (0x7107 bytes) 099000 1717013248.330799 mapwrite 0x4ed7ce thru 0x4f290b (0x513e bytes) 100000 1717013252.890798 read 0x166b8f thru 0x171ad5 (0xaf47 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (471s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 16:07:34 (1717013254) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1717013261.819647 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1717013267.885770 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1717013274.522120 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1717013280.608548 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1717013291.358240 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1717013296.271210 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1717013302.021492 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1717013307.668612 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1717013312.819218 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1717013316.842143 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1717013321.232051 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1717013325.578787 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1717013330.088351 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1717013334.990927 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1717013340.716500 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1717013346.183240 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1717013352.568233 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1717013358.746082 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1717013364.359212 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1717013384.213368 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1717013390.036082 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1717013395.186514 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1717013400.868404 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1717013411.828710 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1717013423.428604 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1717013430.075553 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1717013436.692749 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1717013450.540180 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1717013457.829378 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1717013470.122380 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1717013477.582648 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1717013484.216595 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1717013491.731581 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1717013498.300488 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1717013512.133610 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1717013533.475514 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1717013551.772909 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1717013563.431121 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1717013568.890432 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1717013576.542963 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1717013594.685646 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1717013601.656862 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1717013608.099145 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1717013615.420587 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1717013622.613897 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1717013628.516216 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1717013634.377892 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1717013641.190709 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1717013648.659251 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1717013660.835745 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1717013668.622187 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1717013675.245504 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1717013681.217630 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1717013688.385919 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1717013701.968664 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1717013722.939126 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1717013736.458635 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1717013742.988763 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1717013749.474748 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1717013763.905832 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1717013771.664359 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1717013783.413359 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1717013789.675724 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1717013803.379941 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1717013816.708622 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1717013829.902134 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1717013836.593507 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1717013842.430392 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1717013847.551555 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1717013860.721501 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1717013867.925215 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1717013881.434464 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1717013888.906221 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (636s) == sanity-benchmark test complete, duration 1594 sec ===== 16:18:10 (1717013890) === sanity-benchmark: start cleanup 16:18:11 (1717013891) === === sanity-benchmark: finish cleanup 16:18:11 (1717013891) ===