-----============= acceptance-small: sanity-benchmark ============----- Tue Feb 27 12:09:45 EST 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 12:09:47 (1709053787) === oleg415-client.virtnet: executing check_config_client /mnt/lustre oleg415-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg415-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a465000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a465000.idle_timeout=debug disable quota as required oleg415-server: oleg415-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 12:09:54 (1709053794) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 12:09:55 (1709053795) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7316] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg415-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg415-client.virtnet at Tue Feb 27 12:09:56 EST 2024 waiting for dbench pid 9450 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 275 206.10 MB/sec warmup 1 sec latency 45.817 ms 20 612 204.98 MB/sec warmup 2 sec latency 37.686 ms 20 967 146.16 MB/sec warmup 3 sec latency 49.859 ms 20 1410 129.31 MB/sec warmup 4 sec latency 21.724 ms 20 1776 105.16 MB/sec warmup 5 sec latency 26.357 ms 20 2199 89.79 MB/sec warmup 6 sec latency 20.302 ms 20 2524 82.56 MB/sec warmup 7 sec latency 291.023 ms 20 3069 84.62 MB/sec warmup 8 sec latency 374.452 ms 20 3630 85.85 MB/sec warmup 9 sec latency 27.112 ms 20 3919 79.93 MB/sec warmup 10 sec latency 26.727 ms 20 4158 72.99 MB/sec warmup 11 sec latency 44.649 ms 20 4430 67.86 MB/sec warmup 12 sec latency 49.985 ms 20 4670 64.56 MB/sec warmup 13 sec latency 204.758 ms 20 5053 64.52 MB/sec warmup 14 sec latency 31.769 ms 20 5337 60.55 MB/sec warmup 15 sec latency 27.775 ms 20 5682 57.23 MB/sec warmup 16 sec latency 20.737 ms 20 6052 56.02 MB/sec warmup 17 sec latency 26.585 ms 20 6748 59.54 MB/sec warmup 18 sec latency 27.427 ms 20 7280 61.39 MB/sec warmup 19 sec latency 26.335 ms 20 7566 59.18 MB/sec warmup 20 sec latency 21.895 ms 20 7904 56.82 MB/sec warmup 21 sec latency 59.477 ms 20 8272 55.67 MB/sec warmup 22 sec latency 25.579 ms 20 8684 55.97 MB/sec warmup 23 sec latency 24.535 ms 20 9387 18.97 MB/sec execute 1 sec latency 24.668 ms 20 9813 43.51 MB/sec execute 2 sec latency 26.653 ms 20 10511 67.28 MB/sec execute 3 sec latency 24.889 ms 20 10919 66.93 MB/sec execute 4 sec latency 25.074 ms 20 11239 54.97 MB/sec execute 5 sec latency 26.757 ms 20 11531 47.91 MB/sec execute 6 sec latency 48.119 ms 20 11947 48.13 MB/sec execute 7 sec latency 19.110 ms 20 12351 47.43 MB/sec execute 8 sec latency 26.716 ms 20 12764 43.22 MB/sec execute 9 sec latency 17.358 ms 20 13175 43.15 MB/sec execute 10 sec latency 21.780 ms 20 13845 49.60 MB/sec execute 11 sec latency 26.207 ms 20 14371 53.12 MB/sec execute 12 sec latency 32.483 ms 20 14662 50.48 MB/sec execute 13 sec latency 22.033 ms 20 14998 47.55 MB/sec execute 14 sec latency 42.036 ms 20 15386 46.55 MB/sec execute 15 sec latency 22.317 ms 20 15800 47.52 MB/sec execute 16 sec latency 27.291 ms 20 16170 45.10 MB/sec execute 17 sec latency 20.984 ms 20 16603 44.35 MB/sec execute 18 sec latency 19.084 ms 20 17144 47.49 MB/sec execute 19 sec latency 60.331 ms 20 17800 50.44 MB/sec execute 20 sec latency 23.810 ms 20 18107 49.37 MB/sec execute 21 sec latency 22.604 ms 20 18402 47.36 MB/sec execute 22 sec latency 44.405 ms 20 18754 46.41 MB/sec execute 23 sec latency 26.926 ms 20 19196 47.39 MB/sec execute 24 sec latency 23.626 ms 20 19573 45.85 MB/sec execute 25 sec latency 18.710 ms 20 19991 44.60 MB/sec execute 26 sec latency 19.037 ms 20 20403 45.07 MB/sec execute 27 sec latency 25.202 ms 20 21219 48.64 MB/sec execute 28 sec latency 20.993 ms 20 21649 48.94 MB/sec execute 29 sec latency 23.390 ms 20 21926 47.46 MB/sec execute 30 sec latency 54.459 ms 20 22240 46.35 MB/sec execute 31 sec latency 31.779 ms 20 22696 46.96 MB/sec execute 32 sec latency 19.258 ms 20 23068 46.31 MB/sec execute 33 sec latency 23.459 ms 20 23542 45.48 MB/sec execute 34 sec latency 17.863 ms 20 24047 46.39 MB/sec execute 35 sec latency 20.958 ms 20 24754 48.36 MB/sec execute 36 sec latency 21.867 ms 20 25173 48.60 MB/sec execute 37 sec latency 19.852 ms 20 25491 47.54 MB/sec execute 38 sec latency 40.830 ms 20 25819 46.78 MB/sec execute 39 sec latency 28.897 ms 20 26295 47.29 MB/sec execute 40 sec latency 18.036 ms 20 26671 46.63 MB/sec execute 41 sec latency 22.117 ms 20 27163 46.06 MB/sec execute 42 sec latency 17.766 ms 20 27761 47.36 MB/sec execute 43 sec latency 21.215 ms 20 28448 48.81 MB/sec execute 44 sec latency 20.410 ms 20 28810 48.56 MB/sec execute 45 sec latency 21.950 ms 20 29127 47.67 MB/sec execute 46 sec latency 42.593 ms 20 29505 47.26 MB/sec execute 47 sec latency 22.310 ms 20 29968 47.65 MB/sec execute 48 sec latency 19.609 ms 20 30349 46.87 MB/sec execute 49 sec latency 43.714 ms 20 30805 46.54 MB/sec execute 50 sec latency 21.635 ms 20 31468 47.82 MB/sec execute 51 sec latency 21.733 ms 20 32083 48.93 MB/sec execute 52 sec latency 23.424 ms 20 32406 48.47 MB/sec execute 53 sec latency 22.991 ms 20 32751 47.74 MB/sec execute 54 sec latency 67.424 ms 20 33131 47.46 MB/sec execute 55 sec latency 20.918 ms 20 33586 47.74 MB/sec execute 56 sec latency 19.940 ms 20 34038 47.06 MB/sec execute 57 sec latency 17.813 ms 20 34555 47.30 MB/sec execute 58 sec latency 20.066 ms 20 35299 48.61 MB/sec execute 59 sec latency 24.682 ms 20 35774 49.06 MB/sec execute 60 sec latency 20.077 ms 20 36093 48.42 MB/sec execute 61 sec latency 35.850 ms 20 36451 47.93 MB/sec execute 62 sec latency 25.063 ms 20 36897 48.18 MB/sec execute 63 sec latency 19.771 ms 20 37280 47.79 MB/sec execute 64 sec latency 20.150 ms 20 37741 47.33 MB/sec execute 65 sec latency 19.536 ms 20 38289 47.99 MB/sec execute 66 sec latency 21.247 ms 20 39037 49.10 MB/sec execute 67 sec latency 21.539 ms 20 39425 49.01 MB/sec execute 68 sec latency 18.281 ms 20 39756 48.39 MB/sec execute 69 sec latency 34.836 ms 20 40152 48.15 MB/sec execute 70 sec latency 20.189 ms 20 40630 48.41 MB/sec execute 71 sec latency 18.085 ms 20 41047 47.85 MB/sec execute 72 sec latency 18.737 ms 20 41511 47.69 MB/sec execute 73 sec latency 18.085 ms 20 42156 48.57 MB/sec execute 74 sec latency 22.694 ms 20 42670 49.17 MB/sec execute 75 sec latency 27.108 ms 20 42970 48.88 MB/sec execute 76 sec latency 23.365 ms 20 43245 48.31 MB/sec execute 77 sec latency 39.795 ms 20 43571 47.94 MB/sec execute 78 sec latency 27.600 ms 20 43937 47.94 MB/sec execute 79 sec latency 53.479 ms 20 44271 47.77 MB/sec execute 80 sec latency 22.081 ms 20 44464 47.22 MB/sec execute 81 sec latency 46.018 ms 20 44661 46.70 MB/sec execute 82 sec latency 47.948 ms 20 44838 46.28 MB/sec execute 83 sec latency 40.057 ms 20 44979 45.91 MB/sec execute 84 sec latency 71.661 ms 20 45123 45.58 MB/sec execute 85 sec latency 70.130 ms 20 45331 45.59 MB/sec execute 86 sec latency 49.746 ms 20 45704 45.72 MB/sec execute 87 sec latency 38.387 ms 20 46032 45.86 MB/sec execute 88 sec latency 47.789 ms 20 46267 45.78 MB/sec execute 89 sec latency 39.805 ms 20 46419 45.46 MB/sec execute 90 sec latency 47.804 ms 20 46511 45.01 MB/sec execute 91 sec latency 455.257 ms 20 46600 44.55 MB/sec execute 92 sec latency 1455.348 ms 20 46684 44.08 MB/sec execute 93 sec latency 2455.506 ms 20 46760 43.63 MB/sec execute 94 sec latency 3464.975 ms 20 46854 43.20 MB/sec execute 95 sec latency 4467.326 ms 20 46955 42.80 MB/sec execute 96 sec latency 5467.835 ms 20 47060 42.44 MB/sec execute 97 sec latency 6468.498 ms 20 47173 42.12 MB/sec execute 98 sec latency 7472.200 ms 20 47293 41.83 MB/sec execute 99 sec latency 8472.670 ms 20 47474 41.74 MB/sec execute 100 sec latency 9472.798 ms 20 47702 41.55 MB/sec execute 101 sec latency 10473.127 ms 20 47950 41.19 MB/sec execute 102 sec latency 11044.977 ms 20 48365 41.00 MB/sec execute 103 sec latency 19.326 ms 20 48744 41.13 MB/sec execute 104 sec latency 23.420 ms 20 49246 41.56 MB/sec execute 105 sec latency 26.555 ms 20 49612 41.76 MB/sec execute 106 sec latency 36.485 ms 20 49849 41.66 MB/sec execute 107 sec latency 28.547 ms 20 50013 41.35 MB/sec execute 108 sec latency 38.351 ms 20 50159 41.00 MB/sec execute 109 sec latency 49.156 ms 20 50345 40.69 MB/sec execute 110 sec latency 39.834 ms 20 50549 40.48 MB/sec execute 111 sec latency 36.032 ms 20 50813 40.37 MB/sec execute 112 sec latency 29.572 ms 20 51083 40.39 MB/sec execute 113 sec latency 39.707 ms 20 51290 40.17 MB/sec execute 114 sec latency 43.956 ms 20 51501 39.86 MB/sec execute 115 sec latency 37.698 ms 20 51794 39.60 MB/sec execute 116 sec latency 29.077 ms 20 52097 39.55 MB/sec execute 117 sec latency 33.544 ms 20 52523 39.88 MB/sec execute 118 sec latency 33.316 ms 20 52960 40.11 MB/sec execute 119 sec latency 41.863 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 151860 8.991 102.417 Close 112087 2.275 11044.116 Rename 6503 11.986 76.366 Unlink 30470 3.306 37.785 Qpathinfo 138429 2.145 64.229 Qfileinfo 24365 0.074 14.894 Qfsinfo 25567 0.067 9.251 Sfileinfo 12304 7.277 92.743 Find 53909 0.543 57.182 WriteX 75861 1.041 33.244 ReadX 243420 0.014 6.017 LockX 518 2.291 8.797 UnlockX 518 2.325 9.938 Flush 10606 8.549 79.707 Throughput 40.1139 MB/sec 20 clients 20 procs max_latency=11044.977 ms stopping dbench on /mnt/lustre/d0.oleg415-client.virtnet at Tue Feb 27 12:12:21 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg415-client.virtnet /mnt/lustre/d0.oleg415-client.virtnet /mnt/lustre/d0.oleg415-client.virtnet removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg415-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (150s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 12:12:27 (1709053947) min OST has 3535036kB available, using 5302554kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7316] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5178] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg415-clien 5178M 144941 94 126650 97 332587 93 2412 179 Latency 32822us 51470us 38461us 4880us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg415-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 239 30 3175 55 121 25 103 23 154 23 99 23 Latency 12484us 19598us 107ms 128ms 96198us 11056ms 1.97,1.97,oleg415-client.virtnet,1,1709063799,5178M,,,,144941,94,126650,97,,,332587,93,2412,179,10,,,,,239,30,3175,55,121,25,103,23,154,23,99,23,,32822us,51470us,,38461us,4880us,12484us,19598us,107ms,128ms,96198us,11056ms debug=0x33f0484 PASS bonnie (503s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 12:20:54 (1709054454) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 17557 -P /tmp -l 5408244 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 17557 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x85ba0 fallocating to largest ever: 0x4ec3b5 fallocating to largest ever: 0x508dc8 fallocating to largest ever: 0x51e735 fallocating to largest ever: 0x522f89 001000 1709054474.307076 fallocate 0x4c9db0 thru 0x4d488b (0xaadc bytes) truncating to largest ever: 0x5281da 002000 1709054479.426769 fallocate 0x1964c3 thru 0x1a3461 (0xcf9f bytes) fallocating to largest ever: 0x5285f4 003000 1709054501.730070 fallocate 0x133533 thru 0x139bce (0x669c bytes) 005000 1709054526.170729 mapwrite 0x345e7d thru 0x34ec91 (0x8e15 bytes) 006000 1709054536.579993 mapwrite 0x4eb1c6 thru 0x4f5dd9 (0xac14 bytes) 007000 1709054544.700390 mapwrite 0x065dc5 thru 0x067eeb (0x2127 bytes) 008000 1709054563.604768 trunc from 0x2218f2 to 0x4f45f9 (0x2d2d08 bytes) 009000 1709054570.858333 mapwrite 0x3c807e thru 0x3d4e32 (0xcdb5 bytes) 010000 1709054578.851796 fallocate 0x2ef710 thru 0x2f7c0c (0x84fd bytes) 011000 1709054584.003651 fallocate 0x037b77 thru 0x0393e3 (0x186d bytes) 013000 1709054594.942781 mapwrite 0x3fe91d thru 0x4000c5 (0x17a9 bytes) 014000 1709054601.841764 trunc from 0x41cda9 to 0x4663ea (0x49642 bytes) 016000 1709054612.783619 mapread 0x0e1213 thru 0x0ec64b (0xb439 bytes) 017000 1709054617.850341 trunc from 0x4f28ef to 0x24a44e (0x2a84a0 bytes) skipping zero length fallocate 018000 1709054623.005334 fallocate 0x397439 thru 0x39b733 (0x42fb bytes) 020000 1709054633.443291 mapread 0x059934 thru 0x062c9a (0x9367 bytes) 022000 1709054648.602583 read 0x244ad3 thru 0x253e2b (0xf359 bytes) 023000 1709054656.484446 mapwrite 0x4e8c79 thru 0x4f2590 (0x9918 bytes) 024000 1709054663.889851 mapwrite 0x24b0f8 thru 0x24be16 (0xd1f bytes) 026000 1709054680.185354 mapread 0x1c7683 thru 0x1d5cae (0xe62c bytes) 028000 1709054705.976011 punch from 0x04d6b7 to 0x055190 (0x7ada bytes) 030000 1709054731.464340 write 0x209746 thru 0x212875 (0x9130 bytes) 032000 1709054741.180887 mapread 0x11ce54 thru 0x1293e9 (0xc596 bytes) 033000 1709054746.388446 mapwrite 0x483818 thru 0x48eff6 (0xb7df bytes) 034000 1709054750.805986 fallocate 0x06d6a9 thru 0x07810a (0xaa62 bytes) 035000 1709054756.337889 write 0x16203d thru 0x169a6c (0x7a30 bytes) 036000 1709054763.869724 punch from 0x352f8a to 0x356311 (0x3388 bytes) 038000 1709054776.849478 trunc from 0x4945fa to 0x3bf68f (0xd4f6a bytes) 039000 1709054782.642515 punch from 0x3a89bf to 0x3ab374 (0x29b6 bytes) 040000 1709054787.961776 write 0x3ca33c thru 0x3d5859 (0xb51e bytes) 041000 1709054792.306700 punch from 0x4724d1 to 0x47a5e5 (0x8115 bytes) 043000 1709054803.349959 write 0x104834 thru 0x10fc61 (0xb42e bytes) 045000 1709054817.907459 trunc from 0x143d82 to 0x1d26e9 (0x8e968 bytes) 046000 1709054827.132770 punch from 0x169764 to 0x172b8f (0x942c bytes) 048000 1709054842.253982 fallocate 0x24bf94 thru 0x251b21 (0x5b8e bytes) 050000 1709054868.738944 mapwrite 0x23851c thru 0x241ce8 (0x97cd bytes) 051000 1709054881.013249 trunc from 0x5285f4 to 0x1637cf (0x3c4e24 bytes) 053000 1709054895.889022 write 0x3cd655 thru 0x3dd520 (0xfecc bytes) 055000 1709054908.204010 trunc from 0x311cc6 to 0x25cb6d (0xb5158 bytes) 056000 1709054915.442789 mapread 0x0fb927 thru 0x0fbc53 (0x32d bytes) 057000 1709054921.532346 fallocate 0x47b06c thru 0x485ae7 (0xaa7c bytes) 059000 1709054947.308475 mapwrite 0x07709f thru 0x07e1b6 (0x7118 bytes) 060000 1709054966.255436 fallocate 0x2fbb0b thru 0x2ff170 (0x3666 bytes) 062000 1709054983.478707 write 0x2da790 thru 0x2e6ba2 (0xc413 bytes) 063000 1709054991.082366 trunc from 0x3ae258 to 0x230be9 (0x17d66e bytes) 064000 1709055012.369879 mapwrite 0x0ce879 thru 0x0d38ba (0x5042 bytes) 065000 1709055020.976942 read 0x0817a3 thru 0x08e3d5 (0xcc33 bytes) 066000 1709055027.813963 fallocate 0x0409f4 thru 0x04b5cd (0xabda bytes) 067000 1709055035.143628 punch from 0x1cefae to 0x1db787 (0xc7da bytes) 069000 1709055059.185228 mapwrite 0x09eec7 thru 0x0a36f5 (0x482f bytes) 070000 1709055068.902912 trunc from 0x49dcf2 to 0x29dcbb (0x200036 bytes) 071000 1709055075.398963 write 0x2f60df thru 0x30446a (0xe38c bytes) 072000 1709055081.228498 fallocate 0x3669f3 thru 0x3731b4 (0xc7c2 bytes) 073000 1709055087.282996 read 0x34cde1 thru 0x352b4b (0x5d6b bytes) 074000 1709055094.000362 fallocate 0x205ac7 thru 0x20f5d2 (0x9b0c bytes) 075000 1709055100.379245 mapwrite 0x44b99b thru 0x44d311 (0x1977 bytes) 078000 1709055120.680871 mapwrite 0x0018b8 thru 0x0081c0 (0x6909 bytes) 079000 1709055128.105351 fallocate 0x0942ad thru 0x09c7a4 (0x84f8 bytes) 080000 1709055137.570172 read 0x01d7e7 thru 0x01e6be (0xed8 bytes) 083000 1709055161.061408 write 0x1ba734 thru 0x1c9fd5 (0xf8a2 bytes) 084000 1709055170.194548 mapwrite 0x13c640 thru 0x147a4d (0xb40e bytes) 088000 1709055210.889965 write 0x0bf71b thru 0x0c4fee (0x58d4 bytes) 090000 1709055223.889460 fallocate 0x3e7884 thru 0x3f2973 (0xb0f0 bytes) 091000 1709055229.775382 mapwrite 0x43b17d thru 0x4410cb (0x5f4f bytes) 092000 1709055237.363657 punch from 0x189969 to 0x197b13 (0xe1ab bytes) 094000 1709055249.599898 punch from 0x033587 to 0x03968e (0x6108 bytes) 096000 1709055264.583482 read 0x09e4c5 thru 0x0a9c6f (0xb7ab bytes) 097000 1709055272.580317 punch from 0x0a14b2 to 0x0add51 (0xc8a0 bytes) skipping zero size write 100000 1709055325.829425 mapwrite 0x48f1ad thru 0x495dc3 (0x6c17 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (874s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 12:35:31 (1709055331) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1709055340.849092 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1709055348.546439 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1709055356.013239 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1709055363.655749 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1709055376.872424 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1709055383.389169 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1709055392.041425 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1709055399.825008 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1709055405.284651 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1709055411.826416 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1709055419.040052 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1709055425.423292 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1709055442.800100 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1709055449.056086 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1709055455.769192 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1709055460.273669 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1709055465.278962 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1709055472.311724 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1709055478.088519 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1709055499.074953 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1709055505.121192 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1709055512.097749 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1709055519.646441 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1709055534.118646 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1709055546.970510 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1709055553.520898 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1709055560.219318 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1709055580.782781 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1709055589.234500 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1709055602.959199 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1709055612.522960 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1709055620.019051 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1709055629.835561 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1709055638.958686 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1709055665.016996 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1709055695.281773 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1709055715.216093 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1709055730.778785 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1709055737.164273 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1709055745.168326 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1709055780.412167 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1709055786.793554 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1709055792.731554 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1709055800.076055 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1709055806.043722 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1709055812.281689 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1709055820.972931 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1709055829.195004 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1709055835.779038 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1709055847.631601 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1709055856.221705 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1709055862.821527 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1709055869.524486 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1709055878.076286 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1709055890.030271 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1709055908.272862 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1709055922.298295 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1709055941.762095 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1709055960.452009 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1709055978.736804 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1709055987.225936 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1709056000.896976 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1709056009.536282 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1709056023.703612 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1709056039.563101 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1709056057.177413 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1709056064.652679 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1709056071.383644 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1709056077.657325 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1709056090.488609 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1709056097.490156 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1709056112.363173 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1709056120.724026 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (791s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 2338 sec ===== 12:48:43 (1709056123) === sanity-benchmark: start cleanup 12:48:43 (1709056123) === === sanity-benchmark: finish cleanup 12:48:43 (1709056123) ===