-----============= acceptance-small: sanity-benchmark ============----- Fri Jul 19 12:19:29 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg358-client.virtnet: executing check_config_client /mnt/lustre oleg358-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg358-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012b3a7800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012b3a7800.idle_timeout=debug disable quota as required oleg358-server: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 12:19:38 (1721405978) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6829] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg358-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg358-client.virtnet at Fri Jul 19 12:19:39 EDT 2024 waiting for dbench pid 8758 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 205 161.17 MB/sec warmup 1 sec latency 81.481 ms 20 433 152.44 MB/sec warmup 2 sec latency 44.777 ms 20 671 141.03 MB/sec warmup 3 sec latency 211.726 ms 20 865 107.93 MB/sec warmup 4 sec latency 108.650 ms 20 1087 91.69 MB/sec warmup 5 sec latency 100.602 ms 20 1421 86.68 MB/sec warmup 6 sec latency 27.013 ms 20 1632 74.75 MB/sec warmup 7 sec latency 182.966 ms 20 1865 65.89 MB/sec warmup 8 sec latency 87.186 ms 20 2143 59.31 MB/sec warmup 9 sec latency 83.099 ms 20 2397 55.99 MB/sec warmup 10 sec latency 137.610 ms 20 2591 53.07 MB/sec warmup 11 sec latency 166.181 ms 20 2958 55.77 MB/sec warmup 12 sec latency 172.664 ms 20 3330 54.43 MB/sec warmup 13 sec latency 170.140 ms 20 3698 55.66 MB/sec warmup 14 sec latency 104.133 ms 20 3911 53.25 MB/sec warmup 15 sec latency 29.525 ms 20 4120 50.12 MB/sec warmup 16 sec latency 29.455 ms 20 4260 47.42 MB/sec warmup 17 sec latency 448.542 ms 20 4384 45.13 MB/sec warmup 18 sec latency 119.130 ms 20 4556 43.33 MB/sec warmup 19 sec latency 136.824 ms 20 4840 42.92 MB/sec warmup 20 sec latency 95.227 ms 20 5103 43.05 MB/sec warmup 21 sec latency 95.802 ms 20 5305 41.25 MB/sec warmup 22 sec latency 82.759 ms 20 5516 39.62 MB/sec warmup 23 sec latency 104.074 ms 20 6031 28.12 MB/sec execute 1 sec latency 148.439 ms 20 6368 49.19 MB/sec execute 2 sec latency 168.261 ms 20 6716 49.23 MB/sec execute 3 sec latency 162.298 ms 20 7090 52.49 MB/sec execute 4 sec latency 151.417 ms 20 7351 50.27 MB/sec execute 5 sec latency 34.539 ms 20 7552 43.12 MB/sec execute 6 sec latency 26.597 ms 20 7727 37.31 MB/sec execute 7 sec latency 211.415 ms 20 7883 33.47 MB/sec execute 8 sec latency 211.458 ms 20 8057 30.96 MB/sec execute 9 sec latency 176.015 ms 20 8315 31.18 MB/sec execute 10 sec latency 99.354 ms 20 8614 32.83 MB/sec execute 11 sec latency 192.485 ms 20 8808 30.37 MB/sec execute 12 sec latency 126.459 ms 20 9048 28.37 MB/sec execute 13 sec latency 58.581 ms 20 9364 27.50 MB/sec execute 14 sec latency 78.991 ms 20 9629 28.06 MB/sec execute 15 sec latency 126.856 ms 20 10091 31.78 MB/sec execute 16 sec latency 208.305 ms 20 10515 33.58 MB/sec execute 17 sec latency 133.012 ms 20 10855 34.73 MB/sec execute 18 sec latency 73.772 ms 20 11078 33.74 MB/sec execute 19 sec latency 32.935 ms 20 11290 32.18 MB/sec execute 20 sec latency 282.105 ms 20 11428 30.95 MB/sec execute 21 sec latency 220.451 ms 20 11626 30.24 MB/sec execute 22 sec latency 165.261 ms 20 11940 30.60 MB/sec execute 23 sec latency 134.617 ms 20 12238 31.03 MB/sec execute 24 sec latency 103.608 ms 20 12466 29.94 MB/sec execute 25 sec latency 87.072 ms 20 12753 29.03 MB/sec execute 26 sec latency 74.432 ms 20 13055 29.05 MB/sec execute 27 sec latency 144.893 ms 20 13344 29.77 MB/sec execute 28 sec latency 189.828 ms 20 13777 31.26 MB/sec execute 29 sec latency 143.878 ms 20 14213 32.98 MB/sec execute 30 sec latency 141.768 ms 20 14492 32.88 MB/sec execute 31 sec latency 26.058 ms 20 14697 31.99 MB/sec execute 32 sec latency 26.365 ms 20 14882 31.15 MB/sec execute 33 sec latency 371.088 ms 20 15008 30.41 MB/sec execute 34 sec latency 137.503 ms 20 15189 29.92 MB/sec execute 35 sec latency 132.834 ms 20 15513 30.20 MB/sec execute 36 sec latency 93.341 ms 20 15803 30.48 MB/sec execute 37 sec latency 83.158 ms 20 16047 29.78 MB/sec execute 38 sec latency 83.931 ms 20 16327 29.20 MB/sec execute 39 sec latency 73.996 ms 20 16597 29.15 MB/sec execute 40 sec latency 194.112 ms 20 16924 29.95 MB/sec execute 41 sec latency 191.579 ms 20 17325 30.68 MB/sec execute 42 sec latency 156.454 ms 20 17763 31.84 MB/sec execute 43 sec latency 109.998 ms 20 18054 31.86 MB/sec execute 44 sec latency 23.037 ms 20 18293 31.26 MB/sec execute 45 sec latency 126.002 ms 20 18463 30.69 MB/sec execute 46 sec latency 317.461 ms 20 18623 30.20 MB/sec execute 47 sec latency 113.089 ms 20 18842 30.11 MB/sec execute 48 sec latency 137.833 ms 20 19219 30.77 MB/sec execute 49 sec latency 92.518 ms 20 19486 30.24 MB/sec execute 50 sec latency 95.293 ms 20 19819 29.78 MB/sec execute 51 sec latency 50.679 ms 20 20158 29.75 MB/sec execute 52 sec latency 123.697 ms 20 20487 30.22 MB/sec execute 53 sec latency 150.994 ms 20 20929 30.98 MB/sec execute 54 sec latency 131.280 ms 20 21396 32.02 MB/sec execute 55 sec latency 134.278 ms 20 21677 31.90 MB/sec execute 56 sec latency 23.779 ms 20 21885 31.41 MB/sec execute 57 sec latency 331.184 ms 20 22079 30.99 MB/sec execute 58 sec latency 358.229 ms 20 22276 30.63 MB/sec execute 59 sec latency 107.376 ms 20 22617 30.82 MB/sec execute 60 sec latency 84.372 ms 20 22931 31.04 MB/sec execute 61 sec latency 111.867 ms 20 23195 30.61 MB/sec execute 62 sec latency 69.760 ms 20 23556 30.37 MB/sec execute 63 sec latency 73.018 ms 20 23819 30.32 MB/sec execute 64 sec latency 125.130 ms 20 24278 31.38 MB/sec execute 65 sec latency 163.810 ms 20 24780 31.91 MB/sec execute 66 sec latency 113.316 ms 20 25132 32.32 MB/sec execute 67 sec latency 68.502 ms 20 25375 31.94 MB/sec execute 68 sec latency 23.025 ms 20 25580 31.56 MB/sec execute 69 sec latency 288.256 ms 20 25728 31.20 MB/sec execute 70 sec latency 127.018 ms 20 25984 31.12 MB/sec execute 71 sec latency 165.526 ms 20 26386 31.59 MB/sec execute 72 sec latency 75.299 ms 20 26652 31.21 MB/sec execute 73 sec latency 88.224 ms 20 27002 30.91 MB/sec execute 74 sec latency 63.428 ms 20 27333 30.94 MB/sec execute 75 sec latency 118.986 ms 20 27803 31.76 MB/sec execute 76 sec latency 128.315 ms 20 28332 32.43 MB/sec execute 77 sec latency 124.690 ms 20 28657 32.60 MB/sec execute 78 sec latency 89.403 ms 20 28887 32.33 MB/sec execute 79 sec latency 22.696 ms 20 29106 31.98 MB/sec execute 80 sec latency 388.549 ms 20 29241 31.67 MB/sec execute 81 sec latency 137.338 ms 20 29481 31.59 MB/sec execute 82 sec latency 114.169 ms 20 29893 32.00 MB/sec execute 83 sec latency 75.099 ms 20 30168 31.67 MB/sec execute 84 sec latency 76.102 ms 20 30522 31.40 MB/sec execute 85 sec latency 99.039 ms 20 30857 31.39 MB/sec execute 86 sec latency 110.052 ms 20 31319 32.07 MB/sec execute 87 sec latency 146.946 ms 20 31787 32.49 MB/sec execute 88 sec latency 146.065 ms 20 32175 32.84 MB/sec execute 89 sec latency 62.477 ms 20 32424 32.63 MB/sec execute 90 sec latency 20.868 ms 20 32659 32.32 MB/sec execute 91 sec latency 250.551 ms 20 32824 32.05 MB/sec execute 92 sec latency 170.957 ms 20 33099 32.01 MB/sec execute 93 sec latency 132.852 ms 20 33488 32.33 MB/sec execute 94 sec latency 97.247 ms 20 33758 32.04 MB/sec execute 95 sec latency 88.377 ms 20 34098 31.81 MB/sec execute 96 sec latency 66.483 ms 20 34422 31.80 MB/sec execute 97 sec latency 146.091 ms 20 34875 32.41 MB/sec execute 98 sec latency 151.932 ms 20 35374 32.81 MB/sec execute 99 sec latency 136.062 ms 20 35735 33.05 MB/sec execute 100 sec latency 114.341 ms 20 36008 32.86 MB/sec execute 101 sec latency 58.128 ms 20 36211 32.59 MB/sec execute 102 sec latency 249.984 ms 20 36389 32.36 MB/sec execute 103 sec latency 117.705 ms 20 36701 32.42 MB/sec execute 104 sec latency 91.755 ms 20 37052 32.59 MB/sec execute 105 sec latency 120.350 ms 20 37305 32.32 MB/sec execute 106 sec latency 77.291 ms 20 37633 32.10 MB/sec execute 107 sec latency 56.175 ms 20 37937 32.08 MB/sec execute 108 sec latency 122.445 ms 20 38322 32.47 MB/sec execute 109 sec latency 151.613 ms 20 38771 32.76 MB/sec execute 110 sec latency 132.301 ms 20 39171 33.13 MB/sec execute 111 sec latency 98.017 ms 20 39436 33.03 MB/sec execute 112 sec latency 23.565 ms 20 39670 32.77 MB/sec execute 113 sec latency 389.516 ms 20 39834 32.55 MB/sec execute 114 sec latency 124.877 ms 20 40061 32.43 MB/sec execute 115 sec latency 112.355 ms 20 40440 32.58 MB/sec execute 116 sec latency 109.154 ms 20 40759 32.54 MB/sec execute 117 sec latency 105.675 ms 20 41069 32.31 MB/sec execute 118 sec latency 81.022 ms 20 41449 32.30 MB/sec execute 119 sec latency 111.875 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 124141 9.511 59.103 Close 91305 2.109 25.953 Rename 5328 12.202 41.963 Unlink 25044 3.455 44.988 Qpathinfo 112729 2.128 42.336 Qfileinfo 19853 0.064 13.068 Qfsinfo 20735 0.024 4.559 Sfileinfo 10304 5.382 29.290 Find 43652 0.395 45.197 WriteX 61802 0.740 22.532 ReadX 196572 0.009 2.782 LockX 422 2.711 13.228 UnlockX 422 2.569 14.384 Flush 8693 58.360 389.509 Throughput 32.296 MB/sec 20 clients 20 procs max_latency=389.516 ms stopping dbench on /mnt/lustre/d0.oleg358-client.virtnet at Fri Jul 19 12:22:04 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg358-client.virtnet /mnt/lustre/d0.oleg358-client.virtnet /mnt/lustre/d0.oleg358-client.virtnet removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg358-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 12:22:06 (1721406126) min OST has 3116032kB available, using 4674048kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6829] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4564] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg358-clien 4564M 147392 98 130715 98 303080 86 2187 133 Latency 1852us 38676us 37145us 248ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg358-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 465 16 3442 17 664 12 521 15 669 14 763 12 Latency 15743us 9932us 74162us 15619us 8513us 12535us 1.97,1.97,oleg358-client.virtnet,1,1721414871,4564M,,,,147392,98,130715,98,,,303080,86,2187,133,10,,,,,465,16,3442,17,664,12,521,15,669,14,763,12,,1852us,38676us,,37145us,248ms,15743us,9932us,74162us,15619us,8513us,12535us debug=0x33f0484 PASS bonnie (181s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 12:25:08 (1721406308) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 22943 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 22943 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x565e3 truncating to largest ever: 0x15de8b truncating to largest ever: 0x3ab5e4 truncating to largest ever: 0x48f03d truncating to largest ever: 0x525369 truncating to largest ever: 0x54c0fb truncating to largest ever: 0x55c6bd 001000 1721406311.962775 mapread 0x1e63fd thru 0x1eefc6 (0x8bca bytes) truncating to largest ever: 0x560fe4 005000 1721406325.574982 trunc from 0x301dcc to 0x1cbd68 (0x136063 bytes) 006000 1721406328.766440 mapwrite 0x0cfe4b thru 0x0d974a (0x9900 bytes) 008000 1721406335.729817 mapread 0x169f04 thru 0x1740dc (0xa1d9 bytes) 010000 1721406342.300828 mapread 0x060c05 thru 0x066ced (0x60e9 bytes) truncating to largest ever: 0x56189b 011000 1721406345.942984 write 0x4c84db thru 0x4ccdff (0x4925 bytes) 012000 1721406349.441969 trunc from 0x4c987f to 0x0dbfb2 (0x3ed8cc bytes) 014000 1721406356.085904 write 0x400a17 thru 0x406d00 (0x62ea bytes) 015000 1721406359.851701 read 0x180a54 thru 0x18aed7 (0xa484 bytes) 019000 1721406374.297833 trunc from 0x111b91 to 0x1168d9 (0x4d49 bytes) 020000 1721406377.579862 mapwrite 0x232672 thru 0x236898 (0x4227 bytes) 021000 1721406380.969816 mapwrite 0x0a32ae thru 0x0af1e5 (0xbf38 bytes) truncating to largest ever: 0x562d88 022000 1721406384.287872 mapwrite 0x0327ae thru 0x03e384 (0xbbd7 bytes) 024000 1721406390.513053 mapread 0x26d0f6 thru 0x275e6e (0x8d79 bytes) 025000 1721406393.767081 mapwrite 0x3e0ceb thru 0x3e9de7 (0x90fd bytes) 026000 1721406396.889752 mapwrite 0x2e772b thru 0x2e8d94 (0x166a bytes) 027000 1721406400.318850 mapwrite 0x29cbc2 thru 0x2a6313 (0x9752 bytes) 028000 1721406403.217835 write 0x0dd8f7 thru 0x0deb1c (0x1226 bytes) 030000 1721406410.206282 trunc from 0x4b0b1d to 0x4f5c1c (0x45100 bytes) 032000 1721406416.932821 trunc from 0x06c15c to 0x46ba13 (0x3ff8b8 bytes) 034000 1721406424.447161 write 0x009f58 thru 0x00d11f (0x31c8 bytes) 036000 1721406431.253198 mapread 0x1b539e thru 0x1baf39 (0x5b9c bytes) 037000 1721406434.235687 trunc from 0x18c7d7 to 0x535e57 (0x3a9681 bytes) 039000 1721406441.003810 write 0x547c24 thru 0x55289f (0xac7c bytes) 040000 1721406444.342028 mapwrite 0x28e3ba thru 0x2913c0 (0x3007 bytes) 041000 1721406447.401449 read 0x257400 thru 0x257578 (0x179 bytes) 042000 1721406450.593957 mapwrite 0x3d5106 thru 0x3e3a9e (0xe999 bytes) 043000 1721406454.109443 write 0x001d93 thru 0x011128 (0xf396 bytes) 045000 1721406460.982220 trunc from 0x562e00 to 0x11f8b2 (0x44354d bytes) 047000 1721406468.401806 trunc from 0x55526b to 0x38fd7e (0x1c54ec bytes) 049000 1721406474.742779 trunc from 0x4753a1 to 0x31a353 (0x15b04d bytes) 052000 1721406485.231548 mapwrite 0x5459a0 thru 0x554ef9 (0xf55a bytes) 053000 1721406488.370787 trunc from 0x36dc56 to 0x0f3810 (0x27a445 bytes) 058000 1721406506.034587 read 0x175479 thru 0x177509 (0x2091 bytes) 060000 1721406513.274535 trunc from 0x554f30 to 0x240852 (0x3146dd bytes) 061000 1721406516.527968 mapread 0x3436c6 thru 0x343c8c (0x5c7 bytes) 063000 1721406523.476941 mapwrite 0x15209f thru 0x15a629 (0x858b bytes) 064000 1721406527.434220 mapread 0x0002fd thru 0x0067c4 (0x64c8 bytes) 065000 1721406531.331245 read 0x0d805d thru 0x0dc6ca (0x466e bytes) 066000 1721406534.904292 trunc from 0x4bb8da to 0x54c597 (0x90cbe bytes) 067000 1721406538.002057 write 0x4d0dca thru 0x4d226f (0x14a6 bytes) 069000 1721406545.424527 read 0x161afc thru 0x16fd5d (0xe262 bytes) 070000 1721406548.646890 mapread 0x2025f5 thru 0x20843c (0x5e48 bytes) 076000 1721406569.402329 read 0x2558cc thru 0x25d336 (0x7a6b bytes) 077000 1721406572.897273 mapwrite 0x2c0338 thru 0x2c1520 (0x11e9 bytes) 080000 1721406582.978650 write 0x1fb89b thru 0x206ea3 (0xb609 bytes) 081000 1721406586.838507 trunc from 0x080461 to 0x1488fa (0xc849a bytes) 083000 1721406594.454623 read 0x036ef5 thru 0x03a1b3 (0x32bf bytes) 084000 1721406597.697767 read 0x0c8aab thru 0x0cc5cb (0x3b21 bytes) 086000 1721406604.480816 trunc from 0x1ca03c to 0x548515 (0x37e4da bytes) 087000 1721406608.199325 mapwrite 0x455ba8 thru 0x45b9b9 (0x5e12 bytes) 089000 1721406615.012240 mapread 0x2ecd21 thru 0x2ed4c7 (0x7a7 bytes) 090000 1721406618.849758 mapread 0x1f20e8 thru 0x1fda6f (0xb988 bytes) 091000 1721406622.814536 read 0x081cd4 thru 0x088837 (0x6b64 bytes) 092000 1721406626.128981 trunc from 0x4d3232 to 0x0dc742 (0x3f6aef bytes) 094000 1721406632.582504 mapread 0x349867 thru 0x34b503 (0x1c9d bytes) 095000 1721406635.740753 mapwrite 0x462d3d thru 0x472610 (0xf8d4 bytes) 096000 1721406639.331683 mapread 0x0d6312 thru 0x0d920e (0x2efd bytes) 097000 1721406642.621830 trunc from 0x54b538 to 0x21e65b (0x32cedc bytes) 098000 1721406646.475306 mapwrite 0x3c46d7 thru 0x3d0155 (0xba7f bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (346s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 12:30:54 (1721406654) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1721406666.140196 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1721406669.164649 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1721406676.317560 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1721406680.363091 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1721406685.637837 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1721406711.311399 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1721406714.792881 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1721406718.850184 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1721406729.346988 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1721406735.151072 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1721406738.911726 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1721406746.844377 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1721406750.758633 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1721406760.479543 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1721406765.318664 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1721406770.379176 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1721406782.374808 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1721406786.055738 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1721406797.883665 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1721406814.951278 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1721406819.310081 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1721406823.881505 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1721406828.849111 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1721406833.007785 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1721406859.509622 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1721406863.851037 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1721406874.178365 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1721406897.200906 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1721406922.728383 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1721406935.994226 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1721406943.433669 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1721406953.242786 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1721406966.694152 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1721406976.159724 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1721406980.170051 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1721406984.238911 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1721407002.021488 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1721407005.550841 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1721407009.051663 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1721407016.101182 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1721407023.782428 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1721407027.814909 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1721407039.954958 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1721407048.449847 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1721407052.753773 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1721407056.630185 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1721407061.157199 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1721407067.492796 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1721407073.270791 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1721407077.683082 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1721407098.111545 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1721407102.198116 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1721407111.321138 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (461s) == sanity-benchmark test complete, duration 1146 sec ===== 12:38:35 (1721407115)