-----============= acceptance-small: sanity-benchmark ============----- Tue Jun 9 19:08:09 EDT 2026 oleg112-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-benchmark.*ex': No such file or directory excepting tests: skipping tests SLOW=no: iozone oleg112-client.virtnet: executing check_config_client /mnt/lustre oleg112-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg112-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff977852355000.idle_timeout=debug osc.lustre-OST0001-osc-ffff977852355000.idle_timeout=debug disable quota as required oleg112-server: oleg112-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 19:08:30 (1781046510) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7687] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg112-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg112-client.virtnet at Tue Jun 9 19:08:32 EDT 2026 waiting for dbench pid 9843 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 16 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 66 57.55 MB/sec warmup 1 sec latency 133.283 ms 20 153 64.67 MB/sec warmup 2 sec latency 168.073 ms 20 229 58.72 MB/sec warmup 3 sec latency 112.813 ms 20 311 56.91 MB/sec warmup 4 sec latency 94.948 ms 20 405 57.38 MB/sec warmup 5 sec latency 101.593 ms 20 515 59.66 MB/sec warmup 6 sec latency 96.922 ms 20 648 60.19 MB/sec warmup 7 sec latency 598.895 ms 20 666 52.83 MB/sec warmup 8 sec latency 1604.068 ms 20 773 47.42 MB/sec warmup 9 sec latency 1644.642 ms 20 875 43.27 MB/sec warmup 10 sec latency 68.512 ms 20 947 39.59 MB/sec warmup 11 sec latency 76.303 ms 20 1080 38.17 MB/sec warmup 12 sec latency 61.675 ms 20 1206 35.43 MB/sec warmup 13 sec latency 62.993 ms 20 1413 37.13 MB/sec warmup 14 sec latency 55.985 ms 20 1509 34.72 MB/sec warmup 15 sec latency 98.644 ms 20 1651 32.72 MB/sec warmup 16 sec latency 69.596 ms 20 1808 30.95 MB/sec warmup 17 sec latency 62.562 ms 20 1970 29.37 MB/sec warmup 18 sec latency 48.431 ms 20 2100 28.03 MB/sec warmup 19 sec latency 53.133 ms 20 2200 26.74 MB/sec warmup 20 sec latency 68.855 ms 20 2374 26.58 MB/sec warmup 21 sec latency 61.991 ms 20 2465 25.84 MB/sec warmup 22 sec latency 59.590 ms 20 2620 25.54 MB/sec warmup 23 sec latency 71.396 ms 20 3059 13.72 MB/sec execute 1 sec latency 87.496 ms 20 3303 22.53 MB/sec execute 2 sec latency 81.559 ms 20 3514 34.40 MB/sec execute 3 sec latency 61.433 ms 20 3626 27.83 MB/sec execute 4 sec latency 71.664 ms 20 3712 23.58 MB/sec execute 5 sec latency 88.844 ms 20 3812 22.45 MB/sec execute 6 sec latency 96.784 ms 20 3868 19.29 MB/sec execute 7 sec latency 140.691 ms 20 3943 17.59 MB/sec execute 8 sec latency 98.002 ms 20 4010 15.63 MB/sec execute 9 sec latency 106.793 ms 20 4097 14.11 MB/sec execute 10 sec latency 82.206 ms 20 4200 12.95 MB/sec execute 11 sec latency 106.377 ms 20 4253 12.10 MB/sec execute 12 sec latency 145.068 ms 20 4321 11.42 MB/sec execute 13 sec latency 92.203 ms 20 4378 10.81 MB/sec execute 14 sec latency 323.485 ms 20 4456 10.34 MB/sec execute 15 sec latency 85.492 ms 20 4517 9.86 MB/sec execute 16 sec latency 90.510 ms 20 4605 10.31 MB/sec execute 17 sec latency 78.434 ms 20 4707 10.09 MB/sec execute 18 sec latency 73.763 ms 20 4787 9.64 MB/sec execute 19 sec latency 78.861 ms 20 4922 11.25 MB/sec execute 20 sec latency 84.475 ms 20 5029 11.54 MB/sec execute 21 sec latency 86.960 ms 20 5106 11.07 MB/sec execute 22 sec latency 90.401 ms 20 5195 10.66 MB/sec execute 23 sec latency 70.866 ms 20 5270 10.27 MB/sec execute 24 sec latency 82.786 ms 20 5344 9.90 MB/sec execute 25 sec latency 98.871 ms 20 5415 9.57 MB/sec execute 26 sec latency 88.456 ms 20 5543 9.30 MB/sec execute 27 sec latency 63.252 ms 20 5651 9.09 MB/sec execute 28 sec latency 75.338 ms 20 5757 8.85 MB/sec execute 29 sec latency 63.429 ms 20 5902 9.28 MB/sec execute 30 sec latency 88.772 ms 20 5984 9.14 MB/sec execute 31 sec latency 79.569 ms 20 6103 9.34 MB/sec execute 32 sec latency 64.249 ms 20 6242 10.07 MB/sec execute 33 sec latency 80.032 ms 20 6501 11.50 MB/sec execute 34 sec latency 85.840 ms 20 6715 11.52 MB/sec execute 35 sec latency 87.118 ms 20 6977 12.50 MB/sec execute 36 sec latency 71.102 ms 20 7172 13.33 MB/sec execute 37 sec latency 51.070 ms 20 7299 13.43 MB/sec execute 38 sec latency 64.064 ms 20 7401 13.26 MB/sec execute 39 sec latency 72.539 ms 20 7510 13.07 MB/sec execute 40 sec latency 62.807 ms 20 7568 12.75 MB/sec execute 41 sec latency 169.222 ms 20 7680 12.46 MB/sec execute 42 sec latency 81.022 ms 20 7778 12.24 MB/sec execute 43 sec latency 117.012 ms 20 7874 12.07 MB/sec execute 44 sec latency 133.502 ms 20 7976 11.91 MB/sec execute 45 sec latency 170.751 ms 20 8071 11.75 MB/sec execute 46 sec latency 80.246 ms 20 8191 11.93 MB/sec execute 47 sec latency 56.252 ms 20 8307 11.77 MB/sec execute 48 sec latency 69.399 ms 20 8463 12.35 MB/sec execute 49 sec latency 78.376 ms 20 8580 12.49 MB/sec execute 50 sec latency 101.877 ms 20 8677 12.28 MB/sec execute 51 sec latency 63.239 ms 20 8782 12.08 MB/sec execute 52 sec latency 78.590 ms 20 8894 11.89 MB/sec execute 53 sec latency 54.411 ms 20 8995 11.70 MB/sec execute 54 sec latency 59.824 ms 20 9111 11.53 MB/sec execute 55 sec latency 60.715 ms 20 9235 11.38 MB/sec execute 56 sec latency 58.752 ms 20 9366 11.36 MB/sec execute 57 sec latency 60.619 ms 20 9480 11.42 MB/sec execute 58 sec latency 79.646 ms 20 9543 11.31 MB/sec execute 59 sec latency 74.629 ms 20 9638 11.33 MB/sec execute 60 sec latency 86.992 ms 20 9817 11.87 MB/sec execute 61 sec latency 78.318 ms 20 10039 12.41 MB/sec execute 62 sec latency 64.027 ms 20 10253 12.49 MB/sec execute 63 sec latency 81.298 ms 20 10461 12.76 MB/sec execute 64 sec latency 91.051 ms 20 10666 13.43 MB/sec execute 65 sec latency 58.478 ms 20 10796 13.37 MB/sec execute 66 sec latency 50.581 ms 20 10889 13.41 MB/sec execute 67 sec latency 90.478 ms 20 10977 13.26 MB/sec execute 68 sec latency 90.912 ms 20 11048 13.11 MB/sec execute 69 sec latency 137.452 ms 20 11119 12.93 MB/sec execute 70 sec latency 174.984 ms 20 11246 12.76 MB/sec execute 71 sec latency 80.316 ms 20 11333 12.63 MB/sec execute 72 sec latency 115.450 ms 20 11413 12.51 MB/sec execute 73 sec latency 74.613 ms 20 11489 12.39 MB/sec execute 74 sec latency 76.223 ms 20 11556 12.27 MB/sec execute 75 sec latency 304.626 ms 20 11626 12.17 MB/sec execute 76 sec latency 76.114 ms 20 11699 12.17 MB/sec execute 77 sec latency 89.848 ms 20 11774 12.12 MB/sec execute 78 sec latency 93.219 ms 20 11833 11.98 MB/sec execute 79 sec latency 122.733 ms 20 11900 11.89 MB/sec execute 80 sec latency 109.817 ms 20 12008 12.17 MB/sec execute 81 sec latency 111.449 ms 20 12087 12.25 MB/sec execute 82 sec latency 127.002 ms 20 12145 12.13 MB/sec execute 83 sec latency 155.172 ms 20 12223 12.01 MB/sec execute 84 sec latency 73.963 ms 20 12294 11.88 MB/sec execute 85 sec latency 87.563 ms 20 12355 11.75 MB/sec execute 86 sec latency 125.366 ms 20 12407 11.62 MB/sec execute 87 sec latency 129.975 ms 20 12476 11.51 MB/sec execute 88 sec latency 69.072 ms 20 12594 11.40 MB/sec execute 89 sec latency 90.250 ms 20 12693 11.30 MB/sec execute 90 sec latency 76.502 ms 20 12777 11.20 MB/sec execute 91 sec latency 79.011 ms 20 12852 11.11 MB/sec execute 92 sec latency 79.997 ms 20 12977 11.17 MB/sec execute 93 sec latency 81.259 ms 20 13046 11.12 MB/sec execute 94 sec latency 97.731 ms 20 13092 11.05 MB/sec execute 95 sec latency 112.253 ms 20 13165 11.04 MB/sec execute 96 sec latency 122.900 ms 20 13292 11.16 MB/sec execute 97 sec latency 83.103 ms 20 13483 11.53 MB/sec execute 98 sec latency 82.747 ms 20 13611 11.64 MB/sec execute 99 sec latency 113.821 ms 20 13815 11.70 MB/sec execute 100 sec latency 121.398 ms 20 13985 11.79 MB/sec execute 101 sec latency 80.810 ms 20 14165 12.20 MB/sec execute 102 sec latency 84.063 ms 20 14290 12.22 MB/sec execute 103 sec latency 71.227 ms 20 14400 12.27 MB/sec execute 104 sec latency 72.457 ms 20 14476 12.20 MB/sec execute 105 sec latency 84.496 ms 20 14537 12.12 MB/sec execute 106 sec latency 121.575 ms 20 14611 12.03 MB/sec execute 107 sec latency 135.533 ms 20 14690 11.92 MB/sec execute 108 sec latency 78.454 ms 20 14784 11.82 MB/sec execute 109 sec latency 135.856 ms 20 14859 11.73 MB/sec execute 110 sec latency 113.913 ms 20 14904 11.64 MB/sec execute 111 sec latency 163.800 ms 20 14941 11.55 MB/sec execute 112 sec latency 167.794 ms 20 14996 11.48 MB/sec execute 113 sec latency 106.733 ms 20 15078 11.41 MB/sec execute 114 sec latency 93.017 ms 20 15142 11.34 MB/sec execute 115 sec latency 97.354 ms 20 15204 11.33 MB/sec execute 116 sec latency 104.827 ms 20 15286 11.32 MB/sec execute 117 sec latency 112.342 ms 20 15358 11.25 MB/sec execute 118 sec latency 113.604 ms 20 15429 11.17 MB/sec execute 119 sec latency 99.138 ms 20 cleanup 120 sec 20 cleanup 121 sec 5 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 43723 30.668 174.954 Close 31638 8.283 56.925 Rename 1916 42.549 139.992 Unlink 9391 10.611 117.605 Qpathinfo 39349 6.759 109.498 Qfileinfo 6559 0.218 27.681 Qfsinfo 7702 0.083 21.925 Sfileinfo 3665 27.435 99.084 Find 15499 1.618 104.671 WriteX 21446 4.822 95.224 ReadX 68282 0.024 8.188 LockX 120 8.102 21.424 UnlockX 120 8.099 21.091 Flush 3216 35.671 323.474 Throughput 11.1729 MB/sec 20 clients 20 procs max_latency=323.485 ms stopping dbench on /mnt/lustre/d0.oleg112-client.virtnet at Tue Jun 9 19:10:59 EDT 2026 with return code 0 clean dbench files on /mnt/lustre/d0.oleg112-client.virtnet /mnt/lustre/d0.oleg112-client.virtnet /mnt/lustre/d0.oleg112-client.virtnet removed directory 'clients/client6/~dmtmp/ACCESS' removed directory 'clients/client6/~dmtmp/PM' removed directory 'clients/client6/~dmtmp/PWRPNT' removed directory 'clients/client6/~dmtmp/PARADOX' removed directory 'clients/client6/~dmtmp/SEED' removed directory 'clients/client6/~dmtmp/WORDPRO' removed directory 'clients/client6/~dmtmp/COREL' removed directory 'clients/client6/~dmtmp/EXCEL' removed directory 'clients/client6/~dmtmp/WORD' removed directory 'clients/client6/~dmtmp' removed directory 'clients/client6' removed directory 'clients/client9/~dmtmp/ACCESS' removed directory 'clients/client9/~dmtmp/WORD' removed directory 'clients/client9/~dmtmp/PM' removed directory 'clients/client9/~dmtmp/PARADOX' removed directory 'clients/client9/~dmtmp/SEED' removed directory 'clients/client9/~dmtmp/EXCEL' removed directory 'clients/client9/~dmtmp/WORDPRO' removed directory 'clients/client9/~dmtmp/PWRPNT' removed directory 'clients/client9/~dmtmp/COREL' removed directory 'clients/client9/~dmtmp' removed directory 'clients/client9' removed directory 'clients/client7/~dmtmp/ACCESS' removed directory 'clients/client7/~dmtmp/PM' removed directory 'clients/client7/~dmtmp/PWRPNT' removed directory 'clients/client7/~dmtmp/PARADOX' removed directory 'clients/client7/~dmtmp/SEED' removed directory 'clients/client7/~dmtmp/WORDPRO' removed directory 'clients/client7/~dmtmp/COREL' removed directory 'clients/client7/~dmtmp/EXCEL' removed directory 'clients/client7/~dmtmp/WORD' removed directory 'clients/client7/~dmtmp' removed directory 'clients/client7' removed directory 'clients/client14/~dmtmp/ACCESS' removed directory 'clients/client14/~dmtmp/WORD' removed directory 'clients/client14/~dmtmp/PM' removed directory 'clients/client14/~dmtmp/PARADOX' removed directory 'clients/client14/~dmtmp/SEED' removed directory 'clients/client14/~dmtmp/EXCEL' removed directory 'clients/client14/~dmtmp/WORDPRO' removed directory 'clients/client14/~dmtmp/PWRPNT' removed directory 'clients/client14/~dmtmp/COREL' removed directory 'clients/client14/~dmtmp' removed directory 'clients/client14' removed directory 'clients/client19/~dmtmp/ACCESS' removed directory 'clients/client19/~dmtmp/WORD' removed directory 'clients/client19/~dmtmp/PM' removed directory 'clients/client19/~dmtmp/PARADOX' removed directory 'clients/client19/~dmtmp/SEED' removed directory 'clients/client19/~dmtmp/EXCEL' removed directory 'clients/client19/~dmtmp/WORDPRO' removed directory 'clients/client19/~dmtmp/PWRPNT' removed directory 'clients/client19/~dmtmp/COREL' removed directory 'clients/client19/~dmtmp' removed directory 'clients/client19' removed directory 'clients/client11/~dmtmp/ACCESS' removed directory 'clients/client11/~dmtmp/WORD' removed directory 'clients/client11/~dmtmp/PM' removed directory 'clients/client11/~dmtmp/PARADOX' removed directory 'clients/client11/~dmtmp/SEED' removed directory 'clients/client11/~dmtmp/EXCEL' removed directory 'clients/client11/~dmtmp/WORDPRO' removed directory 'clients/client11/~dmtmp/PWRPNT' removed directory 'clients/client11/~dmtmp/COREL' removed directory 'clients/client11/~dmtmp' removed directory 'clients/client11' removed directory 'clients/client4/~dmtmp/ACCESS' removed directory 'clients/client4/~dmtmp/PM' removed directory 'clients/client4/~dmtmp/PWRPNT' removed directory 'clients/client4/~dmtmp/PARADOX' removed directory 'clients/client4/~dmtmp/SEED' removed directory 'clients/client4/~dmtmp/WORDPRO' removed directory 'clients/client4/~dmtmp/COREL' removed directory 'clients/client4/~dmtmp/EXCEL' removed directory 'clients/client4/~dmtmp/WORD' removed directory 'clients/client4/~dmtmp' removed directory 'clients/client4' removed directory 'clients/client16/~dmtmp/ACCESS' removed directory 'clients/client16/~dmtmp/WORD' removed directory 'clients/client16/~dmtmp/PM' removed directory 'clients/client16/~dmtmp/PARADOX' removed directory 'clients/client16/~dmtmp/SEED' removed directory 'clients/client16/~dmtmp/EXCEL' removed directory 'clients/client16/~dmtmp/WORDPRO' removed directory 'clients/client16/~dmtmp/PWRPNT' removed directory 'clients/client16/~dmtmp/COREL' removed directory 'clients/client16/~dmtmp' removed directory 'clients/client16' removed directory 'clients/client1/~dmtmp/ACCESS' removed directory 'clients/client1/~dmtmp/PM' removed directory 'clients/client1/~dmtmp/PWRPNT' removed directory 'clients/client1/~dmtmp/PARADOX' removed directory 'clients/client1/~dmtmp/SEED' removed directory 'clients/client1/~dmtmp/WORDPRO' removed directory 'clients/client1/~dmtmp/COREL' removed directory 'clients/client1/~dmtmp/EXCEL' removed directory 'clients/client1/~dmtmp/WORD' removed directory 'clients/client1/~dmtmp' removed directory 'clients/client1' removed directory 'clients/client0/~dmtmp/ACCESS' removed directory 'clients/client0/~dmtmp/PM' removed directory 'clients/client0/~dmtmp/PWRPNT' removed directory 'clients/client0/~dmtmp/PARADOX' removed directory 'clients/client0/~dmtmp/SEED' removed directory 'clients/client0/~dmtmp/WORDPRO' removed directory 'clients/client0/~dmtmp/COREL' removed directory 'clients/client0/~dmtmp/EXCEL' removed directory 'clients/client0/~dmtmp/WORD' removed directory 'clients/client0/~dmtmp' removed directory 'clients/client0' removed directory 'clients/client17/~dmtmp/ACCESS' removed directory 'clients/client17/~dmtmp/WORD' removed directory 'clients/client17/~dmtmp/PM' removed directory 'clients/client17/~dmtmp/PARADOX' removed directory 'clients/client17/~dmtmp/SEED' removed directory 'clients/client17/~dmtmp/EXCEL' removed directory 'clients/client17/~dmtmp/WORDPRO' removed directory 'clients/client17/~dmtmp/PWRPNT' removed directory 'clients/client17/~dmtmp/COREL' removed directory 'clients/client17/~dmtmp' removed directory 'clients/client17' removed directory 'clients/client2/~dmtmp/ACCESS' removed directory 'clients/client2/~dmtmp/PM' removed directory 'clients/client2/~dmtmp/PWRPNT' removed directory 'clients/client2/~dmtmp/PARADOX' removed directory 'clients/client2/~dmtmp/SEED' removed directory 'clients/client2/~dmtmp/WORDPRO' removed directory 'clients/client2/~dmtmp/COREL' removed directory 'clients/client2/~dmtmp/EXCEL' removed directory 'clients/client2/~dmtmp/WORD' removed directory 'clients/client2/~dmtmp' removed directory 'clients/client2' removed directory 'clients/client3/~dmtmp/ACCESS' removed directory 'clients/client3/~dmtmp/PM' removed directory 'clients/client3/~dmtmp/PWRPNT' removed directory 'clients/client3/~dmtmp/PARADOX' removed directory 'clients/client3/~dmtmp/SEED' removed directory 'clients/client3/~dmtmp/WORDPRO' removed directory 'clients/client3/~dmtmp/COREL' removed directory 'clients/client3/~dmtmp/EXCEL' removed directory 'clients/client3/~dmtmp/WORD' removed directory 'clients/client3/~dmtmp' removed directory 'clients/client3' removed directory 'clients/client10/~dmtmp/ACCESS' removed directory 'clients/client10/~dmtmp/WORD' removed directory 'clients/client10/~dmtmp/PM' removed directory 'clients/client10/~dmtmp/PARADOX' removed directory 'clients/client10/~dmtmp/SEED' removed directory 'clients/client10/~dmtmp/EXCEL' removed directory 'clients/client10/~dmtmp/WORDPRO' removed directory 'clients/client10/~dmtmp/PWRPNT' removed directory 'clients/client10/~dmtmp/COREL' removed directory 'clients/client10/~dmtmp' removed directory 'clients/client10' removed directory 'clients/client13/~dmtmp/ACCESS' removed directory 'clients/client13/~dmtmp/WORD' removed directory 'clients/client13/~dmtmp/PM' removed directory 'clients/client13/~dmtmp/PARADOX' removed directory 'clients/client13/~dmtmp/SEED' removed directory 'clients/client13/~dmtmp/EXCEL' removed directory 'clients/client13/~dmtmp/WORDPRO' removed directory 'clients/client13/~dmtmp/PWRPNT' removed directory 'clients/client13/~dmtmp/COREL' removed directory 'clients/client13/~dmtmp' removed directory 'clients/client13' removed directory 'clients/client8/~dmtmp/ACCESS' removed directory 'clients/client8/~dmtmp/PM' removed directory 'clients/client8/~dmtmp/PWRPNT' removed directory 'clients/client8/~dmtmp/PARADOX' removed directory 'clients/client8/~dmtmp/SEED' removed directory 'clients/client8/~dmtmp/WORDPRO' removed directory 'clients/client8/~dmtmp/COREL' removed directory 'clients/client8/~dmtmp/EXCEL' removed directory 'clients/client8/~dmtmp/WORD' removed directory 'clients/client8/~dmtmp' removed directory 'clients/client8' removed directory 'clients/client12/~dmtmp/ACCESS' removed directory 'clients/client12/~dmtmp/PM' removed directory 'clients/client12/~dmtmp/PWRPNT' removed directory 'clients/client12/~dmtmp/PARADOX' removed directory 'clients/client12/~dmtmp/SEED' removed directory 'clients/client12/~dmtmp/WORDPRO' removed directory 'clients/client12/~dmtmp/COREL' removed directory 'clients/client12/~dmtmp/EXCEL' removed directory 'clients/client12/~dmtmp/WORD' removed directory 'clients/client12/~dmtmp' removed directory 'clients/client12' removed directory 'clients/client5/~dmtmp/ACCESS' removed directory 'clients/client5/~dmtmp/WORD' removed directory 'clients/client5/~dmtmp/PM' removed directory 'clients/client5/~dmtmp/PARADOX' removed directory 'clients/client5/~dmtmp/SEED' removed directory 'clients/client5/~dmtmp/EXCEL' removed directory 'clients/client5/~dmtmp/WORDPRO' removed directory 'clients/client5/~dmtmp/PWRPNT' removed directory 'clients/client5/~dmtmp/COREL' removed directory 'clients/client5/~dmtmp' removed directory 'clients/client5' removed directory 'clients/client15/~dmtmp/ACCESS' removed directory 'clients/client15/~dmtmp/WORD' removed directory 'clients/client15/~dmtmp/PM' removed directory 'clients/client15/~dmtmp/PARADOX' removed directory 'clients/client15/~dmtmp/SEED' removed directory 'clients/client15/~dmtmp/EXCEL' removed directory 'clients/client15/~dmtmp/WORDPRO' removed directory 'clients/client15/~dmtmp/PWRPNT' removed directory 'clients/client15/~dmtmp/COREL' removed directory 'clients/client15/~dmtmp' removed directory 'clients/client15' removed directory 'clients/client18/~dmtmp/ACCESS' removed directory 'clients/client18/~dmtmp/PM' removed directory 'clients/client18/~dmtmp/PWRPNT' removed directory 'clients/client18/~dmtmp/PARADOX' removed directory 'clients/client18/~dmtmp/SEED' removed directory 'clients/client18/~dmtmp/WORDPRO' removed directory 'clients/client18/~dmtmp/COREL' removed directory 'clients/client18/~dmtmp/EXCEL' removed directory 'clients/client18/~dmtmp/WORD' removed directory 'clients/client18/~dmtmp' removed directory 'clients/client18' removed directory 'clients' removed 'client.txt' /mnt/lustre/d0.oleg112-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 19:11:07 (1781046667) min OST has 3595568kB available, using 5393352kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7687] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5266] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.98 ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Name:Size etc /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP oleg112-clien 5266M 72.9m 76 78.4m 85 146m 43 2186 185 Latency 13513us 161ms 105ms 12354us Version 1.98 ------Sequential Create------ --------Random Create-------- oleg112-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 0 13 0 13 0 10 0 13 0 10 0 10 Latency 33505us 18348us 119ms 41379us 23915us 79115us 1.98,1.98,oleg112-client.virtnet,1,1781052520,5266M,,8192,5,,,74694,76,80328,85,,,149187,43,2186,185,10,,,,,158,13,1283,13,233,10,156,13,200,10,246,10,,13513us,161ms,,105ms,12354us,33505us,18348us,119ms,41379us,23915us,79115us debug=0x33f0484 PASS bonnie (463s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 19:18:51 (1781047131) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 32434 -P /tmp -l 5408064 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 32434 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole skipping zero size read skipping zero size read truncating to largest ever: 0x4ca5fa fallocating to largest ever: 0x4e2881 truncating to largest ever: 0x51041c 001000 1781047139.532308 fallocate 0x19e0e8 thru 0x1a6b00 (0x8a19 bytes) fallocating to largest ever: 0x51e2e7 fallocating to largest ever: 0x527af8 fallocating to largest ever: 0x528540 002000 1781047145.209093 mapwrite 0x0da7cf thru 0x0da965 (0x197 bytes) 003000 1781047150.808865 write 0x0855b5 thru 0x090b4b (0xb597 bytes) 004000 1781047156.531180 write 0x263708 thru 0x267958 (0x4251 bytes) 005000 1781047162.400249 trunc from 0x44d238 to 0x06eaeb (0x3de74c bytes) 007000 1781047173.234827 fallocate 0x4ebf0d thru 0x4ec3df (0x4d3 bytes) 008000 1781047178.674265 fallocate 0x15a668 thru 0x16a4e9 (0xfe82 bytes) 011000 1781047194.087994 write 0x264e17 thru 0x26541a (0x604 bytes) 012000 1781047199.388309 fallocate 0x457b50 thru 0x466721 (0xebd2 bytes) 013000 1781047205.184114 read 0x1c26bc thru 0x1c98db (0x7220 bytes) 014000 1781047210.337984 mapwrite 0x488fc1 thru 0x495e5c (0xce9c bytes) 015000 1781047215.204335 mapread 0x25a040 thru 0x266835 (0xc7f6 bytes) 016000 1781047220.947668 write 0x350d6e thru 0x35d358 (0xc5eb bytes) 017000 1781047225.860738 write 0x510a93 thru 0x51d3dc (0xc94a bytes) 018000 1781047231.598637 mapread 0x187039 thru 0x1943f3 (0xd3bb bytes) 019000 1781047238.214716 write 0x28a243 thru 0x28c42c (0x21ea bytes) 020000 1781047242.996334 punch from 0x278ee0 to 0x2875a3 (0xe6c4 bytes) 022000 1781047255.110037 read 0x266959 thru 0x26ed36 (0x83de bytes) 023000 1781047261.544258 read 0x41333d thru 0x416be1 (0x38a5 bytes) 024000 1781047267.072338 fallocate 0x326d31 thru 0x326db6 (0x86 bytes) 027000 1781047279.199631 trunc from 0x3eefa6 to 0x278bf2 (0x1763b3 bytes) 028000 1781047283.719106 mapread 0x0f5d9c thru 0x0fcab9 (0x6d1e bytes) 029000 1781047288.538261 read 0x2c8b9a thru 0x2cc613 (0x3a7a bytes) 031000 1781047297.118628 write 0x4b61e7 thru 0x4bb6eb (0x5505 bytes) 033000 1781047306.989266 write 0x3c4d7c thru 0x3d3d86 (0xf00b bytes) 034000 1781047312.035607 punch from 0x37251c to 0x381f7d (0xfa62 bytes) 035000 1781047316.583830 mapread 0x19c736 thru 0x1a8532 (0xbdfd bytes) 038000 1781047330.808591 trunc from 0x101d8f to 0x369e95 (0x268107 bytes) 039000 1781047335.824285 punch from 0x195c17 to 0x19bc8c (0x6076 bytes) 040000 1781047340.041380 trunc from 0x4dfe03 to 0x278739 (0x2676c9 bytes) 041000 1781047344.327797 punch from 0x4f1a63 to 0x4ff959 (0xdef7 bytes) 042000 1781047349.020661 mapwrite 0x1921d5 thru 0x19303b (0xe67 bytes) 043000 1781047353.186560 trunc from 0x405a21 to 0x2dc46d (0x1295b3 bytes) 044000 1781047358.238588 read 0x30e61c thru 0x3141a9 (0x5b8e bytes) 045000 1781047363.773807 mapread 0x087752 thru 0x08f4e6 (0x7d95 bytes) 049000 1781047387.409777 punch from 0x13e0ec to 0x14c0f0 (0xe005 bytes) 050000 1781047393.648089 fallocate 0x1edca6 thru 0x1f78d5 (0x9c30 bytes) 051000 1781047400.413007 write 0x1221cb thru 0x129e7d (0x7cb3 bytes) 052000 1781047407.345195 mapread 0x0d5048 thru 0x0da597 (0x5550 bytes) 053000 1781047413.210644 punch from 0x08f86b to 0x092f52 (0x36e8 bytes) 054000 1781047418.632263 read 0x38787a thru 0x388d94 (0x151b bytes) 055000 1781047424.143330 fallocate 0x40ec76 thru 0x411f9a (0x3325 bytes) 056000 1781047429.874757 fallocate 0x300c5c thru 0x30991d (0x8cc2 bytes) 057000 1781047434.861112 mapread 0x04bb0e thru 0x04d4db (0x19ce bytes) 058000 1781047440.418932 read 0x38902d thru 0x39553f (0xc513 bytes) 059000 1781047445.665710 write 0x3ad6b4 thru 0x3aed19 (0x1666 bytes) 060000 1781047450.242825 write 0x315360 thru 0x31bd74 (0x6a15 bytes) 063000 1781047465.396448 write 0x06d3ef thru 0x074b39 (0x774b bytes) 064000 1781047470.648588 mapwrite 0x0337b0 thru 0x03a0b1 (0x6902 bytes) 065000 1781047476.516303 write 0x12fb6f thru 0x132b17 (0x2fa9 bytes) 066000 1781047481.784054 write 0x0a00b6 thru 0x0ae2b2 (0xe1fd bytes) 067000 1781047486.404977 trunc from 0x4cdeae to 0x26933e (0x264b6f bytes) 069000 1781047497.424482 trunc from 0x401dd7 to 0x206acd (0x1fb309 bytes) 070000 1781047502.253289 fallocate 0x437b14 thru 0x444670 (0xcb5d bytes) 071000 1781047509.320765 read 0x2e3e6f thru 0x2f012c (0xc2be bytes) 072000 1781047514.143666 read 0x220574 thru 0x220a2b (0x4b8 bytes) 073000 1781047519.552903 mapwrite 0x120d46 thru 0x12952a (0x87e5 bytes) 074000 1781047524.181355 punch from 0x0ad351 to 0x0bbb87 (0xe837 bytes) 075000 1781047529.166386 punch from 0x29413b to 0x295f52 (0x1e18 bytes) 078000 1781047542.892861 punch from 0x070926 to 0x0743bc (0x3a97 bytes) 079000 1781047546.785066 read 0x18b97e thru 0x1978a3 (0xbf26 bytes) 080000 1781047551.032985 fallocate 0x4de08d thru 0x4e09fb (0x296f bytes) 081000 1781047554.317671 write 0x0da4a8 thru 0x0e6b31 (0xc68a bytes) 083000 1781047562.020928 read 0x2acf1e thru 0x2bb121 (0xe204 bytes) 084000 1781047566.145615 write 0x113653 thru 0x1199ac (0x635a bytes) skipping zero size read 085000 1781047569.913177 punch from 0x100239 to 0x10d420 (0xd1e8 bytes) 087000 1781047577.716470 mapread 0x454f20 thru 0x46124f (0xc330 bytes) 088000 1781047581.607795 punch from 0x05ef86 to 0x066d62 (0x7ddd bytes) 089000 1781047585.421697 mapwrite 0x058045 thru 0x0588b9 (0x875 bytes) 090000 1781047589.437957 mapread 0x0f160f thru 0x0fa44d (0x8e3f bytes) 092000 1781047597.420917 mapread 0x0c5657 thru 0x0cd209 (0x7bb3 bytes) 093000 1781047600.927489 write 0x063e26 thru 0x065bf3 (0x1dce bytes) 095000 1781047608.868084 write 0x40c9a5 thru 0x40cba0 (0x1fc bytes) 096000 1781047612.638909 fallocate 0x278388 thru 0x283c0e (0xb887 bytes) 097000 1781047616.063667 fallocate 0x06a7f1 thru 0x071c75 (0x7485 bytes) 099000 1781047622.927783 write 0x3d2619 thru 0x3d5ffb (0x39e3 bytes) 100000 1781047626.905643 write 0x39a90a thru 0x39d4f9 (0x2bf0 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (497s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 19:27:08 (1781047628) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1781047633.565230 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1781047637.164134 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1781047652.766400 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1781047656.726100 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1781047660.575218 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1781047664.995686 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1781047669.111844 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1781047676.223545 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1781047679.872863 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1781047687.592404 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1781047692.444777 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1781047700.429355 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1781047703.696645 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1781047712.183632 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1781047716.670089 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1781047721.138447 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1781047726.775710 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1781047731.675657 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1781047736.945360 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1781047740.969847 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1781047745.191553 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1781047753.472372 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1781047757.094650 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1781047760.731661 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1781047764.674980 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1781047769.114373 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1781047773.514136 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1781047777.372215 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1781047781.355741 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1781047785.779106 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1781047789.660713 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1781047793.398636 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1781047800.389342 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1781047804.232598 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1781047807.871344 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1781047811.523598 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1781047823.178484 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1781047827.115146 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1781047830.741489 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1781047834.845775 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1781047838.761416 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1781047842.557460 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1781047852.914618 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1781047856.659331 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1781047860.658659 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1781047873.494859 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1781047881.414439 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1781047884.781326 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1781047888.376839 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1781047895.765961 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1781047903.687285 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1781047907.658418 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1781047911.910351 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1781047922.146164 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1781047926.406485 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1781047931.117357 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1781047935.114965 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1781047939.671592 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1781047943.729061 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1781047952.050972 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1781047960.640554 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1781047964.778489 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1781047968.763379 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1781047973.618849 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1781047981.920516 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1781047991.084168 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1781047999.681330 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1781048003.632111 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1781048007.184563 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1781048010.727235 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1781048014.405285 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1781048022.525547 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1781048026.252751 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1781048029.972755 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1781048037.187251 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (410s) == sanity-benchmark test complete, duration 1548 sec ===== 19:33:58 (1781048038)