-----============= acceptance-small: sanity-benchmark ============----- Sat May 11 16:54:00 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg211-client.virtnet: executing check_config_client /mnt/lustre oleg211-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg211-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6f59800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6f59800.idle_timeout=debug disable quota as required oleg211-server: oleg211-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 16:54:09 (1715460849) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6844] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg211-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg211-client.virtnet at Sat May 11 16:54:09 EDT 2024 waiting for dbench pid 8773 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 213 166.29 MB/sec warmup 1 sec latency 88.256 ms 20 444 156.23 MB/sec warmup 2 sec latency 45.960 ms 20 689 141.23 MB/sec warmup 3 sec latency 264.795 ms 20 874 108.24 MB/sec warmup 4 sec latency 101.377 ms 20 1083 91.67 MB/sec warmup 5 sec latency 111.543 ms 20 1422 86.70 MB/sec warmup 6 sec latency 123.856 ms 20 1632 74.79 MB/sec warmup 7 sec latency 467.264 ms 20 1815 65.83 MB/sec warmup 8 sec latency 1467.386 ms 20 1984 59.60 MB/sec warmup 9 sec latency 2467.507 ms 20 2145 55.50 MB/sec warmup 10 sec latency 3467.571 ms 20 2364 53.98 MB/sec warmup 11 sec latency 4467.670 ms 20 2558 51.46 MB/sec warmup 12 sec latency 5467.774 ms 20 2714 49.74 MB/sec warmup 13 sec latency 6467.880 ms 20 2815 47.00 MB/sec warmup 14 sec latency 7467.968 ms 20 2912 44.40 MB/sec warmup 15 sec latency 8468.109 ms 20 2998 41.88 MB/sec warmup 16 sec latency 9468.746 ms 20 3089 39.78 MB/sec warmup 17 sec latency 10468.849 ms 20 3181 37.94 MB/sec warmup 18 sec latency 11468.935 ms 20 3284 36.39 MB/sec warmup 19 sec latency 12469.068 ms 20 3395 35.18 MB/sec warmup 20 sec latency 13469.171 ms 20 3499 33.94 MB/sec warmup 21 sec latency 14469.280 ms 20 3607 32.77 MB/sec warmup 22 sec latency 15469.395 ms 20 3724 31.92 MB/sec warmup 23 sec latency 16469.547 ms 20 4015 17.70 MB/sec execute 1 sec latency 18469.752 ms 20 4116 15.85 MB/sec execute 2 sec latency 19470.691 ms 20 4226 14.65 MB/sec execute 3 sec latency 20470.798 ms 20 4329 12.71 MB/sec execute 4 sec latency 21470.878 ms 20 4430 12.12 MB/sec execute 5 sec latency 22471.011 ms 20 4537 11.55 MB/sec execute 6 sec latency 23471.099 ms 20 4662 11.56 MB/sec execute 7 sec latency 24471.171 ms 20 4781 11.74 MB/sec execute 8 sec latency 25471.973 ms 20 4909 11.74 MB/sec execute 9 sec latency 26472.150 ms 20 5036 12.19 MB/sec execute 10 sec latency 27472.234 ms 20 5169 12.59 MB/sec execute 11 sec latency 28472.367 ms 20 5290 12.58 MB/sec execute 12 sec latency 29472.473 ms 20 5399 12.48 MB/sec execute 13 sec latency 30472.596 ms 20 5501 12.23 MB/sec execute 14 sec latency 31472.683 ms 20 5614 12.29 MB/sec execute 15 sec latency 32472.830 ms 20 5766 12.64 MB/sec execute 16 sec latency 33473.045 ms 20 5863 12.61 MB/sec execute 17 sec latency 34473.209 ms 20 5966 12.61 MB/sec execute 18 sec latency 35473.298 ms 20 6117 12.83 MB/sec execute 19 sec latency 36473.455 ms 20 6230 12.86 MB/sec execute 20 sec latency 37473.554 ms 20 6316 12.46 MB/sec execute 21 sec latency 38473.700 ms 20 6428 12.40 MB/sec execute 22 sec latency 39473.860 ms 20 6566 12.72 MB/sec execute 23 sec latency 40473.962 ms 20 6691 12.71 MB/sec execute 24 sec latency 41474.086 ms 20 6804 12.66 MB/sec execute 25 sec latency 42474.169 ms 20 6951 12.89 MB/sec execute 26 sec latency 43474.283 ms 20 7077 12.87 MB/sec execute 27 sec latency 44474.457 ms 20 7179 12.62 MB/sec execute 28 sec latency 45474.569 ms 20 7306 12.75 MB/sec execute 29 sec latency 46474.668 ms 20 7430 12.93 MB/sec execute 30 sec latency 47474.746 ms 20 7548 12.84 MB/sec execute 31 sec latency 48474.853 ms 20 7668 12.74 MB/sec execute 32 sec latency 49474.995 ms 20 7794 12.74 MB/sec execute 33 sec latency 50475.152 ms 20 7921 12.88 MB/sec execute 34 sec latency 51475.263 ms 20 8055 12.88 MB/sec execute 35 sec latency 52475.360 ms 20 8171 12.94 MB/sec execute 36 sec latency 53475.450 ms 20 8279 12.83 MB/sec execute 37 sec latency 54475.709 ms 20 8431 13.00 MB/sec execute 38 sec latency 55476.018 ms 20 8571 13.16 MB/sec execute 39 sec latency 56476.158 ms 20 8689 13.05 MB/sec execute 40 sec latency 57476.233 ms 20 8786 12.80 MB/sec execute 41 sec latency 58476.324 ms 20 8895 12.74 MB/sec execute 42 sec latency 59476.427 ms 20 9045 12.90 MB/sec execute 43 sec latency 60476.542 ms 20 9165 12.94 MB/sec execute 44 sec latency 61476.691 ms 20 9302 13.03 MB/sec execute 45 sec latency 62476.780 ms 20 9424 13.00 MB/sec execute 46 sec latency 63476.884 ms 20 9541 12.96 MB/sec execute 47 sec latency 64476.963 ms 20 9670 12.98 MB/sec execute 48 sec latency 65477.137 ms 20 9814 13.12 MB/sec execute 49 sec latency 66477.230 ms 20 9934 13.11 MB/sec execute 50 sec latency 67477.339 ms 20 10036 12.94 MB/sec execute 51 sec latency 68477.426 ms 20 10148 12.88 MB/sec execute 52 sec latency 69477.516 ms 20 10284 12.96 MB/sec execute 53 sec latency 70477.613 ms 20 10425 13.08 MB/sec execute 54 sec latency 71477.701 ms 20 10561 13.07 MB/sec execute 55 sec latency 72477.803 ms 20 10684 13.08 MB/sec execute 56 sec latency 73477.963 ms 20 10812 13.11 MB/sec execute 57 sec latency 74478.060 ms 20 10953 13.22 MB/sec execute 58 sec latency 75478.228 ms 20 11099 13.31 MB/sec execute 59 sec latency 76478.321 ms 20 11211 13.29 MB/sec execute 60 sec latency 77478.468 ms 20 11312 13.20 MB/sec execute 61 sec latency 78478.591 ms 20 11420 13.10 MB/sec execute 62 sec latency 79478.698 ms 20 11528 13.02 MB/sec execute 63 sec latency 80478.801 ms 20 11681 13.12 MB/sec execute 64 sec latency 81478.894 ms 20 11820 13.19 MB/sec execute 65 sec latency 82479.010 ms 20 11924 13.11 MB/sec execute 66 sec latency 83479.103 ms 20 12027 13.05 MB/sec execute 67 sec latency 84479.200 ms 20 12179 13.17 MB/sec execute 68 sec latency 85479.294 ms 20 12304 13.22 MB/sec execute 69 sec latency 86479.378 ms 20 12410 13.18 MB/sec execute 70 sec latency 87479.481 ms 20 12513 13.09 MB/sec execute 71 sec latency 88479.578 ms 20 12643 13.13 MB/sec execute 72 sec latency 89479.676 ms 20 12792 13.18 MB/sec execute 73 sec latency 90479.763 ms 20 12913 13.24 MB/sec execute 74 sec latency 91479.858 ms 20 13038 13.24 MB/sec execute 75 sec latency 92479.943 ms 20 13127 13.14 MB/sec execute 76 sec latency 93480.021 ms 20 13240 13.12 MB/sec execute 77 sec latency 94480.116 ms 20 13365 13.09 MB/sec execute 78 sec latency 95480.196 ms 20 13471 13.03 MB/sec execute 79 sec latency 96480.268 ms 20 13603 13.01 MB/sec execute 80 sec latency 97480.369 ms 20 13736 13.07 MB/sec execute 81 sec latency 98480.461 ms 20 13872 13.18 MB/sec execute 82 sec latency 99480.563 ms 20 14024 13.28 MB/sec execute 83 sec latency 100480.635 ms 20 14145 13.26 MB/sec execute 84 sec latency 101480.735 ms 20 14243 13.17 MB/sec execute 85 sec latency 102480.826 ms 20 14376 13.18 MB/sec execute 86 sec latency 103480.954 ms 20 14506 13.24 MB/sec execute 87 sec latency 104481.078 ms 20 14645 13.28 MB/sec execute 88 sec latency 105481.163 ms 20 14754 13.27 MB/sec execute 89 sec latency 106481.315 ms 20 14861 13.24 MB/sec execute 90 sec latency 107481.423 ms 20 14969 13.16 MB/sec execute 91 sec latency 108481.527 ms 20 15077 13.14 MB/sec execute 92 sec latency 109481.621 ms 20 15186 13.07 MB/sec execute 93 sec latency 110481.724 ms 20 15301 13.05 MB/sec execute 94 sec latency 111481.821 ms 20 15437 13.05 MB/sec execute 95 sec latency 112481.931 ms 20 15575 13.12 MB/sec execute 96 sec latency 113482.046 ms 20 15716 13.16 MB/sec execute 97 sec latency 114482.138 ms 20 15823 13.12 MB/sec execute 98 sec latency 115482.250 ms 20 15939 13.12 MB/sec execute 99 sec latency 116482.348 ms 20 16066 13.13 MB/sec execute 100 sec latency 117482.437 ms 20 16194 13.17 MB/sec execute 101 sec latency 118482.551 ms 20 16329 13.20 MB/sec execute 102 sec latency 119482.659 ms 20 16453 13.22 MB/sec execute 103 sec latency 120482.733 ms 20 16561 13.19 MB/sec execute 104 sec latency 121482.828 ms 20 16642 13.10 MB/sec execute 105 sec latency 122482.927 ms 20 16746 13.06 MB/sec execute 106 sec latency 123483.007 ms 20 16874 13.09 MB/sec execute 107 sec latency 124483.104 ms 20 16987 13.03 MB/sec execute 108 sec latency 125483.187 ms 20 17083 12.98 MB/sec execute 109 sec latency 126483.291 ms 20 17209 13.03 MB/sec execute 110 sec latency 127483.415 ms 20 17351 13.06 MB/sec execute 111 sec latency 128483.520 ms 20 17474 13.06 MB/sec execute 112 sec latency 129483.616 ms 20 17576 13.03 MB/sec execute 113 sec latency 130483.714 ms 20 17679 12.98 MB/sec execute 114 sec latency 131483.825 ms 20 17834 13.05 MB/sec execute 115 sec latency 132483.926 ms 20 17967 13.09 MB/sec execute 116 sec latency 133484.071 ms 20 18077 13.09 MB/sec execute 117 sec latency 134484.197 ms 20 18188 13.05 MB/sec execute 118 sec latency 135484.293 ms 20 18306 13.03 MB/sec execute 119 sec latency 136484.388 ms 20 cleanup 120 sec 11 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 50558 19.420 138087.885 Close 37102 30.009 138960.433 Rename 2131 50.725 82757.107 Unlink 10268 18.484 50780.003 Qpathinfo 45644 0.949 38.164 Qfileinfo 7895 0.043 2.144 Qfsinfo 8396 0.025 1.596 Sfileinfo 4139 13.970 10414.031 Find 17604 0.217 10.210 WriteX 24817 0.427 6.571 ReadX 78466 0.011 3.557 LockX 160 3.508 35.151 UnlockX 160 4.917 85.957 Flush 3543 22.228 82.479 Throughput 13.0323 MB/sec 20 clients 20 procs max_latency=136484.388 ms stopping dbench on /mnt/lustre/d0.oleg211-client.virtnet at Sat May 11 16:56:35 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg211-client.virtnet /mnt/lustre/d0.oleg211-client.virtnet /mnt/lustre/d0.oleg211-client.virtnet removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg211-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (150s) == sanity-benchmark test bonnie: bonnie++ ================ 16:56:38 (1715460998) min OST has 3377152kB available, using 5065728kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6844] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4947] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg211-clien 4947M 160886 98 139096 98 315422 87 1782 122 Latency 6809us 27075us 43268us 288ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg211-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 486 16 3579 17 763 12 543 15 598 14 691 12 Latency 15377us 8565us 51234us 16461us 7588us 18924us 1.97,1.97,oleg211-client.virtnet,1,1715469415,4947M,,,,160886,98,139096,98,,,315422,87,1782,122,10,,,,,486,16,3579,17,763,12,543,15,598,14,691,12,,6809us,27075us,,43268us,288ms,15377us,8565us,51234us,16461us,7588us,18924us debug=0x33f0484 PASS bonnie (182s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 16:59:40 (1715461180) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 5263 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 5263 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x27ecfd truncating to largest ever: 0x316476 truncating to largest ever: 0x34c6fa truncating to largest ever: 0x3aa952 truncating to largest ever: 0x46803c truncating to largest ever: 0x47b1bd truncating to largest ever: 0x512043 truncating to largest ever: 0x51f297 truncating to largest ever: 0x555e34 truncating to largest ever: 0x556400 001000 1715461184.347152 mapread 0x07024e thru 0x073670 (0x3423 bytes) truncating to largest ever: 0x55a6a9 004000 1715461194.218455 read 0x3ef3f3 thru 0x3fec8a (0xf898 bytes) truncating to largest ever: 0x55b3e4 005000 1715461197.662995 mapread 0x04f8f6 thru 0x05a6ee (0xadf9 bytes) 006000 1715461200.904337 mapwrite 0x393ffa thru 0x394d49 (0xd50 bytes) 007000 1715461204.377666 mapwrite 0x2a0df9 thru 0x2af2e6 (0xe4ee bytes) truncating to largest ever: 0x55c86b truncating to largest ever: 0x562684 010000 1715461214.622286 write 0x345a24 thru 0x34a158 (0x4735 bytes) 012000 1715461221.258934 trunc from 0x002cde to 0x541385 (0x53e6a8 bytes) 014000 1715461227.894696 write 0x264582 thru 0x2690e6 (0x4b65 bytes) 015000 1715461231.069949 write 0x024e63 thru 0x026c91 (0x1e2f bytes) 016000 1715461234.161722 write 0x00d2af thru 0x0199f5 (0xc747 bytes) 017000 1715461237.561891 write 0x1608ad thru 0x16fb88 (0xf2dc bytes) skipping zero size write 020000 1715461247.727432 read 0x26a1fe thru 0x2715fa (0x73fd bytes) 024000 1715461261.003554 write 0x27a190 thru 0x27dd49 (0x3bba bytes) 025000 1715461264.435726 read 0x2c2dff thru 0x2c2e58 (0x5a bytes) 027000 1715461270.922855 mapread 0x3409ef thru 0x347bbb (0x71cd bytes) 029000 1715461277.433246 write 0x380c1d thru 0x38a144 (0x9528 bytes) skipping zero size read 031000 1715461283.701973 trunc from 0x4c94a9 to 0x433521 (0x95f87 bytes) 032000 1715461287.782406 mapread 0x2507ed thru 0x25b67a (0xae8e bytes) 033000 1715461290.856658 mapwrite 0x1c79a5 thru 0x1cb875 (0x3ed1 bytes) 034000 1715461294.167407 mapread 0x0af69a thru 0x0b2664 (0x2fcb bytes) 035000 1715461297.564076 write 0x1a3d94 thru 0x1ae80b (0xaa78 bytes) 037000 1715461304.230905 mapwrite 0x441ce8 thru 0x447172 (0x548b bytes) 041000 1715461317.469424 write 0x50c390 thru 0x511b17 (0x5788 bytes) 043000 1715461324.449191 read 0x181e8d thru 0x18c5b1 (0xa725 bytes) 044000 1715461327.730355 mapread 0x18edbb thru 0x1908d0 (0x1b16 bytes) 045000 1715461331.234651 mapread 0x489d3c thru 0x48c211 (0x24d6 bytes) 046000 1715461334.839903 mapwrite 0x44d793 thru 0x4566e0 (0x8f4e bytes) 047000 1715461337.557481 trunc from 0x48631e to 0x0d8fcf (0x3ad34e bytes) 048000 1715461341.002287 mapwrite 0x28c881 thru 0x29b00a (0xe78a bytes) 050000 1715461347.273309 write 0x06c9bc thru 0x06d8d8 (0xf1d bytes) 055000 1715461365.598299 write 0x554af2 thru 0x55844e (0x395d bytes) 056000 1715461368.798214 write 0x4aed9f thru 0x4b33f4 (0x4656 bytes) 057000 1715461373.142965 mapwrite 0x3e9cfe thru 0x3f0389 (0x668c bytes) truncating to largest ever: 0x56292a 060000 1715461386.937923 read 0x1cf1c2 thru 0x1d1538 (0x2377 bytes) 063000 1715461400.608635 mapwrite 0x0a638d thru 0x0a6b78 (0x7ec bytes) 064000 1715461404.177361 mapread 0x495b18 thru 0x499605 (0x3aee bytes) 065000 1715461408.633819 read 0x03c8ef thru 0x042ac3 (0x61d5 bytes) truncating to largest ever: 0x5629f6 067000 1715461418.813241 mapwrite 0x19df1a thru 0x1accbf (0xeda6 bytes) 068000 1715461423.717901 trunc from 0x416c11 to 0x194a12 (0x2821fe bytes) 069000 1715461428.575105 mapread 0x05c153 thru 0x06a645 (0xe4f3 bytes) 070000 1715461434.086518 mapwrite 0x31fd1c thru 0x3283d8 (0x86bd bytes) truncating to largest ever: 0x562c24 073000 1715461449.142858 trunc from 0x48f7f1 to 0x1219d0 (0x36de20 bytes) 074000 1715461452.114084 write 0x304364 thru 0x313a95 (0xf732 bytes) 076000 1715461460.941379 mapwrite 0x43cbc4 thru 0x44c52c (0xf969 bytes) 081000 1715461484.094307 mapread 0x11c298 thru 0x1286b2 (0xc41b bytes) 082000 1715461488.954048 write 0x199cc1 thru 0x19a822 (0xb62 bytes) 091000 1715461541.766986 write 0x13e2fa thru 0x1467a4 (0x84ab bytes) 093000 1715461554.756808 mapread 0x38537a thru 0x389a9c (0x4723 bytes) 094000 1715461559.445692 trunc from 0x32d0e8 to 0x2ac91c (0x807cb bytes) 096000 1715461572.007786 write 0x07c96e thru 0x08232c (0x59bf bytes) 097000 1715461577.514405 read 0x07f197 thru 0x089bc0 (0xaa2a bytes) 098000 1715461584.142662 trunc from 0x517698 to 0x0eff5a (0x42773d bytes) 099000 1715461591.110418 trunc from 0x4ab5c9 to 0x2d6945 (0x1d4c83 bytes) 100000 1715461596.969193 write 0x52268b thru 0x52e386 (0xbcfc bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (418s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 17:06:38 (1715461598) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1715461617.808892 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1715461623.196379 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1715461634.355262 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1715461641.788789 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1715461648.512002 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1715461686.683243 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1715461692.963138 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1715461699.719006 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1715461713.828761 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1715461720.816177 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1715461727.850024 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1715461742.788940 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1715461750.012890 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1715461765.255256 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1715461772.173094 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1715461778.437332 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1715461790.621393 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1715461797.693010 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1715461818.436298 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1715461843.453836 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1715461849.814948 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1715461857.057067 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1715461864.127289 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1715461870.707147 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1715461911.463889 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1715461918.332046 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1715461932.280135 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1715461962.637164 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1715461990.463290 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1715462004.849241 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1715462011.815199 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1715462026.212441 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1715462040.583703 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1715462053.545973 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1715462060.667555 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1715462068.403956 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1715462097.728539 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1715462104.364458 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1715462110.823356 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1715462125.348116 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1715462139.936841 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1715462147.552710 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1715462168.486895 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1715462181.551533 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1715462188.122063 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1715462195.490716 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1715462202.235427 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1715462209.766272 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1715462217.072285 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1715462223.880392 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1715462257.186590 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1715462264.730950 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1715462279.082000 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (689s) == sanity-benchmark test complete, duration 1447 sec ===== 17:18:07 (1715462287)