-----============= acceptance-small: sanity-benchmark ============----- Fri May 31 06:54:57 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg309-client.virtnet: executing check_config_client /mnt/lustre oleg309-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg309-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b02df800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b02df800.idle_timeout=debug disable quota as required oleg309-server: oleg309-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 06:55:06 (1717152906) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6843] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg309-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg309-client.virtnet at Fri May 31 06:55:07 EDT 2024 waiting for dbench pid 8773 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 189 151.76 MB/sec warmup 1 sec latency 86.359 ms 20 368 131.48 MB/sec warmup 2 sec latency 64.696 ms 20 584 132.98 MB/sec warmup 3 sec latency 68.205 ms 20 730 106.52 MB/sec warmup 4 sec latency 254.809 ms 20 860 86.40 MB/sec warmup 5 sec latency 307.106 ms 20 971 73.57 MB/sec warmup 6 sec latency 901.976 ms 20 1124 65.56 MB/sec warmup 7 sec latency 1902.087 ms 20 1226 59.15 MB/sec warmup 8 sec latency 2902.205 ms 20 1304 53.03 MB/sec warmup 9 sec latency 3902.286 ms 20 1382 48.09 MB/sec warmup 10 sec latency 4902.445 ms 20 1483 44.37 MB/sec warmup 11 sec latency 5902.537 ms 20 1620 42.02 MB/sec warmup 12 sec latency 6902.694 ms 20 1753 40.32 MB/sec warmup 13 sec latency 7902.884 ms 20 1895 39.33 MB/sec warmup 14 sec latency 8902.964 ms 20 2003 37.54 MB/sec warmup 15 sec latency 9903.077 ms 20 2065 35.53 MB/sec warmup 16 sec latency 10903.188 ms 20 2135 33.87 MB/sec warmup 17 sec latency 11903.336 ms 20 2189 32.15 MB/sec warmup 18 sec latency 12903.923 ms 20 2252 30.82 MB/sec warmup 19 sec latency 13904.096 ms 20 2326 29.65 MB/sec warmup 20 sec latency 14904.296 ms 20 2399 28.53 MB/sec warmup 21 sec latency 15904.480 ms 20 2463 27.48 MB/sec warmup 22 sec latency 16904.649 ms 20 2537 26.67 MB/sec warmup 23 sec latency 17904.872 ms 20 2666 4.14 MB/sec execute 1 sec latency 19905.080 ms 20 2742 4.76 MB/sec execute 2 sec latency 20905.328 ms 20 2813 5.36 MB/sec execute 3 sec latency 21905.458 ms 20 2918 7.99 MB/sec execute 4 sec latency 22905.890 ms 20 3023 8.65 MB/sec execute 5 sec latency 23905.983 ms 20 3131 9.21 MB/sec execute 6 sec latency 24906.074 ms 20 3250 10.55 MB/sec execute 7 sec latency 25906.237 ms 20 3356 10.72 MB/sec execute 8 sec latency 26906.315 ms 20 3446 10.95 MB/sec execute 9 sec latency 27906.456 ms 20 3523 10.50 MB/sec execute 10 sec latency 28906.604 ms 20 3586 10.05 MB/sec execute 11 sec latency 29906.776 ms 20 3672 10.02 MB/sec execute 12 sec latency 30906.857 ms 20 3751 10.33 MB/sec execute 13 sec latency 31907.034 ms 20 3816 9.84 MB/sec execute 14 sec latency 32907.175 ms 20 3888 9.54 MB/sec execute 15 sec latency 33907.280 ms 20 3970 9.26 MB/sec execute 16 sec latency 34907.356 ms 20 4052 8.98 MB/sec execute 17 sec latency 35907.421 ms 20 4152 9.11 MB/sec execute 18 sec latency 36907.512 ms 20 4258 9.29 MB/sec execute 19 sec latency 37907.689 ms 20 4364 9.42 MB/sec execute 20 sec latency 38908.009 ms 20 4487 9.83 MB/sec execute 21 sec latency 39908.163 ms 20 4583 9.70 MB/sec execute 22 sec latency 40908.230 ms 20 4675 9.79 MB/sec execute 23 sec latency 41908.336 ms 20 4776 9.78 MB/sec execute 24 sec latency 42908.436 ms 20 4890 10.03 MB/sec execute 25 sec latency 43908.542 ms 20 4989 10.08 MB/sec execute 26 sec latency 44908.670 ms 20 5087 10.20 MB/sec execute 27 sec latency 45908.793 ms 20 5173 10.10 MB/sec execute 28 sec latency 46908.879 ms 20 5257 9.96 MB/sec execute 29 sec latency 47908.957 ms 20 5353 9.78 MB/sec execute 30 sec latency 48909.041 ms 20 5444 9.76 MB/sec execute 31 sec latency 49909.195 ms 20 5556 9.88 MB/sec execute 32 sec latency 50909.283 ms 20 5673 10.07 MB/sec execute 33 sec latency 51909.379 ms 20 5782 10.18 MB/sec execute 34 sec latency 52909.480 ms 20 5853 10.05 MB/sec execute 35 sec latency 53909.622 ms 20 5918 9.84 MB/sec execute 36 sec latency 54909.697 ms 20 6007 9.72 MB/sec execute 37 sec latency 55909.810 ms 20 6114 9.90 MB/sec execute 38 sec latency 56909.887 ms 20 6193 9.89 MB/sec execute 39 sec latency 57910.046 ms 20 6303 9.96 MB/sec execute 40 sec latency 58910.177 ms 20 6415 9.99 MB/sec execute 41 sec latency 59910.278 ms 20 6497 9.98 MB/sec execute 42 sec latency 60910.396 ms 20 6593 10.00 MB/sec execute 43 sec latency 61910.513 ms 20 6702 10.05 MB/sec execute 44 sec latency 62910.620 ms 20 6828 10.25 MB/sec execute 45 sec latency 63910.830 ms 20 6945 10.39 MB/sec execute 46 sec latency 64910.908 ms 20 7055 10.36 MB/sec execute 47 sec latency 65911.026 ms 20 7139 10.27 MB/sec execute 48 sec latency 66911.157 ms 20 7221 10.18 MB/sec execute 49 sec latency 67911.249 ms 20 7334 10.28 MB/sec execute 50 sec latency 68911.426 ms 20 7447 10.27 MB/sec execute 51 sec latency 69911.518 ms 20 7594 10.31 MB/sec execute 52 sec latency 70911.595 ms 20 7722 10.45 MB/sec execute 53 sec latency 71911.656 ms 20 7837 10.49 MB/sec execute 54 sec latency 72911.740 ms 20 7954 10.49 MB/sec execute 55 sec latency 73911.818 ms 20 8062 10.50 MB/sec execute 56 sec latency 74912.128 ms 20 8195 10.67 MB/sec execute 57 sec latency 75912.199 ms 20 8312 10.72 MB/sec execute 58 sec latency 76912.296 ms 20 8405 10.60 MB/sec execute 59 sec latency 77912.452 ms 20 8510 10.53 MB/sec execute 60 sec latency 78912.559 ms 20 8636 10.60 MB/sec execute 61 sec latency 79912.664 ms 20 8775 10.71 MB/sec execute 62 sec latency 80912.741 ms 20 8939 10.88 MB/sec execute 63 sec latency 81912.835 ms 20 9061 10.94 MB/sec execute 64 sec latency 82912.939 ms 20 9188 10.97 MB/sec execute 65 sec latency 83913.051 ms 20 9296 10.96 MB/sec execute 66 sec latency 84913.131 ms 20 9400 10.99 MB/sec execute 67 sec latency 85913.222 ms 20 9535 11.08 MB/sec execute 68 sec latency 86913.336 ms 20 9643 11.10 MB/sec execute 69 sec latency 87913.462 ms 20 9730 11.02 MB/sec execute 70 sec latency 88913.565 ms 20 9822 10.98 MB/sec execute 71 sec latency 89913.686 ms 20 9941 11.00 MB/sec execute 72 sec latency 90913.778 ms 20 10069 11.06 MB/sec execute 73 sec latency 91913.862 ms 20 10182 11.08 MB/sec execute 74 sec latency 92913.941 ms 20 10275 11.03 MB/sec execute 75 sec latency 93914.342 ms 20 10392 11.02 MB/sec execute 76 sec latency 94914.417 ms 20 10519 11.05 MB/sec execute 77 sec latency 95914.516 ms 20 10635 11.09 MB/sec execute 78 sec latency 96914.614 ms 20 10796 11.25 MB/sec execute 79 sec latency 97914.717 ms 20 10893 11.22 MB/sec execute 80 sec latency 98914.809 ms 20 11002 11.18 MB/sec execute 81 sec latency 99914.908 ms 20 11105 11.12 MB/sec execute 82 sec latency 100915.005 ms 20 11243 11.22 MB/sec execute 83 sec latency 101915.104 ms 20 11362 11.27 MB/sec execute 84 sec latency 102915.219 ms 20 11512 11.34 MB/sec execute 85 sec latency 103915.289 ms 20 11642 11.36 MB/sec execute 86 sec latency 104915.358 ms 20 11750 11.36 MB/sec execute 87 sec latency 105915.454 ms 20 11861 11.32 MB/sec execute 88 sec latency 106915.552 ms 20 11986 11.32 MB/sec execute 89 sec latency 107915.658 ms 20 12102 11.32 MB/sec execute 90 sec latency 108915.727 ms 20 12217 11.33 MB/sec execute 91 sec latency 109915.870 ms 20 12359 11.40 MB/sec execute 92 sec latency 110915.955 ms 20 12481 11.44 MB/sec execute 93 sec latency 111916.055 ms 20 12609 11.43 MB/sec execute 94 sec latency 112916.317 ms 20 12722 11.49 MB/sec execute 95 sec latency 113916.510 ms 20 12824 11.50 MB/sec execute 96 sec latency 114916.615 ms 20 12922 11.48 MB/sec execute 97 sec latency 115916.704 ms 20 13021 11.44 MB/sec execute 98 sec latency 116916.845 ms 20 13111 11.44 MB/sec execute 99 sec latency 117916.933 ms 20 13200 11.37 MB/sec execute 100 sec latency 118916.995 ms 20 13311 11.35 MB/sec execute 101 sec latency 119917.103 ms 20 13438 11.39 MB/sec execute 102 sec latency 120917.241 ms 20 13599 11.50 MB/sec execute 103 sec latency 121917.460 ms 20 13719 11.50 MB/sec execute 104 sec latency 122917.547 ms 20 13835 11.51 MB/sec execute 105 sec latency 123917.652 ms 20 13946 11.51 MB/sec execute 106 sec latency 124918.264 ms 20 14079 11.59 MB/sec execute 107 sec latency 125918.375 ms 20 14206 11.66 MB/sec execute 108 sec latency 126918.475 ms 20 14288 11.62 MB/sec execute 109 sec latency 127918.631 ms 20 14363 11.54 MB/sec execute 110 sec latency 128918.826 ms 20 14429 11.48 MB/sec execute 111 sec latency 129919.044 ms 20 14512 11.45 MB/sec execute 112 sec latency 130919.181 ms 20 14615 11.45 MB/sec execute 113 sec latency 131919.321 ms 20 14721 11.50 MB/sec execute 114 sec latency 132919.416 ms 20 14824 11.49 MB/sec execute 115 sec latency 133919.514 ms 20 14915 11.45 MB/sec execute 116 sec latency 134919.616 ms 20 14993 11.40 MB/sec execute 117 sec latency 135919.711 ms 20 15094 11.38 MB/sec execute 118 sec latency 136919.859 ms 20 15228 11.44 MB/sec execute 119 sec latency 137919.969 ms 20 cleanup 120 sec 13 cleanup 121 sec 2 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 43937 25.740 139937.160 Close 32363 14.535 140511.655 Rename 1869 72.035 111400.277 Unlink 8776 8.053 2962.023 Qpathinfo 39939 1.051 57.110 Qfileinfo 7010 0.042 2.024 Qfsinfo 7277 0.025 1.719 Sfileinfo 3563 189.645 140516.302 Find 15453 0.227 14.607 WriteX 21818 0.476 12.294 ReadX 69374 0.010 1.886 LockX 146 3.758 78.726 UnlockX 146 5.105 81.692 Flush 3063 26.002 537.518 Throughput 11.4446 MB/sec 20 clients 20 procs max_latency=137919.969 ms stopping dbench on /mnt/lustre/d0.oleg309-client.virtnet at Fri May 31 06:57:33 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg309-client.virtnet /mnt/lustre/d0.oleg309-client.virtnet /mnt/lustre/d0.oleg309-client.virtnet removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg309-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) == sanity-benchmark test bonnie: bonnie++ ================ 06:57:35 (1717153055) min OST has 3390464kB available, using 5085696kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6843] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4966] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg309-clien 4966M 160397 98 143215 98 343441 59 1801 127 Latency 1467us 31910us 31869us 207ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg309-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 552 16 3939 18 732 12 490 16 631 14 679 12 Latency 14853us 9078us 52925us 14405us 6639us 13628us 1.97,1.97,oleg309-client.virtnet,1,1717144270,4966M,,,,160397,98,143215,98,,,343441,59,1801,127,10,,,,,552,16,3939,18,732,12,490,16,631,14,679,12,,1467us,31910us,,31869us,207ms,14853us,9078us,52925us,14405us,6639us,13628us debug=0x33f0484 PASS bonnie (179s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 07:00:34 (1717153234) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 12741 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 12741 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x381fd2 truncating to largest ever: 0x42d722 truncating to largest ever: 0x4c66ba truncating to largest ever: 0x4cbc82 truncating to largest ever: 0x53cc62 truncating to largest ever: 0x550d16 truncating to largest ever: 0x559435 001000 1717153239.072249 mapwrite 0x3b80fc thru 0x3b829b (0x1a0 bytes) truncating to largest ever: 0x55bb06 truncating to largest ever: 0x561843 003000 1717153245.735080 read 0x2ac305 thru 0x2bab7d (0xe879 bytes) 005000 1717153252.952031 mapwrite 0x1ae94c thru 0x1b1a86 (0x313b bytes) 006000 1717153256.435558 mapwrite 0x3d17a2 thru 0x3d5f61 (0x47c0 bytes) 007000 1717153259.663532 mapread 0x0cd728 thru 0x0d1add (0x43b6 bytes) truncating to largest ever: 0x5626ec 008000 1717153263.054903 mapwrite 0x1bc593 thru 0x1c1469 (0x4ed7 bytes) 010000 1717153270.529631 mapread 0x0a2271 thru 0x0a3373 (0x1103 bytes) 011000 1717153274.017854 trunc from 0x1003b9 to 0x38f727 (0x28f36f bytes) 012000 1717153277.315047 read 0x077273 thru 0x07834a (0x10d8 bytes) 014000 1717153284.513955 mapread 0x1783bf thru 0x179885 (0x14c7 bytes) 016000 1717153292.034629 mapread 0x3e401d thru 0x3f1e15 (0xddf9 bytes) 018000 1717153298.882482 mapwrite 0x3d788b thru 0x3da1f4 (0x296a bytes) 022000 1717153313.167952 write 0x46e44a thru 0x47343f (0x4ff6 bytes) 024000 1717153320.479224 mapread 0x25a702 thru 0x25ac89 (0x588 bytes) 025000 1717153323.604436 mapwrite 0x41deda thru 0x425a55 (0x7b7c bytes) 026000 1717153327.454548 trunc from 0x4fcd6b to 0x500f64 (0x41fa bytes) 028000 1717153335.398628 trunc from 0x562e00 to 0x20497e (0x35e481 bytes) 029000 1717153338.598115 trunc from 0x4b8d5a to 0x1cfb63 (0x2e91f6 bytes) 032000 1717153349.223995 mapread 0x08efcf thru 0x09b991 (0xc9c3 bytes) 035000 1717153359.756764 write 0x1ddac8 thru 0x1ecd71 (0xf2aa bytes) skipping zero size read 038000 1717153370.123672 read 0x28b752 thru 0x291c25 (0x64d4 bytes) 041000 1717153380.055809 write 0x3f19f4 thru 0x3fa92d (0x8f3a bytes) 042000 1717153384.223565 write 0x182f8f thru 0x18f167 (0xc1d9 bytes) 044000 1717153391.929966 trunc from 0x30aadd to 0x20cc4b (0xfde91 bytes) 046000 1717153398.871401 read 0x12b337 thru 0x12c718 (0x13e2 bytes) 047000 1717153402.509893 mapread 0x232a5e thru 0x232af2 (0x95 bytes) 051000 1717153416.010577 trunc from 0x346675 to 0x2f5285 (0x513ef bytes) 052000 1717153419.599496 mapwrite 0x09e6cb thru 0x0a6398 (0x7cce bytes) 057000 1717153436.486169 mapwrite 0x270caf thru 0x27cd6c (0xc0be bytes) 058000 1717153440.176924 write 0x523572 thru 0x524d0c (0x179b bytes) 059000 1717153443.864768 mapread 0x0a081f thru 0x0acef6 (0xc6d8 bytes) 060000 1717153447.378769 trunc from 0x4236c9 to 0x102b12 (0x320bb6 bytes) 061000 1717153450.397064 read 0x1acfa0 thru 0x1b4ee7 (0x7f48 bytes) 063000 1717153456.377358 trunc from 0x3c2059 to 0x411415 (0x4f3bd bytes) 064000 1717153459.413129 read 0x31b18c thru 0x321e1b (0x6c90 bytes) 065000 1717153462.571955 mapread 0x074426 thru 0x07d7f8 (0x93d3 bytes) 066000 1717153465.841072 mapwrite 0x39119f thru 0x3a100a (0xfe6c bytes) 069000 1717153475.844897 mapwrite 0x54d773 thru 0x551829 (0x40b7 bytes) 071000 1717153482.270329 write 0x4855ab thru 0x493a0b (0xe461 bytes) 072000 1717153485.926119 mapread 0x09566e thru 0x0a2a5d (0xd3f0 bytes) 074000 1717153492.616605 mapwrite 0x50db01 thru 0x513e39 (0x6339 bytes) 077000 1717153501.648571 mapread 0x43ed25 thru 0x447772 (0x8a4e bytes) 080000 1717153511.146404 mapwrite 0x543751 thru 0x54ddf6 (0xa6a6 bytes) 082000 1717153518.176428 trunc from 0x2617c9 to 0x4cf82f (0x26e067 bytes) 083000 1717153521.147103 read 0x4fffad thru 0x501d3e (0x1d92 bytes) truncating to largest ever: 0x56296e 085000 1717153528.169838 mapwrite 0x2e721f thru 0x2f5b29 (0xe90b bytes) 087000 1717153534.918894 mapread 0x1ad66a thru 0x1b28b4 (0x524b bytes) 092000 1717153550.941119 read 0x4e8f6e thru 0x4ebeab (0x2f3e bytes) 093000 1717153555.425098 mapread 0x31c9dd thru 0x32021f (0x3843 bytes) 095000 1717153565.729001 read 0x2d4394 thru 0x2d7149 (0x2db6 bytes) 097000 1717153572.850429 mapwrite 0x1406f0 thru 0x1477af (0x70c0 bytes) 100000 1717153583.760186 mapread 0x0d54a3 thru 0x0e03d8 (0xaf36 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (350s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 07:06:24 (1717153584) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1717153598.229944 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1717153601.386241 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1717153608.875653 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1717153612.987072 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1717153616.844272 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1717153638.029485 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1717153641.553587 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1717153645.509817 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1717153656.236702 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1717153659.849435 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1717153663.442958 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1717153671.002920 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1717153674.903219 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1717153683.861076 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1717153688.283658 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1717153693.638969 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1717153701.125692 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1717153705.793703 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1717153717.107114 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1717153738.555217 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1717153742.367228 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1717153747.125328 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1717153751.893623 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1717153755.779579 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1717153782.307957 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1717153785.975165 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1717153793.317423 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1717153809.088324 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1717153825.082680 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1717153833.310838 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1717153837.972741 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1717153847.598651 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1717153857.095001 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1717153866.581169 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1717153870.644753 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1717153874.598938 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1717153890.498685 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1717153893.890347 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1717153897.234946 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1717153906.488800 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1717153914.764266 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1717153918.485061 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1717153932.687338 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1717153944.073901 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1717153948.340095 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1717153952.638950 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1717153957.765922 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1717153962.161410 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1717153968.085689 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1717153973.784790 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1717153994.633153 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1717153998.795322 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1717154007.237815 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (427s) == sanity-benchmark test complete, duration 1114 sec ===== 07:13:31 (1717154011)