== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 09:29:08 (1784122148) start mds service on oleg252-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg252-server: oleg252-server.virtnet: executing set_default_debug -1 all pdsh@oleg252-client: oleg252-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg252-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg252-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg252-server: oleg252-server.virtnet: executing set_default_debug -1 all pdsh@oleg252-client: oleg252-server: ssh exited with exit code 1 Started lustre-OST0000 oleg252-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg252-client.virtnet: -o user_xattr,flock 192.168.202.152@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12329 425 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 1056 (time 1784122179.03 total 10.01 last 105.47) - open/close/unlink 1944 (time 1784122189.04 total 20.02 last 88.76) - open/close/unlink 2914 (time 1784122199.05 total 30.02 last 96.94) - open/close/unlink 3480 (time 1784122209.06 total 40.04 last 56.53) - open/close/unlink 4126 (time 1784122219.07 total 50.05 last 64.51) - open/close/unlink 4635 (time 1784122229.08 total 60.05 last 50.89) - open/close/unlink 5141 (time 1784122239.09 total 70.07 last 50.52) - open/close/unlink 5728 (time 1784122249.11 total 80.09 last 58.60) - open/close/unlink 6341 (time 1784122259.11 total 90.09 last 61.27) - open/close/unlink 6912 (time 1784122269.12 total 100.10 last 57.04) - open/close/unlink 7478 (time 1784122279.13 total 110.11 last 56.53) - open/close/unlink 7960 (time 1784122289.14 total 120.12 last 48.15) - open/close/unlink 8440 (time 1784122299.15 total 130.13 last 47.95) - open/close/unlink 9088 (time 1784122309.16 total 140.14 last 64.75) - open/close/unlink 9647 (time 1784122319.17 total 150.15 last 55.84) - open/close/unlink 10000 (time 1784122325.89 total 156.86 last 52.59) - open/close/unlink 10750 (time 1784122335.90 total 166.87 last 74.93) - open/close/unlink 11557 (time 1784122345.90 total 176.88 last 80.68) - open/close/unlink 12198 (time 1784122355.90 total 186.88 last 64.10) - open/close/unlink 12863 (time 1784122365.90 total 196.88 last 66.46) - open/close/unlink 13668 (time 1784122375.91 total 206.89 last 80.46) - open/close/unlink 14495 (time 1784122385.92 total 216.89 last 82.64) - open/close/unlink 15302 (time 1784122395.93 total 226.91 last 80.59) - open/close/unlink 16006 (time 1784122405.94 total 236.92 last 70.29) - open/close/unlink 16764 (time 1784122415.95 total 246.93 last 75.76) - open/close/unlink 17386 (time 1784122425.95 total 256.93 last 62.20) - open/close/unlink 17927 (time 1784122435.97 total 266.94 last 54.02) - open/close/unlink 18461 (time 1784122445.97 total 276.95 last 53.36) - open/close/unlink 19090 (time 1784122455.99 total 286.96 last 62.82) - open/close/unlink 19805 (time 1784122465.99 total 296.97 last 71.48) - open/close/unlink 20000 (time 1784122469.21 total 300.19 last 60.45) - open/close/unlink 20636 (time 1784122479.22 total 310.20 last 63.57) - open/close/unlink 21207 (time 1784122489.23 total 320.20 last 57.07) - open/close/unlink 21784 (time 1784122499.23 total 330.20 last 57.69) - open/close/unlink 22260 (time 1784122509.24 total 340.22 last 47.54) - open/close/unlink 23133 (time 1784122519.24 total 350.22 last 87.26) - open/close/unlink 23988 (time 1784122529.25 total 360.22 last 85.49) - open/close/unlink 25028 (time 1784122539.25 total 370.23 last 103.93) - open/close/unlink 26261 (time 1784122549.26 total 380.24 last 123.23) - open/close/unlink 27204 (time 1784122559.27 total 390.25 last 94.19) - open/close/unlink 28560 (time 1784122569.28 total 400.26 last 135.45) - open/close/unlink 29898 (time 1784122579.28 total 410.26 last 133.80) - open/close/unlink 31127 (time 1784122589.28 total 420.26 last 122.87) - open/close/unlink 32320 (time 1784122599.29 total 430.27 last 119.19) - open/close/unlink 33619 (time 1784122609.29 total 440.27 last 129.89) - open/close/unlink 34890 (time 1784122619.30 total 450.28 last 127.04) - open/close/unlink 35935 (time 1784122629.30 total 460.28 last 104.49) - open/close/unlink 36869 (time 1784122639.31 total 470.29 last 93.29) - open/close/unlink 37977 (time 1784122649.31 total 480.29 last 110.78) - open/close/unlink 39140 (time 1784122659.32 total 490.30 last 116.16) - open/close/unlink 40000 (time 1784122666.75 total 497.72 last 115.86) - open/close/unlink 41098 (time 1784122676.76 total 507.73 last 109.71) - open/close/unlink 42181 (time 1784122686.76 total 517.74 last 108.22) - open/close/unlink 43314 (time 1784122696.77 total 527.75 last 113.21) - open/close/unlink 44433 (time 1784122706.78 total 537.76 last 111.82) - open/close/unlink 45558 (time 1784122716.78 total 547.76 last 112.44) - open/close/unlink 46741 (time 1784122726.79 total 557.76 last 118.2 - open/close/unlink 1040 (time 1784122178.84 total 10.00 last 103.96) - open/close/unlink 1921 (time 1784122188.84 total 20.01 last 88.08) - open/close/unlink 2897 (time 1784122198.84 total 30.01 last 97.57) - open/close/unlink 3468 (time 1784122208.85 total 40.02 last 57.06) - open/close/unlink 4114 (time 1784122218.85 total 50.02 last 64.59) - open/close/unlink 4623 (time 1784122228.86 total 60.02 last 50.87) - open/close/unlink 5114 (time 1784122238.87 total 70.03 last 49.05) - open/close/unlink 5702 (time 1784122248.88 total 80.05 last 58.72) - open/close/unlink 6306 (time 1784122258.89 total 90.06 last 60.32) - open/close/unlink 6875 (time 1784122268.91 total 100.08 last 56.79) - open/close/unlink 7436 (time 1784122278.93 total 110.10 last 56.02) - open/close/unlink 7906 (time 1784122288.93 total 120.10 last 47.00) - open/close/unlink 8372 (time 1784122298.93 total 130.10 last 46.60) - open/close/unlink 9012 (time 1784122308.93 total 140.10 last 64.00) - open/close/unlink 9586 (time 1784122318.93 total 150.10 last 57.39) - open/close/unlink 10000 (time 1784122326.73 total 157.90 last 53.05) - open/close/unlink 10765 (time 1784122336.74 total 167.91 last 76.48) - open/close/unlink 11558 (time 1784122346.75 total 177.92 last 79.21) - open/close/unlink 12207 (time 1784122356.76 total 187.93 last 64.82) - open/close/unlink 12874 (time 1784122366.77 total 197.94 last 66.66) - open/close/unlink 13685 (time 1784122376.77 total 207.94 last 81.10) - open/close/unlink 14545 (time 1784122386.77 total 217.94 last 85.98) - open/close/unlink 15295 (time 1784122396.78 total 227.94 last 74.95) - open/close/unlink 16013 (time 1784122406.78 total 237.95 last 71.78) - open/close/unlink 16752 (time 1784122416.79 total 247.96 last 73.80) - open/close/unlink 17356 (time 1784122426.81 total 257.98 last 60.30) - open/close/unlink 17900 (time 1784122436.82 total 267.98 last 54.37) - open/close/unlink 18436 (time 1784122446.82 total 277.99 last 53.57) - open/close/unlink 19082 (time 1784122456.82 total 287.99 last 64.60) - open/close/unlink 19802 (time 1784122466.82 total 297.99 last 71.98) - open/close/unlink 20000 (time 1784122470.17 total 301.33 last 59.25) - open/close/unlink 20644 (time 1784122480.17 total 311.34 last 64.35) - open/close/unlink 21218 (time 1784122490.19 total 321.36 last 57.29) - open/close/unlink 21768 (time 1784122500.20 total 331.37 last 54.95) - open/close/unlink 22256 (time 1784122510.22 total 341.38 last 48.73) - open/close/unlink 23159 (time 1784122520.22 total 351.39 last 90.24) - open/close/unlink 24015 (time 1784122530.23 total 361.39 last 85.57) - open/close/unlink 25116 (time 1784122540.23 total 371.40 last 110.01) - open/close/unlink 26346 (time 1784122550.24 total 381.40 last 122.96) - open/close/unlink 27299 (time 1784122560.24 total 391.41 last 95.27) - open/close/unlink 28662 (time 1784122570.25 total 401.42 last 136.19) - open/close/unlink 29969 (time 1784122580.25 total 411.42 last 130.62) - open/close/unlink 31206 (time 1784122590.26 total 421.43 last 123.58) - open/close/unlink 32427 (time 1784122600.27 total 431.44 last 122.04) - open/close/unlink 33750 (time 1784122610.27 total 441.44 last 132.27) - open/close/unlink 34999 (time 1784122620.28 total 451.45 last 124.83) - open/close/unlink 36026 (time 1784122630.29 total 461.45 last 102.61) - open/close/unlink 36941 (time 1784122640.29 total 471.46 last 91.48) - open/close/unlink 38085 (time 1784122650.29 total 481.46 last 114.35) - open/close/unlink 39255 (time 1784122660.29 total 491.46 last 116.97) - open/close/unlink 40000 (time 1784122667.22 total 498.39 last 107.60) - open/close/unlink 41097 (time 1784122677.22 total 508.39 last 109.69) - open/close/unlink 42166 (time 1784122687.22 total 518.39 last 106.90) - open/close/unlink 43320 (time 1784122697.23 total 528.40 last 115.28) - open/close/unlink 44418 (time 1784122707.25 total 538.42 last 109.55) - open/close/unlink 45577 (time 1784122717.26 total 548.43 last 115.84) - open/close/unlink 46720 (time 1784122727.26 total 558.43 last 114.2 - open/close/unlink 1043 (time 1784122178.85 total 10.00 last 104.28) - open/close/unlink 1920 (time 1784122188.86 total 20.01 last 87.65) - open/close/unlink 2893 (time 1784122198.87 total 30.02 last 97.20) - open/close/unlink 3465 (time 1784122208.87 total 40.02 last 57.19) - open/close/unlink 4112 (time 1784122218.89 total 50.04 last 64.55) - open/close/unlink 4620 (time 1784122228.89 total 60.04 last 50.79) - open/close/unlink 5110 (time 1784122238.90 total 70.05 last 48.96) - open/close/unlink 5701 (time 1784122248.91 total 80.06 last 59.04) - open/close/unlink 6307 (time 1784122258.92 total 90.07 last 60.55) - open/close/unlink 6876 (time 1784122268.93 total 100.08 last 56.84) - open/close/unlink 7443 (time 1784122278.94 total 110.09 last 56.64) - open/close/unlink 7917 (time 1784122288.95 total 120.10 last 47.36) - open/close/unlink 8397 (time 1784122298.96 total 130.11 last 47.96) - open/close/unlink 9043 (time 1784122308.96 total 140.11 last 64.60) - open/close/unlink 9616 (time 1784122318.96 total 150.11 last 57.27) - open/close/unlink 10000 (time 1784122326.48 total 157.63 last 51.06) - open/close/unlink 10762 (time 1784122336.49 total 167.64 last 76.17) - open/close/unlink 11561 (time 1784122346.50 total 177.65 last 79.80) - open/close/unlink 12201 (time 1784122356.50 total 187.65 last 63.99) - open/close/unlink 12867 (time 1784122366.51 total 197.66 last 66.54) - open/close/unlink 13682 (time 1784122376.52 total 207.67 last 81.42) - open/close/unlink 14542 (time 1784122386.52 total 217.67 last 86.00) - open/close/unlink 15312 (time 1784122396.53 total 227.68 last 76.90) - open/close/unlink 16023 (time 1784122406.54 total 237.69 last 71.08) - open/close/unlink 16761 (time 1784122416.54 total 247.69 last 73.75) - open/close/unlink 17372 (time 1784122426.54 total 257.69 last 61.09) - open/close/unlink 17912 (time 1784122436.55 total 267.71 last 53.93) - open/close/unlink 18454 (time 1784122446.56 total 277.71 last 54.16) - open/close/unlink 19093 (time 1784122456.56 total 287.72 last 63.88) - open/close/unlink 19805 (time 1784122466.57 total 297.72 last 71.16) - open/close/unlink 20000 (time 1784122469.86 total 301.01 last 59.28) - open/close/unlink 20641 (time 1784122479.87 total 311.02 last 64.05) - open/close/unlink 21211 (time 1784122489.88 total 321.03 last 56.95) - open/close/unlink 21776 (time 1784122499.88 total 331.03 last 56.48) - open/close/unlink 22262 (time 1784122509.89 total 341.05 last 48.53) - open/close/unlink 23140 (time 1784122519.90 total 351.05 last 87.75) - open/close/unlink 23994 (time 1784122529.90 total 361.05 last 85.39) - open/close/unlink 25075 (time 1784122539.91 total 371.06 last 107.99) - open/close/unlink 26295 (time 1784122549.91 total 381.06 last 121.97) - open/close/unlink 27244 (time 1784122559.92 total 391.07 last 94.85) - open/close/unlink 28576 (time 1784122569.93 total 401.08 last 133.06) - open/close/unlink 29906 (time 1784122579.93 total 411.08 last 132.95) - open/close/unlink 31156 (time 1784122589.94 total 421.09 last 124.96) - open/close/unlink 32362 (time 1784122599.94 total 431.09 last 120.54) - open/close/unlink 33668 (time 1784122609.95 total 441.10 last 130.53) - open/close/unlink 34917 (time 1784122619.96 total 451.11 last 124.74) - open/close/unlink 35958 (time 1784122629.96 total 461.11 last 104.10) - open/close/unlink 36872 (time 1784122639.97 total 471.12 last 91.35) - open/close/unlink 38010 (time 1784122649.97 total 481.12 last 113.73) - open/close/unlink 39155 (time 1784122659.97 total 491.12 last 114.49) - open/close/unlink 40000 (time 1784122667.74 total 498.89 last 108.82) - open/close/unlink 41079 (time 1784122677.74 total 508.89 last 107.85) - open/close/unlink 42155 (time 1784122687.75 total 518.90 last 107.57) - open/close/unlink 43316 (time 1784122697.75 total 528.90 last 116.08) - open/close/unlink 44411 (time 1784122707.75 total 538.90 last 109.45) - open/close/unlink 45607 (time 1784122717.76 total 548.91 last 119.55) - open/close/unlink 46738 (time 1784122727.76 total 558.91 last 113.0 - open/close/unlink 1038 (time 1784122178.88 total 10.00 last 103.76) - open/close/unlink 1915 (time 1784122188.89 total 20.01 last 87.64) - open/close/unlink 2885 (time 1784122198.90 total 30.03 last 96.86) - open/close/unlink 3460 (time 1784122208.92 total 40.04 last 57.43) - open/close/unlink 4099 (time 1784122218.93 total 50.05 last 63.83) - open/close/unlink 4614 (time 1784122228.96 total 60.08 last 51.32) - open/close/unlink 5106 (time 1784122238.97 total 70.09 last 49.18) - open/close/unlink 5701 (time 1784122248.97 total 80.10 last 59.45) - open/close/unlink 6303 (time 1784122258.99 total 90.11 last 60.09) - open/close/unlink 6872 (time 1784122269.01 total 100.13 last 56.82) - open/close/unlink 7443 (time 1784122279.03 total 110.15 last 56.99) - open/close/unlink 7920 (time 1784122289.03 total 120.16 last 47.66) - open/close/unlink 8402 (time 1784122299.04 total 130.17 last 48.16) - open/close/unlink 9052 (time 1784122309.05 total 140.18 last 64.94) - open/close/unlink 9620 (time 1784122319.07 total 150.19 last 56.71) - open/close/unlink 10000 (time 1784122326.28 total 157.40 last 52.71) - open/close/unlink 10764 (time 1784122336.28 total 167.40 last 76.39) - open/close/unlink 11573 (time 1784122346.29 total 177.41 last 80.85) - open/close/unlink 12215 (time 1784122356.29 total 187.41 last 64.19) - open/close/unlink 12880 (time 1784122366.29 total 197.41 last 66.47) - open/close/unlink 13697 (time 1784122376.30 total 207.42 last 81.65) - open/close/unlink 14536 (time 1784122386.30 total 217.42 last 83.88) - open/close/unlink 15313 (time 1784122396.31 total 227.43 last 77.65) - open/close/unlink 16027 (time 1784122406.31 total 237.44 last 71.35) - open/close/unlink 16777 (time 1784122416.34 total 247.46 last 74.80) - open/close/unlink 17383 (time 1784122426.35 total 257.47 last 60.57) - open/close/unlink 17931 (time 1784122436.36 total 267.48 last 54.73) - open/close/unlink 18464 (time 1784122446.38 total 277.50 last 53.20) - open/close/unlink 19107 (time 1784122456.38 total 287.51 last 64.27) - open/close/unlink 19815 (time 1784122466.40 total 297.53 last 70.66) - open/close/unlink 20000 (time 1784122469.38 total 300.50 last 62.22) - open/close/unlink 20630 (time 1784122479.38 total 310.50 last 62.99) - open/close/unlink 21203 (time 1784122489.39 total 320.51 last 57.23) - open/close/unlink 21763 (time 1784122499.40 total 330.52 last 55.95) - open/close/unlink 22248 (time 1784122509.41 total 340.53 last 48.44) - open/close/unlink 23133 (time 1784122519.42 total 350.54 last 88.41) - open/close/unlink 23990 (time 1784122529.44 total 360.56 last 85.57) - open/close/unlink 25033 (time 1784122539.44 total 370.56 last 104.24) - open/close/unlink 26246 (time 1784122549.44 total 380.57 last 121.29) - open/close/unlink 27181 (time 1784122559.45 total 390.57 last 93.42) - open/close/unlink 28535 (time 1784122569.46 total 400.58 last 135.33) - open/close/unlink 29855 (time 1784122579.47 total 410.59 last 131.81) - open/close/unlink 31109 (time 1784122589.48 total 420.60 last 125.31) - open/close/unlink 32285 (time 1784122599.48 total 430.61 last 117.55) - open/close/unlink 33581 (time 1784122609.49 total 440.61 last 129.54) - open/close/unlink 34847 (time 1784122619.49 total 450.61 last 126.58) - open/close/unlink 35878 (time 1784122629.49 total 460.62 last 103.06) - open/close/unlink 36808 (time 1784122639.50 total 470.62 last 92.95) - open/close/unlink 37930 (time 1784122649.50 total 480.62 last 112.19) - open/close/unlink 39076 (time 1784122659.50 total 490.63 last 114.55) - open/close/unlink 40000 (time 1784122667.86 total 498.98 last 110.62) - open/close/unlink 41081 (time 1784122677.86 total 508.98 last 108.05) - open/close/unlink 42140 (time 1784122687.87 total 518.99 last 105.78) - open/close/unlink 43303 (time 1784122697.88 total 529.00 last 116.24) - open/close/unlink 44387 (time 1784122707.90 total 539.02 last 108.20) - open/close/unlink 45594 (time 1784122717.90 total 549.02 last 120.68) - open/close/unlink 46734 (time 1784122727.91 total 559.03 last 113.8 - open/close/unlink 1051 (time 1784122179.03 total 10.00 last 105.07) - open/close/unlink 1936 (time 1784122189.04 total 20.01 last 88.41) - open/close/unlink 2906 (time 1784122199.04 total 30.02 last 96.93) - open/close/unlink 3478 (time 1784122209.06 total 40.04 last 57.11) - open/close/unlink 4120 (time 1784122219.08 total 50.06 last 64.07) - open/close/unlink 4620 (time 1784122229.08 total 60.06 last 49.99) - open/close/unlink 5117 (time 1784122239.09 total 70.07 last 49.64) - open/close/unlink 5696 (time 1784122249.12 total 80.10 last 57.72) - open/close/unlink 6296 (time 1784122259.14 total 90.11 last 59.92) - open/close/unlink 6866 (time 1784122269.14 total 100.12 last 56.97) - open/close/unlink 7422 (time 1784122279.16 total 110.13 last 55.53) - open/close/unlink 7900 (time 1784122289.16 total 120.13 last 47.80) - open/close/unlink 8377 (time 1784122299.16 total 130.14 last 47.68) - open/close/unlink 9020 (time 1784122309.17 total 140.14 last 64.25) - open/close/unlink 9582 (time 1784122319.18 total 150.16 last 56.13) - open/close/unlink 10000 (time 1784122326.86 total 157.84 last 54.41) - open/close/unlink 10776 (time 1784122336.87 total 167.84 last 77.57) - open/close/unlink 11566 (time 1784122346.89 total 177.87 last 78.80) - open/close/unlink 12208 (time 1784122356.90 total 187.88 last 64.15) - open/close/unlink 12885 (time 1784122366.91 total 197.89 last 67.62) - open/close/unlink 13702 (time 1784122376.93 total 207.91 last 81.54) - open/close/unlink 14558 (time 1784122386.94 total 217.92 last 85.52) - open/close/unlink 15300 (time 1784122396.95 total 227.92 last 74.15) - open/close/unlink 16024 (time 1784122406.96 total 237.94 last 72.31) - open/close/unlink 16760 (time 1784122416.97 total 247.95 last 73.53) - open/close/unlink 17367 (time 1784122426.97 total 257.95 last 60.68) - open/close/unlink 17911 (time 1784122436.98 total 267.96 last 54.34) - open/close/unlink 18455 (time 1784122447.00 total 277.97 last 54.34) - open/close/unlink 19092 (time 1784122457.01 total 287.99 last 63.60) - open/close/unlink 19805 (time 1784122467.02 total 297.99 last 71.28) - open/close/unlink 20000 (time 1784122470.21 total 301.18 last 61.07) - open/close/unlink 20647 (time 1784122480.21 total 311.19 last 64.69) - open/close/unlink 21221 (time 1784122490.21 total 321.19 last 57.40) - open/close/unlink 21774 (time 1784122500.21 total 331.19 last 55.27) - open/close/unlink 22261 (time 1784122510.22 total 341.20 last 48.65) - open/close/unlink 23144 (time 1784122520.23 total 351.21 last 88.23) - open/close/unlink 24000 (time 1784122530.24 total 361.22 last 85.50) - open/close/unlink 25089 (time 1784122540.25 total 371.23 last 108.84) - open/close/unlink 26305 (time 1784122550.25 total 381.23 last 121.54) - open/close/unlink 27255 (time 1784122560.26 total 391.24 last 94.94) - open/close/unlink 28593 (time 1784122570.27 total 401.24 last 133.74) - open/close/unlink 29888 (time 1784122580.27 total 411.24 last 129.50) - open/close/unlink 31117 (time 1784122590.27 total 421.24 last 122.89) - open/close/unlink 32327 (time 1784122600.27 total 431.25 last 120.93) - open/close/unlink 33645 (time 1784122610.27 total 441.25 last 131.76) - open/close/unlink 34897 (time 1784122620.28 total 451.26 last 125.10) - open/close/unlink 35928 (time 1784122630.29 total 461.27 last 103.03) - open/close/unlink 36851 (time 1784122640.30 total 471.27 last 92.23) - open/close/unlink 37999 (time 1784122650.30 total 481.28 last 114.77) - open/close/unlink 39167 (time 1784122660.30 total 491.28 last 116.79) - open/close/unlink 40000 (time 1784122668.08 total 499.05 last 107.12) - open/close/unlink 41079 (time 1784122678.09 total 509.07 last 107.75) - open/close/unlink 42144 (time 1784122688.10 total 519.07 last 106.45) - open/close/unlink 43325 (time 1784122698.10 total 529.07 last 118.07) - open/close/unlink 44390 (time 1784122708.10 total 539.08 last 106.48) - open/close/unlink 45597 (time 1784122718.10 total 549.08 last 120.66) - open/close/unlink 46739 (time 1784122728.11 total 559.08 last 114.16) - open/close/unlink 48005 (time 1784122737.26 total 568.43 last 128.49) - open/close/unlink 49329 (time 1784122747.27 total 578.44 last 132.32) - open/close/unlink 50000 (time 1784122753.74 total 584.91 last 103.72) - open/close/unlink 50975 (time 1784122763.74 total 594.91 last 97.44) - open/close/unlink 52368 (time 1784122773.74 total 604.91 last 139.29) - open/close/unlink 53980 (time 1784122783.74 total 614.91 last 161.19) - open/close/unlink 55248 (time 1784122793.75 total 624.91 last 126.77) - open/close/unlink 56351 (time 1784122803.75 total 634.92 last 110.29) - open/close/unlink 57775 (time 1784122813.75 total 644.92 last 142.38) - open/close/unlink 59201 (time 1784122823.75 total 654.92 last 142.53) - open/close/unlink 60000 (time 1784122829.00 total 660.17 last 152.37) - open/close/unlink 61597 (time 1784122839.00 total 670.17 last 159.64) - open/close/unlink 62974 (time 1784122849.00 total 680.17 last 137.67) - open/close/unlink 64482 (time 1784122859.00 total 690.17 last 150.78) total: 64768 open/close/unlink in 691.94 seconds: 93.60 ops/second 8) - open/close/unlink 47978 (time 1784122736.79 total 567.76 last 123.70) - open/close/unlink 49336 (time 1784122746.79 total 577.77 last 135.75) - open/close/unlink 50000 (time 1784122753.02 total 583.99 last 106.64) - open/close/unlink 50981 (time 1784122763.02 total 594.00 last 98.05) - open/close/unlink 52323 (time 1784122773.03 total 604.00 last 134.14) - open/close/unlink 53951 (time 1784122783.03 total 614.01 last 162.71) - open/close/unlink 55207 (time 1784122793.03 total 624.01 last 125.56) - open/close/unlink 56305 (time 1784122803.04 total 634.02 last 109.73) - open/close/unlink 57711 (time 1784122813.05 total 644.02 last 140.54) - open/close/unlink 59126 (time 1784122823.05 total 654.03 last 141.41) - open/close/unlink 60000 (time 1784122828.86 total 659.84 last 150.51) - open/close/unlink 61593 (time 1784122838.86 total 669.84 last 159.28) - open/close/unlink 62953 (time 1784122848.86 total 679.84 last 135.96) - open/close/unlink 64463 (time 1784122858.87 total 689.85 last 150.92) total: 64768 open/close/unlink in 691.76 seconds: 93.63 ops/second 5) - open/close/unlink 48046 (time 1784122737.76 total 568.91 last 130.79) - open/close/unlink 49396 (time 1784122747.76 total 578.91 last 134.95) - open/close/unlink 50000 (time 1784122753.82 total 584.97 last 99.79) - open/close/unlink 50985 (time 1784122763.82 total 594.97 last 98.47) - open/close/unlink 52385 (time 1784122773.82 total 604.97 last 139.97) - open/close/unlink 53997 (time 1784122783.82 total 614.97 last 161.18) - open/close/unlink 55266 (time 1784122793.83 total 624.98 last 126.83) - open/close/unlink 56370 (time 1784122803.84 total 634.99 last 110.31) - open/close/unlink 57784 (time 1784122813.84 total 644.99 last 141.37) - open/close/unlink 59207 (time 1784122823.85 total 655.00 last 142.20) - open/close/unlink 60000 (time 1784122829.04 total 660.19 last 152.57) - open/close/unlink 61592 (time 1784122839.05 total 670.20 last 159.12) - open/close/unlink 62980 (time 1784122849.05 total 680.20 last 138.77) - open/close/unlink 64492 (time 1784122859.05 total 690.20 last 151.18) total: 64768 open/close/unlink in 691.94 seconds: 93.60 ops/second 7) - open/close/unlink 48047 (time 1784122737.92 total 569.04 last 131.22) - open/close/unlink 49373 (time 1784122747.92 total 579.04 last 132.57) - open/close/unlink 50000 (time 1784122754.56 total 585.68 last 94.45) - open/close/unlink 51018 (time 1784122764.56 total 595.68 last 101.76) - open/close/unlink 52453 (time 1784122774.56 total 605.68 last 143.49) - open/close/unlink 54069 (time 1784122784.57 total 615.69 last 161.44) - open/close/unlink 55305 (time 1784122794.58 total 625.70 last 123.48) - open/close/unlink 56455 (time 1784122804.58 total 635.70 last 114.98) - open/close/unlink 57847 (time 1784122814.58 total 645.70 last 139.19) - open/close/unlink 59300 (time 1784122824.59 total 655.71 last 145.24) - open/close/unlink 60000 (time 1784122829.25 total 660.37 last 150.11) - open/close/unlink 61582 (time 1784122839.25 total 670.38 last 158.12) - open/close/unlink 62958 (time 1784122849.26 total 680.38 last 137.56) - open/close/unlink 64474 (time 1784122859.26 total 690.38 last 151.54) total: 64768 open/close/unlink in 693.15 seconds: 93.44 ops/second 6) - open/close/unlink 48058 (time 1784122738.11 total 569.09 last 131.86) - open/close/unlink 49390 (time 1784122748.11 total 579.09 last 133.18) - open/close/unlink 50000 (time 1784122754.59 total 585.56 last 94.21) - open/close/unlink 51004 (time 1784122764.59 total 595.57 last 100.37) - open/close/unlink 52430 (time 1784122774.60 total 605.57 last 142.51) - open/close/unlink 54064 (time 1784122784.61 total 615.59 last 163.12) - open/close/unlink 55286 (time 1784122794.63 total 625.60 last 122.02) - open/close/unlink 56452 (time 1784122804.63 total 635.60 last 116.60) - open/close/unlink 57838 (time 1784122814.63 total 645.61 last 138.57) - open/close/unlink 59285 (time 1784122824.64 total 655.62 last 144.56) - open/close/unlink 60000 (time 1784122829.37 total 660.35 last 151.03) - open/close/unlink 61570 (time 1784122839.38 total 670.35 last 156.94) - open/close/unlink 62938 (time 1784122849.38 total 680.36 last 136.76) - open/close/unlink 64452 (time 1784122859.39 total 690.36 last 151.33) total: 64768 open/close/unlink in 693.78 seconds: 93.36 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete oleg252-server: cannot open 'lustre-ost2': no such pool pdsh@oleg252-client: oleg252-server: ssh exited with exit code 255 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg252-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg252-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg252-server stop mds service on oleg252-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg252-server unloading modules via unload_modules_local on: 'oleg252-server' oleg252-server: oleg252-server.virtnet: executing unload_modules_local oleg252-server: modules unloaded. pdsh@oleg252-client: oleg252-client: ssh exited with exit code 2 pdsh@oleg252-client: oleg252-server: ssh exited with exit code 2 pdsh@oleg252-client: oleg252-client: ssh exited with exit code 2 pdsh@oleg252-client: oleg252-server: ssh exited with exit code 2