== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 00:44:19 (1776919459) start mds service on oleg456-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg456-server: oleg456-server.virtnet: executing set_default_debug -1 all pdsh@oleg456-client: oleg456-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg456-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg456-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg456-server: oleg456-server.virtnet: executing set_default_debug -1 all pdsh@oleg456-client: oleg456-server: ssh exited with exit code 1 Started lustre-OST0000 oleg456-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg456-client.virtnet: -o user_xattr,flock 192.168.204.156@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12328 424 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 424 (time 1776919495.24 total 10.01 last 42.38) - open/close/unlink 843 (time 1776919505.25 total 20.02 last 41.84) - open/close/unlink 1382 (time 1776919515.27 total 30.03 last 53.83) - open/close/unlink 1835 (time 1776919525.29 total 40.05 last 45.21) - open/close/unlink 2406 (time 1776919535.31 total 50.07 last 56.99) - open/close/unlink 3036 (time 1776919545.31 total 60.08 last 62.95) - open/close/unlink 3603 (time 1776919555.32 total 70.09 last 56.65) - open/close/unlink 4143 (time 1776919565.34 total 80.11 last 53.90) - open/close/unlink 4650 (time 1776919575.34 total 90.11 last 50.70) - open/close/unlink 5151 (time 1776919585.36 total 100.12 last 50.03) - open/close/unlink 5647 (time 1776919595.36 total 110.13 last 49.56) - open/close/unlink 6190 (time 1776919605.37 total 120.14 last 54.25) - open/close/unlink 6729 (time 1776919615.39 total 130.16 last 53.79) - open/close/unlink 7209 (time 1776919625.40 total 140.17 last 47.95) - open/close/unlink 7700 (time 1776919635.42 total 150.18 last 49.03) - open/close/unlink 8157 (time 1776919645.43 total 160.20 last 45.63) - open/close/unlink 8558 (time 1776919655.45 total 170.22 last 40.03) - open/close/unlink 9068 (time 1776919665.45 total 180.22 last 50.99) - open/close/unlink 9618 (time 1776919675.46 total 190.23 last 54.97) - open/close/unlink 10000 (time 1776919682.59 total 197.36 last 53.58) - open/close/unlink 10508 (time 1776919692.61 total 207.37 last 50.71) - open/close/unlink 10965 (time 1776919702.61 total 217.38 last 45.67) - open/close/unlink 11666 (time 1776919712.62 total 227.39 last 70.06) - open/close/unlink 12358 (time 1776919722.62 total 237.39 last 69.17) - open/close/unlink 12993 (time 1776919732.63 total 247.39 last 63.49) - open/close/unlink 13875 (time 1776919742.63 total 257.40 last 88.15) - open/close/unlink 14640 (time 1776919752.63 total 267.40 last 76.49) - open/close/unlink 15475 (time 1776919762.64 total 277.40 last 83.46) - open/close/unlink 16251 (time 1776919772.64 total 287.40 last 77.59) - open/close/unlink 17076 (time 1776919782.64 total 297.40 last 82.50) - open/close/unlink 17910 (time 1776919792.65 total 307.41 last 83.33) - open/close/unlink 18933 (time 1776919802.66 total 317.42 last 102.20) - open/close/unlink 19875 (time 1776919812.68 total 327.44 last 94.00) - open/close/unlink 20000 (time 1776919814.68 total 329.45 last 62.32) - open/close/unlink 20790 (time 1776919824.69 total 339.46 last 78.94) - open/close/unlink 21628 (time 1776919834.71 total 349.48 last 83.64) - open/close/unlink 22361 (time 1776919844.71 total 359.48 last 73.29) - open/close/unlink 23181 (time 1776919854.72 total 369.49 last 81.91) - open/close/unlink 24015 (time 1776919864.73 total 379.50 last 83.31) - open/close/unlink 24803 (time 1776919874.74 total 389.51 last 78.71) - open/close/unlink 25667 (time 1776919884.75 total 399.52 last 86.36) - open/close/unlink 26556 (time 1776919894.76 total 409.52 last 88.84) - open/close/unlink 27243 (time 1776919904.76 total 419.53 last 68.68) - open/close/unlink 27998 (time 1776919914.77 total 429.54 last 75.43) - open/close/unlink 28639 (time 1776919924.77 total 439.54 last 64.10) - open/close/unlink 29305 (time 1776919934.77 total 449.54 last 66.59) - open/close/unlink 29926 (time 1776919944.78 total 459.55 last 62.03) - open/close/unlink 30545 (time 1776919954.78 total 469.55 last 61.89) - open/close/unlink 31325 (time 1776919964.79 total 479.55 last 77.97) - open/close/unlink 32024 (time 1776919974.79 total 489.56 last 69.89) - open/close/unlink 32721 (time 1776919984.79 total 499.56 last 69.66) - open/close/unlink 33404 (time 1776919994.81 total 509.58 last 68.19) - open/close/unlink 33991 (time 1776920004.82 total 519.59 last 58.63) - open/close/unlink 34633 (time 1776920014.84 total 529.61 last 64.06) - open/close/unlink 35305 (time 1776920024.85 total 539.62 last 67.12) - open/close/unlink 35943 (time 1776920034.85 total 549.62 last 63.80) - open/close/unlink 36589 (time 1776920044.87 total 559.64 last 64.51) - open/close/unlink - open/close/unlink 423 (time 1776919494.84 total 10.01 last 42.27) - open/close/unlink 834 (time 1776919504.85 total 20.02 last 41.07) - open/close/unlink 1373 (time 1776919514.86 total 30.02 last 53.86) - open/close/unlink 1818 (time 1776919524.87 total 40.03 last 44.45) - open/close/unlink 2391 (time 1776919534.87 total 50.04 last 57.28) - open/close/unlink 3018 (time 1776919544.87 total 60.04 last 62.70) - open/close/unlink 3589 (time 1776919554.88 total 70.05 last 57.03) - open/close/unlink 4134 (time 1776919564.90 total 80.06 last 54.42) - open/close/unlink 4633 (time 1776919574.92 total 90.08 last 49.81) - open/close/unlink 5140 (time 1776919584.94 total 100.11 last 50.57) - open/close/unlink 5635 (time 1776919594.95 total 110.12 last 49.45) - open/close/unlink 6168 (time 1776919604.96 total 120.13 last 53.23) - open/close/unlink 6700 (time 1776919614.97 total 130.14 last 53.16) - open/close/unlink 7181 (time 1776919624.98 total 140.14 last 48.07) - open/close/unlink 7687 (time 1776919634.98 total 150.15 last 50.57) - open/close/unlink 8139 (time 1776919645.00 total 160.17 last 45.12) - open/close/unlink 8539 (time 1776919655.01 total 170.18 last 39.97) - open/close/unlink 9038 (time 1776919665.02 total 180.19 last 49.84) - open/close/unlink 9586 (time 1776919675.03 total 190.20 last 54.75) - open/close/unlink 10000 (time 1776919682.85 total 198.01 last 52.96) - open/close/unlink 10509 (time 1776919692.86 total 208.03 last 50.83) - open/close/unlink 10964 (time 1776919702.86 total 218.03 last 45.49) - open/close/unlink 11664 (time 1776919712.87 total 228.03 last 69.98) - open/close/unlink 12357 (time 1776919722.87 total 238.03 last 69.30) - open/close/unlink 13008 (time 1776919732.87 total 248.04 last 65.07) - open/close/unlink 13878 (time 1776919742.88 total 258.05 last 86.90) - open/close/unlink 14631 (time 1776919752.89 total 268.06 last 75.25) - open/close/unlink 15470 (time 1776919762.90 total 278.07 last 83.82) - open/close/unlink 16244 (time 1776919772.91 total 288.08 last 77.32) - open/close/unlink 17075 (time 1776919782.91 total 298.08 last 83.08) - open/close/unlink 17909 (time 1776919792.92 total 308.08 last 83.36) - open/close/unlink 18910 (time 1776919802.92 total 318.09 last 100.07) - open/close/unlink 19864 (time 1776919812.93 total 328.10 last 95.29) - open/close/unlink 20000 (time 1776919814.97 total 330.14 last 66.66) - open/close/unlink 20783 (time 1776919824.97 total 340.14 last 78.28) - open/close/unlink 21619 (time 1776919834.98 total 350.14 last 83.59) - open/close/unlink 22355 (time 1776919844.98 total 360.14 last 73.59) - open/close/unlink 23168 (time 1776919854.98 total 370.15 last 81.23) - open/close/unlink 23989 (time 1776919864.99 total 380.16 last 82.07) - open/close/unlink 24783 (time 1776919874.99 total 390.16 last 79.38) - open/close/unlink 25648 (time 1776919884.99 total 400.16 last 86.48) - open/close/unlink 26543 (time 1776919895.00 total 410.17 last 89.45) - open/close/unlink 27222 (time 1776919905.02 total 420.19 last 67.75) - open/close/unlink 27985 (time 1776919915.02 total 430.19 last 76.30) - open/close/unlink 28625 (time 1776919925.03 total 440.19 last 63.96) - open/close/unlink 29301 (time 1776919935.04 total 450.20 last 67.54) - open/close/unlink 29912 (time 1776919945.04 total 460.21 last 61.05) - open/close/unlink 30545 (time 1776919955.05 total 470.22 last 63.24) - open/close/unlink 31329 (time 1776919965.06 total 480.23 last 78.35) - open/close/unlink 32051 (time 1776919975.07 total 490.24 last 72.12) - open/close/unlink 32747 (time 1776919985.08 total 500.24 last 69.57) - open/close/unlink 33417 (time 1776919995.09 total 510.25 last 66.94) - open/close/unlink 34006 (time 1776920005.09 total 520.26 last 58.88) - open/close/unlink 34641 (time 1776920015.10 total 530.26 last 63.46) - open/close/unlink 35306 (time 1776920025.11 total 540.28 last 66.40) - open/close/unlink 35948 (time 1776920035.13 total 550.29 last 64.11) - open/close/unlink 36585 (time 1776920045.14 total 560.30 last 63.63) - open/close/unlink - open/close/unlink 424 (time 1776919494.80 total 10.01 last 42.37) - open/close/unlink 831 (time 1776919504.80 total 20.01 last 40.68) - open/close/unlink 1376 (time 1776919514.81 total 30.01 last 54.48) - open/close/unlink 1817 (time 1776919524.82 total 40.03 last 44.03) - open/close/unlink 2387 (time 1776919534.83 total 50.04 last 56.93) - open/close/unlink 3014 (time 1776919544.85 total 60.06 last 62.60) - open/close/unlink 3591 (time 1776919554.87 total 70.07 last 57.61) - open/close/unlink 4139 (time 1776919564.87 total 80.08 last 54.78) - open/close/unlink 4643 (time 1776919574.88 total 90.09 last 50.34) - open/close/unlink 5145 (time 1776919584.88 total 100.09 last 50.18) - open/close/unlink 5637 (time 1776919594.88 total 110.09 last 49.20) - open/close/unlink 6162 (time 1776919604.88 total 120.09 last 52.50) - open/close/unlink 6694 (time 1776919614.90 total 130.10 last 53.14) - open/close/unlink 7176 (time 1776919624.91 total 140.12 last 48.14) - open/close/unlink 7685 (time 1776919634.91 total 150.12 last 50.89) - open/close/unlink 8137 (time 1776919644.94 total 160.15 last 45.07) - open/close/unlink 8533 (time 1776919654.95 total 170.16 last 39.55) - open/close/unlink 9030 (time 1776919664.96 total 180.17 last 49.63) - open/close/unlink 9576 (time 1776919675.00 total 190.21 last 54.42) - open/close/unlink 10000 (time 1776919682.90 total 198.10 last 53.67) - open/close/unlink 10502 (time 1776919692.91 total 208.12 last 50.12) - open/close/unlink 10961 (time 1776919702.93 total 218.14 last 45.81) - open/close/unlink 11657 (time 1776919712.93 total 228.14 last 69.59) - open/close/unlink 12347 (time 1776919722.95 total 238.16 last 68.90) - open/close/unlink 13007 (time 1776919732.95 total 248.16 last 65.99) - open/close/unlink 13878 (time 1776919742.95 total 258.16 last 87.07) - open/close/unlink 14630 (time 1776919752.96 total 268.17 last 75.13) - open/close/unlink 15470 (time 1776919762.97 total 278.18 last 83.91) - open/close/unlink 16242 (time 1776919772.98 total 288.19 last 77.16) - open/close/unlink 17066 (time 1776919782.98 total 298.19 last 82.34) - open/close/unlink 17904 (time 1776919792.99 total 308.20 last 83.77) - open/close/unlink 18908 (time 1776919802.99 total 318.20 last 100.33) - open/close/unlink 19853 (time 1776919813.01 total 328.21 last 94.40) - open/close/unlink 20000 (time 1776919815.20 total 330.40 last 67.10) - open/close/unlink 20784 (time 1776919825.20 total 340.41 last 78.33) - open/close/unlink 21635 (time 1776919835.21 total 350.42 last 85.03) - open/close/unlink 22378 (time 1776919845.22 total 360.43 last 74.27) - open/close/unlink 23179 (time 1776919855.22 total 370.43 last 80.05) - open/close/unlink 24007 (time 1776919865.23 total 380.44 last 82.75) - open/close/unlink 24801 (time 1776919875.23 total 390.44 last 79.35) - open/close/unlink 25665 (time 1776919885.24 total 400.45 last 86.32) - open/close/unlink 26551 (time 1776919895.26 total 410.47 last 88.45) - open/close/unlink 27235 (time 1776919905.27 total 420.48 last 68.35) - open/close/unlink 27987 (time 1776919915.27 total 430.48 last 75.18) - open/close/unlink 28626 (time 1776919925.28 total 440.49 last 63.84) - open/close/unlink 29296 (time 1776919935.28 total 450.49 last 66.99) - open/close/unlink 29915 (time 1776919945.28 total 460.49 last 61.89) - open/close/unlink 30549 (time 1776919955.30 total 470.51 last 63.29) - open/close/unlink 31328 (time 1776919965.31 total 480.52 last 77.84) - open/close/unlink 32049 (time 1776919975.32 total 490.53 last 72.03) - open/close/unlink 32745 (time 1776919985.33 total 500.53 last 69.55) - open/close/unlink 33424 (time 1776919995.33 total 510.54 last 67.86) - open/close/unlink 34000 (time 1776920005.34 total 520.55 last 57.57) - open/close/unlink 34647 (time 1776920015.34 total 530.55 last 64.69) - open/close/unlink 35301 (time 1776920025.34 total 540.55 last 65.37) - open/close/unlink 35948 (time 1776920035.36 total 550.57 last 64.62) - open/close/unlink 36597 (time 1776920045.36 total 560.57 last 64.89) - open/close/unlink - open/close/unlink 419 (time 1776919495.32 total 10.00 last 41.88) - open/close/unlink 837 (time 1776919505.32 total 20.01 last 41.78) - open/close/unlink 1379 (time 1776919515.33 total 30.02 last 54.15) - open/close/unlink 1829 (time 1776919525.34 total 40.03 last 44.95) - open/close/unlink 2401 (time 1776919535.35 total 50.04 last 57.15) - open/close/unlink 3023 (time 1776919545.36 total 60.04 last 62.18) - open/close/unlink 3583 (time 1776919555.36 total 70.05 last 55.97) - open/close/unlink 4121 (time 1776919565.38 total 80.06 last 53.73) - open/close/unlink 4626 (time 1776919575.38 total 90.06 last 50.49) - open/close/unlink 5129 (time 1776919585.38 total 100.07 last 50.29) - open/close/unlink 5619 (time 1776919595.39 total 110.08 last 48.94) - open/close/unlink 6157 (time 1776919605.41 total 120.09 last 53.72) - open/close/unlink 6689 (time 1776919615.42 total 130.11 last 53.14) - open/close/unlink 7174 (time 1776919625.43 total 140.12 last 48.44) - open/close/unlink 7669 (time 1776919635.46 total 150.14 last 49.37) - open/close/unlink 8122 (time 1776919645.47 total 160.16 last 45.24) - open/close/unlink 8525 (time 1776919655.48 total 170.17 last 40.25) - open/close/unlink 9035 (time 1776919665.50 total 180.18 last 50.94) - open/close/unlink 9580 (time 1776919675.52 total 190.21 last 54.35) - open/close/unlink 10000 (time 1776919683.33 total 198.02 last 53.78) - open/close/unlink 10493 (time 1776919693.35 total 208.04 last 49.21) - open/close/unlink 10963 (time 1776919703.36 total 218.04 last 46.99) - open/close/unlink 11671 (time 1776919713.36 total 228.04 last 70.78) - open/close/unlink 12358 (time 1776919723.37 total 238.06 last 68.62) - open/close/unlink 13024 (time 1776919733.38 total 248.06 last 66.54) - open/close/unlink 13894 (time 1776919743.38 total 258.07 last 86.95) - open/close/unlink 14643 (time 1776919753.39 total 268.08 last 74.86) - open/close/unlink 15477 (time 1776919763.40 total 278.08 last 83.35) - open/close/unlink 16258 (time 1776919773.41 total 288.09 last 78.01) - open/close/unlink 17076 (time 1776919783.41 total 298.10 last 81.75) - open/close/unlink 17918 (time 1776919793.41 total 308.10 last 84.20) - open/close/unlink 18913 (time 1776919803.42 total 318.11 last 99.42) - open/close/unlink 19841 (time 1776919813.43 total 328.11 last 92.74) - open/close/unlink 20000 (time 1776919815.71 total 330.40 last 69.69) - open/close/unlink 20793 (time 1776919825.71 total 340.40 last 79.28) - open/close/unlink 21623 (time 1776919835.71 total 350.40 last 82.99) - open/close/unlink 22364 (time 1776919845.72 total 360.41 last 74.04) - open/close/unlink 23177 (time 1776919855.73 total 370.41 last 81.24) - open/close/unlink 23996 (time 1776919865.74 total 380.42 last 81.82) - open/close/unlink 24791 (time 1776919875.74 total 390.43 last 79.46) - open/close/unlink 25636 (time 1776919885.75 total 400.43 last 84.47) - open/close/unlink 26527 (time 1776919895.76 total 410.44 last 89.00) - open/close/unlink 27204 (time 1776919905.76 total 420.45 last 67.69) - open/close/unlink 27960 (time 1776919915.77 total 430.45 last 75.55) - open/close/unlink 28601 (time 1776919925.77 total 440.46 last 64.08) - open/close/unlink 29262 (time 1776919935.80 total 450.48 last 65.93) - open/close/unlink 29878 (time 1776919945.83 total 460.52 last 61.39) - open/close/unlink 30533 (time 1776919955.83 total 470.52 last 65.47) - open/close/unlink 31306 (time 1776919965.85 total 480.53 last 77.22) - open/close/unlink 32042 (time 1776919975.85 total 490.54 last 73.56) - open/close/unlink 32731 (time 1776919985.86 total 500.54 last 68.84) - open/close/unlink 33396 (time 1776919995.86 total 510.55 last 66.46) - open/close/unlink 33992 (time 1776920005.87 total 520.55 last 59.59) - open/close/unlink 34646 (time 1776920015.87 total 530.55 last 65.40) - open/close/unlink 35309 (time 1776920025.87 total 540.56 last 66.27) - open/close/unlink 35953 (time 1776920035.88 total 550.57 last 64.34) - open/close/unlink 36606 (time 1776920045.88 total 560.57 last 65.29) - open/close/unlink 3 - open/close/unlink 428 (time 1776919495.13 total 10.02 last 42.73) - open/close/unlink 840 (time 1776919505.13 total 20.02 last 41.20) - open/close/unlink 1381 (time 1776919515.15 total 30.03 last 54.04) - open/close/unlink 1827 (time 1776919525.16 total 40.04 last 44.54) - open/close/unlink 2398 (time 1776919535.16 total 50.04 last 57.10) - open/close/unlink 3024 (time 1776919545.17 total 60.05 last 62.54) - open/close/unlink 3592 (time 1776919555.19 total 70.07 last 56.69) - open/close/unlink 4137 (time 1776919565.20 total 80.08 last 54.45) - open/close/unlink 4643 (time 1776919575.20 total 90.09 last 50.58) - open/close/unlink 5145 (time 1776919585.21 total 100.09 last 50.17) - open/close/unlink 5634 (time 1776919595.22 total 110.10 last 48.85) - open/close/unlink 6163 (time 1776919605.23 total 120.11 last 52.85) - open/close/unlink 6697 (time 1776919615.23 total 130.12 last 53.37) - open/close/unlink 7182 (time 1776919625.24 total 140.12 last 48.48) - open/close/unlink 7681 (time 1776919635.25 total 150.13 last 49.85) - open/close/unlink 8123 (time 1776919645.26 total 160.15 last 44.14) - open/close/unlink 8520 (time 1776919655.27 total 170.16 last 39.66) - open/close/unlink 9020 (time 1776919665.28 total 180.16 last 49.99) - open/close/unlink 9571 (time 1776919675.28 total 190.16 last 55.07) - open/close/unlink 10000 (time 1776919683.29 total 198.17 last 53.60) - open/close/unlink 10495 (time 1776919693.30 total 208.19 last 49.41) - open/close/unlink 10966 (time 1776919703.31 total 218.20 last 47.05) - open/close/unlink 11678 (time 1776919713.32 total 228.20 last 71.14) - open/close/unlink 12356 (time 1776919723.33 total 238.22 last 67.72) - open/close/unlink 13019 (time 1776919733.34 total 248.22 last 66.27) - open/close/unlink 13887 (time 1776919743.35 total 258.23 last 86.72) - open/close/unlink 14640 (time 1776919753.36 total 268.24 last 75.22) - open/close/unlink 15479 (time 1776919763.37 total 278.25 last 83.83) - open/close/unlink 16261 (time 1776919773.38 total 288.26 last 78.13) - open/close/unlink 17078 (time 1776919783.38 total 298.26 last 81.65) - open/close/unlink 17926 (time 1776919793.38 total 308.27 last 84.79) - open/close/unlink 18931 (time 1776919803.39 total 318.27 last 100.45) - open/close/unlink 19865 (time 1776919813.40 total 328.29 last 93.26) - open/close/unlink 20618 (time 1776919823.41 total 338.29 last 75.24) - open/close/unlink 21494 (time 1776919833.42 total 348.30 last 87.52) - open/close/unlink 22201 (time 1776919843.43 total 358.31 last 70.66) - open/close/unlink 23032 (time 1776919853.43 total 368.32 last 83.04) - open/close/unlink 23882 (time 1776919863.44 total 378.32 last 84.97) - open/close/unlink 24638 (time 1776919873.44 total 388.32 last 75.57) - open/close/unlink 25528 (time 1776919883.45 total 398.33 last 88.92) - open/close/unlink 26404 (time 1776919893.45 total 408.33 last 87.59) - open/close/unlink 27138 (time 1776919903.45 total 418.34 last 73.38) - open/close/unlink 27895 (time 1776919913.46 total 428.34 last 75.67) - open/close/unlink 28525 (time 1776919923.46 total 438.35 last 62.96) - open/close/unlink 29193 (time 1776919933.49 total 448.37 last 66.63) - open/close/unlink 29820 (time 1776919943.50 total 458.38 last 62.66) - open/close/unlink 30000 (time 1776919946.63 total 461.51 last 57.53) - open/close/unlink 30647 (time 1776919956.64 total 471.52 last 64.64) - open/close/unlink 31421 (time 1776919966.64 total 481.52 last 77.36) - open/close/unlink 32175 (time 1776919976.65 total 491.54 last 75.30) - open/close/unlink 32855 (time 1776919986.66 total 501.54 last 67.97) - open/close/unlink 33512 (time 1776919996.67 total 511.56 last 65.60) - open/close/unlink 34122 (time 1776920006.68 total 521.57 last 60.94) - open/close/unlink 34781 (time 1776920016.69 total 531.57 last 65.87) - open/close/unlink 35418 (time 1776920026.69 total 541.57 last 63.69) - open/close/unlink 36064 (time 1776920036.69 total 551.58 last 64.58) - open/close/unlink 36728 (time 1776920046.71 total 561.59 last 66.32) - open/close/unlink 37359 (time 1776920054.89 total 569.66 last 76.84) - open/close/unlink 38123 (time 1776920064.91 total 579.67 last 76.26) - open/close/unlink 38885 (time 1776920074.91 total 589.68 last 76.19) - open/close/unlink 39597 (time 1776920084.92 total 599.68 last 71.16) - open/close/unlink 40000 (time 1776920090.86 total 605.63 last 67.73) - open/close/unlink 40788 (time 1776920100.87 total 615.63 last 78.79) - open/close/unlink 41612 (time 1776920110.87 total 625.64 last 82.36) - open/close/unlink 42434 (time 1776920120.88 total 635.65 last 82.13) - open/close/unlink 43236 (time 1776920130.88 total 645.65 last 80.18) - open/close/unlink 44007 (time 1776920140.88 total 655.65 last 77.09) - open/close/unlink 44811 (time 1776920150.88 total 665.65 last 80.39) - open/close/unlink 45063 (time 1776920160.89 total 675.65 last 25.19) - open/close/unlink 45226 (time 1776920171.04 total 685.80 last 16.06) - open/close/unlink 45450 (time 1776920181.04 total 695.81 last 22.39) - open/close/unlink 45586 (time 1776920191.05 total 705.81 last 13.59) - open/close/unlink 45749 (time 1776920201.11 total 715.87 last 16.20) - open/close/unlink 45900 (time 1776920211.12 total 725.89 last 15.08) - open/close/unlink 46066 (time 1776920221.20 total 735.97 last 16.47) - open/close/unlink 46250 (time 1776920231.20 total 745.97 last 18.39) - open/close/unlink 46475 (time 1776920241.22 total 755.99 last 22.47) - open/close/unlink 46733 (time 1776920251.25 total 766.01 last 25.73) - open/close/unlink 47020 (time 1776920261.26 total 776.02 last 28.67) - open/close/unlink 47352 (time 1776920271.28 total 786.05 last 33.12) - open/close/unlink 47748 (time 1776920281.29 total 796.06 last 39.56) - open/close/unlink 48145 (time 1776920291.29 total 806.06 last 39.69) - open/close/unlink 48507 (time 1776920301.32 total 816.09 last 36.10) - open/close/unlink 48814 (time 1776920311.35 total 826.11 last 30.62) - open/close/unlink 49105 (time 1776920321.37 total 836.14 last 29.03) - open/close/unlink 49362 (time 1776920331.38 total 846.15 last 25.68) - open/close/unlink 49681 (time 1776920341.39 total 856.15 last 31.88) - open/close/unlink 50000 (time 1776920350.48 total 865.24 last 35.09) - open/close/unlink 50343 (time 1776920360.50 total 875.27 last 34.21) - open/close/unlink 51072 (time 1776920370.51 total 885.28 last 72.86) - open/close/unlink 52176 (time 1776920380.51 total 895.28 last 110.35) - open/close/unlink 53126 (time 1776920390.52 total 905.29 last 94.94) - open/close/unlink 53955 (time 1776920400.52 total 915.29 last 82.87) - open/close/unlink 55116 (time 1776920410.53 total 925.29 last 116.07) - open/close/unlink 56262 (time 1776920420.53 total 935.29 last 114.57) - open/close/unlink 57267 (time 1776920430.53 total 945.30 last 100.48) - open/close/unlink 58393 (time 1776920440.53 total 955.30 last 112.60) - open/close/unlink 59538 (time 1776920450.54 total 965.30 last 114.42) - open/close/unlink 60000 (time 1776920455.26 total 970.03 last 97.80) - open/close/unlink 61043 (time 1776920465.27 total 980.03 last 104.24) - open/close/unlink 62109 (time 1776920475.27 total 990.04 last 106.54) - open/close/unlink 63225 (time 1776920485.29 total 1000.05 last 111.44) - open/close/unlink 64186 (time 1776920495.29 total 1010.06 last 96.08) total: 64768 open/close/unlink in 1014.41 seconds: 63.85 ops/second 37366 (time 1776920055.14 total 570.31 last 78.04) - open/close/unlink 38138 (time 1776920065.15 total 580.32 last 77.13) - open/close/unlink 38902 (time 1776920075.16 total 590.32 last 76.37) - open/close/unlink 39614 (time 1776920085.17 total 600.33 last 71.14) - open/close/unlink 40000 (time 1776920090.89 total 606.06 last 67.46) - open/close/unlink 40791 (time 1776920100.89 total 616.06 last 79.09) - open/close/unlink 41621 (time 1776920110.90 total 626.06 last 82.95) - open/close/unlink 42433 (time 1776920120.91 total 636.08 last 81.07) - open/close/unlink 43232 (time 1776920130.92 total 646.09 last 79.80) - open/close/unlink 43998 (time 1776920140.94 total 656.10 last 76.51) - open/close/unlink 44798 (time 1776920150.95 total 666.12 last 79.85) - open/close/unlink 45046 (time 1776920160.97 total 676.14 last 24.76) - open/close/unlink 45210 (time 1776920171.07 total 686.24 last 16.23) - open/close/unlink 45438 (time 1776920181.11 total 696.28 last 22.72) - open/close/unlink 45566 (time 1776920191.15 total 706.31 last 12.76) - open/close/unlink 45731 (time 1776920201.16 total 716.33 last 16.48) - open/close/unlink 45884 (time 1776920211.19 total 726.35 last 15.26) - open/close/unlink 46048 (time 1776920221.20 total 736.37 last 16.38) - open/close/unlink 46235 (time 1776920231.24 total 746.40 last 18.63) - open/close/unlink 46461 (time 1776920241.24 total 756.41 last 22.60) - open/close/unlink 46723 (time 1776920251.26 total 766.43 last 26.14) - open/close/unlink 47014 (time 1776920261.31 total 776.47 last 28.97) - open/close/unlink 47346 (time 1776920271.36 total 786.52 last 33.03) - open/close/unlink 47743 (time 1776920281.37 total 796.53 last 39.66) - open/close/unlink 48138 (time 1776920291.38 total 806.54 last 39.46) - open/close/unlink 48499 (time 1776920301.39 total 816.56 last 36.05) - open/close/unlink 48805 (time 1776920311.39 total 826.56 last 30.58) - open/close/unlink 49093 (time 1776920321.45 total 836.62 last 28.64) - open/close/unlink 49359 (time 1776920331.47 total 846.64 last 26.55) - open/close/unlink 49673 (time 1776920341.48 total 856.65 last 31.36) - open/close/unlink 50000 (time 1776920350.95 total 866.12 last 34.54) - open/close/unlink 50342 (time 1776920360.99 total 876.16 last 34.07) - open/close/unlink 51099 (time 1776920371.00 total 886.17 last 75.59) - open/close/unlink 52202 (time 1776920381.00 total 896.17 last 110.28) - open/close/unlink 53155 (time 1776920391.02 total 906.18 last 95.18) - open/close/unlink 53987 (time 1776920401.03 total 916.19 last 83.11) - open/close/unlink 55151 (time 1776920411.03 total 926.20 last 116.35) - open/close/unlink 56291 (time 1776920421.04 total 936.21 last 113.93) - open/close/unlink 57321 (time 1776920431.04 total 946.21 last 102.96) - open/close/unlink 58462 (time 1776920441.05 total 956.21 last 114.04) - open/close/unlink 59575 (time 1776920451.05 total 966.21 last 111.30) - open/close/unlink 60000 (time 1776920455.35 total 970.52 last 98.81) - open/close/unlink 61045 (time 1776920465.35 total 980.52 last 104.47) - open/close/unlink 62110 (time 1776920475.36 total 990.52 last 106.46) - open/close/unlink 63222 (time 1776920485.36 total 1000.53 last 111.11) - open/close/unlink 64192 (time 1776920495.36 total 1010.53 last 96.99) total: 64768 open/close/unlink in 1014.93 seconds: 63.81 ops/second 37361 (time 1776920055.36 total 570.57 last 76.36) - open/close/unlink 38125 (time 1776920065.37 total 580.58 last 76.36) - open/close/unlink 38874 (time 1776920075.38 total 590.58 last 74.84) - open/close/unlink 39595 (time 1776920085.39 total 600.60 last 71.97) - open/close/unlink 40000 (time 1776920091.38 total 606.58 last 67.70) - open/close/unlink 40800 (time 1776920101.38 total 616.59 last 79.97) - open/close/unlink 41623 (time 1776920111.39 total 626.60 last 82.22) - open/close/unlink 42439 (time 1776920121.40 total 636.61 last 81.51) - open/close/unlink 43236 (time 1776920131.41 total 646.62 last 79.59) - open/close/unlink 44011 (time 1776920141.42 total 656.63 last 77.43) - open/close/unlink 44810 (time 1776920151.43 total 666.63 last 79.88) - open/close/unlink 45042 (time 1776920161.46 total 676.67 last 23.13) - open/close/unlink 45201 (time 1776920171.48 total 686.69 last 15.87) - open/close/unlink 45424 (time 1776920181.56 total 696.77 last 22.12) - open/close/unlink 45560 (time 1776920191.56 total 706.77 last 13.60) - open/close/unlink 45718 (time 1776920201.64 total 716.85 last 15.68) - open/close/unlink 45873 (time 1776920211.65 total 726.86 last 15.49) - open/close/unlink 46033 (time 1776920221.69 total 736.90 last 15.94) - open/close/unlink 46222 (time 1776920231.74 total 746.95 last 18.81) - open/close/unlink 46452 (time 1776920241.76 total 756.97 last 22.96) - open/close/unlink 46716 (time 1776920251.79 total 767.00 last 26.31) - open/close/unlink 47002 (time 1776920261.81 total 777.02 last 28.55) - open/close/unlink 47332 (time 1776920271.82 total 787.03 last 32.97) - open/close/unlink 47736 (time 1776920281.84 total 797.05 last 40.31) - open/close/unlink 48143 (time 1776920291.85 total 807.06 last 40.64) - open/close/unlink 48495 (time 1776920301.86 total 817.07 last 35.16) - open/close/unlink 48796 (time 1776920311.90 total 827.11 last 30.00) - open/close/unlink 49086 (time 1776920321.95 total 837.16 last 28.85) - open/close/unlink 49351 (time 1776920331.96 total 847.16 last 26.49) - open/close/unlink 49669 (time 1776920341.96 total 857.17 last 31.79) - open/close/unlink 50000 (time 1776920351.45 total 866.66 last 34.85) - open/close/unlink 50339 (time 1776920361.46 total 876.67 last 33.87) - open/close/unlink 51119 (time 1776920371.47 total 886.68 last 77.96) - open/close/unlink 52230 (time 1776920381.47 total 896.68 last 111.05) - open/close/unlink 53176 (time 1776920391.48 total 906.69 last 94.56) - open/close/unlink 54028 (time 1776920401.48 total 916.69 last 85.15) - open/close/unlink 55218 (time 1776920411.48 total 926.69 last 118.99) - open/close/unlink 56340 (time 1776920421.49 total 936.70 last 112.11) - open/close/unlink 57362 (time 1776920431.50 total 946.71 last 102.13) - open/close/unlink 58489 (time 1776920441.50 total 956.71 last 112.69) - open/close/unlink 59610 (time 1776920451.50 total 966.71 last 112.07) - open/close/unlink 60000 (time 1776920455.43 total 970.64 last 99.22) - open/close/unlink 61046 (time 1776920465.43 total 980.64 last 104.59) - open/close/unlink 62106 (time 1776920475.43 total 990.64 last 105.99) - open/close/unlink 63209 (time 1776920485.44 total 1000.65 last 110.19) - open/close/unlink 64178 (time 1776920495.45 total 1010.65 last 96.89) total: 64768 open/close/unlink in 1015.32 seconds: 63.79 ops/second 37491 (time 1776920056.71 total 571.59 last 76.27) - open/close/unlink 38260 (time 1776920066.71 total 581.60 last 76.86) - open/close/unlink 38981 (time 1776920076.72 total 591.60 last 72.04) - open/close/unlink 39715 (time 1776920086.73 total 601.62 last 73.32) - open/close/unlink 40000 (time 1776920091.05 total 605.93 last 65.99) - open/close/unlink 40785 (time 1776920101.06 total 615.94 last 78.42) - open/close/unlink 41622 (time 1776920111.06 total 625.94 last 83.70) - open/close/unlink 42438 (time 1776920121.07 total 635.96 last 81.49) - open/close/unlink 43232 (time 1776920131.08 total 645.96 last 79.36) - open/close/unlink 44006 (time 1776920141.08 total 655.97 last 77.38) - open/close/unlink 44806 (time 1776920151.11 total 665.99 last 79.82) - open/close/unlink 45049 (time 1776920161.16 total 676.05 last 24.16) - open/close/unlink 45210 (time 1776920171.21 total 686.09 last 16.03) - open/close/unlink 45437 (time 1776920181.24 total 696.12 last 22.64) - open/close/unlink 45570 (time 1776920191.29 total 706.17 last 13.23) - open/close/unlink 45733 (time 1776920201.37 total 716.26 last 16.17) - open/close/unlink 45886 (time 1776920211.41 total 726.29 last 15.24) - open/close/unlink 46049 (time 1776920221.45 total 736.34 last 16.23) - open/close/unlink 46233 (time 1776920231.49 total 746.37 last 18.34) - open/close/unlink 46457 (time 1776920241.53 total 756.41 last 22.31) - open/close/unlink 46718 (time 1776920251.54 total 766.42 last 26.08) - open/close/unlink 47007 (time 1776920261.56 total 776.44 last 28.84) - open/close/unlink 47334 (time 1776920271.58 total 786.46 last 32.63) - open/close/unlink 47729 (time 1776920281.59 total 796.47 last 39.46) - open/close/unlink 48129 (time 1776920291.59 total 806.47 last 39.99) - open/close/unlink 48487 (time 1776920301.62 total 816.50 last 35.71) - open/close/unlink 48788 (time 1776920311.65 total 826.54 last 29.99) - open/close/unlink 49075 (time 1776920321.65 total 836.54 last 28.69) - open/close/unlink 49343 (time 1776920331.67 total 846.55 last 26.76) - open/close/unlink 49665 (time 1776920341.69 total 856.57 last 32.13) - open/close/unlink 50000 (time 1776920351.32 total 866.20 last 34.81) - open/close/unlink 50333 (time 1776920361.33 total 876.22 last 33.24) - open/close/unlink 51104 (time 1776920371.34 total 886.22 last 77.06) - open/close/unlink 52211 (time 1776920381.34 total 896.22 last 110.70) - open/close/unlink 53164 (time 1776920391.36 total 906.24 last 95.16) - open/close/unlink 54020 (time 1776920401.36 total 916.24 last 85.60) - open/close/unlink 55188 (time 1776920411.36 total 926.24 last 116.75) - open/close/unlink 56317 (time 1776920421.36 total 936.24 last 112.90) - open/close/unlink 57336 (time 1776920431.37 total 946.25 last 101.84) - open/close/unlink 58457 (time 1776920441.37 total 956.25 last 112.03) - open/close/unlink 59581 (time 1776920451.38 total 966.26 last 112.34) - open/close/unlink 60000 (time 1776920455.60 total 970.49 last 99.13) - open/close/unlink 61036 (time 1776920465.61 total 980.49 last 103.58) - open/close/unlink 62110 (time 1776920475.61 total 990.49 last 107.37) - open/close/unlink 63199 (time 1776920485.62 total 1000.50 last 108.76) - open/close/unlink 64179 (time 1776920495.62 total 1010.50 last 97.99) total: 64768 open/close/unlink in 1015.28 seconds: 63.79 ops/second 7373 (time 1776920055.89 total 570.58 last 76.64) - open/close/unlink 38147 (time 1776920065.90 total 580.58 last 77.34) - open/close/unlink 38891 (time 1776920075.91 total 590.59 last 74.32) - open/close/unlink 39613 (time 1776920085.91 total 600.60 last 72.19) - open/close/unlink 40000 (time 1776920091.62 total 606.31 last 67.76) - open/close/unlink 40792 (time 1776920101.63 total 616.32 last 79.12) - open/close/unlink 41619 (time 1776920111.64 total 626.33 last 82.64) - open/close/unlink 42427 (time 1776920121.64 total 636.33 last 80.77) - open/close/unlink 43224 (time 1776920131.66 total 646.34 last 79.58) - open/close/unlink 43996 (time 1776920141.66 total 656.35 last 77.16) - open/close/unlink 44791 (time 1776920151.66 total 666.35 last 79.49) - open/close/unlink 45003 (time 1776920161.67 total 676.35 last 21.19) - open/close/unlink 45168 (time 1776920171.69 total 686.37 last 16.47) - open/close/unlink 45391 (time 1776920181.81 total 696.50 last 22.02) - open/close/unlink 45530 (time 1776920191.85 total 706.54 last 13.85) - open/close/unlink 45687 (time 1776920201.96 total 716.65 last 15.52) - open/close/unlink 45843 (time 1776920211.98 total 726.66 last 15.58) - open/close/unlink 46002 (time 1776920222.01 total 736.69 last 15.85) - open/close/unlink 46193 (time 1776920232.03 total 746.72 last 19.06) - open/close/unlink 46421 (time 1776920242.10 total 756.79 last 22.64) - open/close/unlink 46676 (time 1776920252.13 total 766.81 last 25.43) - open/close/unlink 46973 (time 1776920262.15 total 776.84 last 29.62) - open/close/unlink 47308 (time 1776920272.16 total 786.84 last 33.50) - open/close/unlink 47706 (time 1776920282.17 total 796.85 last 39.75) - open/close/unlink 48111 (time 1776920292.18 total 806.87 last 40.44) - open/close/unlink 48460 (time 1776920302.21 total 816.89 last 34.82) - open/close/unlink 48763 (time 1776920312.22 total 826.91 last 30.25) - open/close/unlink 49044 (time 1776920322.27 total 836.95 last 27.97) - open/close/unlink 49314 (time 1776920332.29 total 846.97 last 26.95) - open/close/unlink 49631 (time 1776920342.32 total 857.01 last 31.59) - open/close/unlink 49994 (time 1776920352.33 total 867.01 last 36.28) - open/close/unlink 50318 (time 1776920362.36 total 877.04 last 32.29) - open/close/unlink 51166 (time 1776920372.36 total 887.05 last 84.76) - open/close/unlink 52252 (time 1776920382.37 total 897.05 last 108.58) - open/close/unlink 53182 (time 1776920392.37 total 907.06 last 92.92) - open/close/unlink 54044 (time 1776920402.38 total 917.06 last 86.17) - open/close/unlink 55239 (time 1776920412.38 total 927.07 last 119.46) - open/close/unlink 56345 (time 1776920422.39 total 937.08 last 110.47) - open/close/unlink 57388 (time 1776920432.39 total 947.08 last 104.29) - open/close/unlink 58573 (time 1776920442.40 total 957.08 last 118.44) - open/close/unlink 59637 (time 1776920452.40 total 967.09 last 106.37) - open/close/unlink 60000 (time 1776920456.02 total 970.70 last 100.43) - open/close/unlink 61041 (time 1776920466.02 total 980.70 last 104.09) - open/close/unlink 62130 (time 1776920476.02 total 990.71 last 108.86) - open/close/unlink 63189 (time 1776920486.03 total 1000.71 last 105.82) - open/close/unlink 64207 (time 1776920496.03 total 1010.72 last 101.78) total: 64768 open/close/unlink in 1015.56 seconds: 63.78 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg456-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg456-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg456-server stop mds service on oleg456-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg456-server unloading modules via unload_modules_local on: 'oleg456-server' oleg456-server: oleg456-server.virtnet: executing unload_modules_local oleg456-server: modules unloaded. pdsh@oleg456-client: oleg456-client: ssh exited with exit code 2 pdsh@oleg456-client: oleg456-server: ssh exited with exit code 2 pdsh@oleg456-client: oleg456-server: ssh exited with exit code 2 pdsh@oleg456-client: oleg456-client: ssh exited with exit code 2