== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 16:54:19 (1779310459) start mds service on oleg344-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg344-server: oleg344-server.virtnet: executing set_default_debug -1 all pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg344-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg344-server: oleg344-server.virtnet: executing set_default_debug -1 all pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 Started lustre-OST0000 oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg344-client.virtnet: -o user_xattr,flock 192.168.203.144@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12329 425 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 307 (time 1779310511.01 total 10.02 last 30.64) - open/close/unlink 622 (time 1779310521.04 total 20.05 last 31.40) - open/close/unlink 1034 (time 1779310531.06 total 30.07 last 41.12) - open/close/unlink 1361 (time 1779310541.09 total 40.10 last 32.60) - open/close/unlink 1729 (time 1779310551.12 total 50.13 last 36.69) - open/close/unlink 2170 (time 1779310561.17 total 60.18 last 43.88) - open/close/unlink 2588 (time 1779310571.19 total 70.20 last 41.70) - open/close/unlink 3019 (time 1779310581.21 total 80.22 last 43.02) - open/close/unlink 3456 (time 1779310591.23 total 90.24 last 43.62) - open/close/unlink 3974 (time 1779310601.24 total 100.26 last 51.71) - open/close/unlink 4441 (time 1779310611.27 total 110.28 last 46.57) - open/close/unlink 4876 (time 1779310621.28 total 120.29 last 43.48) - open/close/unlink 5350 (time 1779310631.29 total 130.30 last 47.33) - open/close/unlink 5748 (time 1779310641.30 total 140.32 last 39.75) - open/close/unlink 6147 (time 1779310651.31 total 150.33 last 39.86) - open/close/unlink 6575 (time 1779310661.34 total 160.35 last 42.71) - open/close/unlink 7013 (time 1779310671.34 total 170.35 last 43.79) - open/close/unlink 7408 (time 1779310681.35 total 180.36 last 39.47) - open/close/unlink 7794 (time 1779310691.36 total 190.37 last 38.56) - open/close/unlink 8186 (time 1779310701.37 total 200.38 last 39.15) - open/close/unlink 8751 (time 1779310711.38 total 210.40 last 56.42) - open/close/unlink 9374 (time 1779310721.39 total 220.40 last 62.29) - open/close/unlink 10000 (time 1779310730.96 total 229.97 last 65.40) - open/close/unlink 10576 (time 1779310740.97 total 239.98 last 57.52) - open/close/unlink 11112 (time 1779310750.97 total 249.98 last 53.59) - open/close/unlink 11701 (time 1779310760.99 total 260.00 last 58.78) - open/close/unlink 12250 (time 1779310771.00 total 270.01 last 54.86) - open/close/unlink 12917 (time 1779310781.02 total 280.03 last 66.57) - open/close/unlink 13555 (time 1779310791.02 total 290.03 last 63.79) - open/close/unlink 14166 (time 1779310801.02 total 300.04 last 61.07) - open/close/unlink 14927 (time 1779310811.04 total 310.05 last 76.01) - open/close/unlink 15762 (time 1779310821.04 total 320.05 last 83.46) - open/close/unlink 16659 (time 1779310831.04 total 330.06 last 89.67) - open/close/unlink 17534 (time 1779310841.05 total 340.07 last 87.41) - open/close/unlink 18281 (time 1779310851.06 total 350.07 last 74.67) - open/close/unlink 19012 (time 1779310861.07 total 360.08 last 73.05) - open/close/unlink 19610 (time 1779310871.07 total 370.08 last 59.79) - open/close/unlink 20000 (time 1779310876.42 total 375.43 last 72.83) - open/close/unlink 20821 (time 1779310886.44 total 385.45 last 81.96) - open/close/unlink 21605 (time 1779310896.45 total 395.46 last 78.34) - open/close/unlink 22434 (time 1779310906.45 total 405.46 last 82.89) - open/close/unlink 23463 (time 1779310916.45 total 415.46 last 102.86) - open/close/unlink 24061 (time 1779310926.47 total 425.49 last 59.66) - open/close/unlink 24741 (time 1779310936.48 total 435.50 last 67.93) - open/close/unlink 25414 (time 1779310946.49 total 445.50 last 67.27) - open/close/unlink 25950 (time 1779310956.50 total 455.52 last 53.52) - open/close/unlink 26570 (time 1779310966.52 total 465.53 last 61.90) - open/close/unlink 27258 (time 1779310976.53 total 475.54 last 68.76) - open/close/unlink 27818 (time 1779310986.53 total 485.54 last 55.96) - open/close/unlink 28346 (time 1779310996.55 total 495.56 last 52.71) - open/close/unlink 28831 (time 1779311006.57 total 505.58 last 48.42) - open/close/unlink 29436 (time 1779311016.59 total 515.61 last 60.33) - open/close/unlink 30000 (time 1779311024.25 total 523.26 last 73.65) - open/close/unlink 30523 (time 1779311034.27 total 533.28 last 52.23) - open/close/unlink 31233 (time 1779311044.27 total 543.29 last 70.93) - open/close/unlink 31974 (time 1779311054.29 total 553.30 last 74.02) - open/close/unlink 32690 (time 1779311064.30 total 563.31 last 71.53) - open/close/unlink 334 - open/close/unlink 316 (time 1779310510.43 total 10.02 last 31.53) - open/close/unlink 621 (time 1779310520.45 total 20.04 last 30.45) - open/close/unlink 1031 (time 1779310530.45 total 30.05 last 40.98) - open/close/unlink 1365 (time 1779310540.52 total 40.11 last 33.20) - open/close/unlink 1726 (time 1779310550.54 total 50.13 last 36.03) - open/close/unlink 2161 (time 1779310560.55 total 60.15 last 43.42) - open/close/unlink 2572 (time 1779310570.57 total 70.16 last 41.05) - open/close/unlink 3004 (time 1779310580.57 total 80.16 last 43.20) - open/close/unlink 3441 (time 1779310590.59 total 90.18 last 43.61) - open/close/unlink 3945 (time 1779310600.60 total 100.19 last 50.36) - open/close/unlink 4426 (time 1779310610.62 total 110.21 last 48.02) - open/close/unlink 4863 (time 1779310620.63 total 120.22 last 43.64) - open/close/unlink 5320 (time 1779310630.64 total 130.23 last 45.66) - open/close/unlink 5739 (time 1779310640.64 total 140.23 last 41.89) - open/close/unlink 6129 (time 1779310650.64 total 150.23 last 38.99) - open/close/unlink 6550 (time 1779310660.64 total 160.23 last 42.10) - open/close/unlink 6994 (time 1779310670.66 total 170.25 last 44.34) - open/close/unlink 7393 (time 1779310680.68 total 180.27 last 39.80) - open/close/unlink 7771 (time 1779310690.69 total 190.28 last 37.76) - open/close/unlink 8160 (time 1779310700.70 total 200.29 last 38.87) - open/close/unlink 8708 (time 1779310710.71 total 210.30 last 54.77) - open/close/unlink 9342 (time 1779310720.72 total 220.32 last 63.29) - open/close/unlink 9989 (time 1779310730.73 total 230.32 last 64.64) - open/close/unlink 10567 (time 1779310740.75 total 240.34 last 57.68) - open/close/unlink 11109 (time 1779310750.76 total 250.35 last 54.19) - open/close/unlink 11690 (time 1779310760.79 total 260.38 last 57.93) - open/close/unlink 12233 (time 1779310770.79 total 270.38 last 54.28) - open/close/unlink 12898 (time 1779310780.80 total 280.39 last 66.44) - open/close/unlink 13533 (time 1779310790.81 total 290.40 last 63.42) - open/close/unlink 14136 (time 1779310800.81 total 300.40 last 60.29) - open/close/unlink 14885 (time 1779310810.82 total 310.41 last 74.86) - open/close/unlink 15715 (time 1779310820.83 total 320.42 last 82.93) - open/close/unlink 16607 (time 1779310830.85 total 330.44 last 89.02) - open/close/unlink 17470 (time 1779310840.87 total 340.46 last 86.09) - open/close/unlink 18216 (time 1779310850.88 total 350.47 last 74.56) - open/close/unlink 18948 (time 1779310860.89 total 360.48 last 73.11) - open/close/unlink 19542 (time 1779310870.90 total 370.50 last 59.31) - open/close/unlink 20000 (time 1779310877.14 total 376.73 last 73.41) - open/close/unlink 20822 (time 1779310887.16 total 386.75 last 82.09) - open/close/unlink 21601 (time 1779310897.17 total 396.76 last 77.78) - open/close/unlink 22455 (time 1779310907.18 total 406.77 last 85.36) - open/close/unlink 23469 (time 1779310917.18 total 416.77 last 101.34) - open/close/unlink 24046 (time 1779310927.19 total 426.78 last 57.67) - open/close/unlink 24744 (time 1779310937.19 total 436.78 last 69.79) - open/close/unlink 25395 (time 1779310947.22 total 446.81 last 64.93) - open/close/unlink 25929 (time 1779310957.22 total 456.81 last 53.40) - open/close/unlink 26553 (time 1779310967.22 total 466.81 last 62.36) - open/close/unlink 27252 (time 1779310977.24 total 476.83 last 69.80) - open/close/unlink 27806 (time 1779310987.25 total 486.84 last 55.30) - open/close/unlink 28315 (time 1779310997.26 total 496.85 last 50.85) - open/close/unlink 28808 (time 1779311007.27 total 506.86 last 49.28) - open/close/unlink 29415 (time 1779311017.27 total 516.86 last 60.69) - open/close/unlink 30000 (time 1779311025.26 total 524.85 last 73.19) - open/close/unlink 30547 (time 1779311035.26 total 534.85 last 54.69) - open/close/unlink 31264 (time 1779311045.27 total 544.87 last 71.62) - open/close/unlink 32000 (time 1779311055.28 total 554.87 last 73.59) - open/close/unlink 32729 (time 1779311065.28 total 564.87 last 72.84) - open/close/unlink 3349 - open/close/unlink 305 (time 1779310511.07 total 10.01 last 30.46) - open/close/unlink 617 (time 1779310521.10 total 20.04 last 31.11) - open/close/unlink 1029 (time 1779310531.11 total 30.05 last 41.15) - open/close/unlink 1352 (time 1779310541.13 total 40.07 last 32.26) - open/close/unlink 1711 (time 1779310551.13 total 50.07 last 35.90) - open/close/unlink 2150 (time 1779310561.14 total 60.08 last 43.85) - open/close/unlink 2567 (time 1779310571.18 total 70.12 last 41.54) - open/close/unlink 2999 (time 1779310581.18 total 80.12 last 43.18) - open/close/unlink 3435 (time 1779310591.18 total 90.12 last 43.59) - open/close/unlink 3949 (time 1779310601.19 total 100.13 last 51.37) - open/close/unlink 4414 (time 1779310611.22 total 110.16 last 46.38) - open/close/unlink 4846 (time 1779310621.22 total 120.17 last 43.16) - open/close/unlink 5325 (time 1779310631.23 total 130.17 last 47.88) - open/close/unlink 5726 (time 1779310641.23 total 140.18 last 40.08) - open/close/unlink 6128 (time 1779310651.24 total 150.18 last 40.16) - open/close/unlink 6548 (time 1779310661.25 total 160.19 last 41.99) - open/close/unlink 6987 (time 1779310671.27 total 170.21 last 43.81) - open/close/unlink 7386 (time 1779310681.31 total 180.25 last 39.74) - open/close/unlink 7765 (time 1779310691.32 total 190.26 last 37.86) - open/close/unlink 8154 (time 1779310701.35 total 200.29 last 38.78) - open/close/unlink 8715 (time 1779310711.35 total 210.29 last 56.08) - open/close/unlink 9340 (time 1779310721.35 total 220.29 last 62.48) - open/close/unlink 9995 (time 1779310731.36 total 230.30 last 65.44) - open/close/unlink 10567 (time 1779310741.37 total 240.31 last 57.18) - open/close/unlink 11104 (time 1779310751.37 total 250.31 last 53.68) - open/close/unlink 11687 (time 1779310761.39 total 260.33 last 58.18) - open/close/unlink 12236 (time 1779310771.39 total 270.33 last 54.89) - open/close/unlink 12910 (time 1779310781.40 total 280.34 last 67.34) - open/close/unlink 13552 (time 1779310791.41 total 290.35 last 64.13) - open/close/unlink 14161 (time 1779310801.43 total 300.37 last 60.81) - open/close/unlink 14926 (time 1779310811.43 total 310.37 last 76.50) - open/close/unlink 15772 (time 1779310821.43 total 320.37 last 84.59) - open/close/unlink 16657 (time 1779310831.44 total 330.38 last 88.38) - open/close/unlink 17504 (time 1779310841.45 total 340.39 last 84.66) - open/close/unlink 18257 (time 1779310851.45 total 350.39 last 75.26) - open/close/unlink 18974 (time 1779310861.46 total 360.40 last 71.66) - open/close/unlink 19581 (time 1779310871.46 total 370.40 last 60.69) - open/close/unlink 20000 (time 1779310877.06 total 376.00 last 74.82) - open/close/unlink 20828 (time 1779310887.07 total 386.01 last 82.73) - open/close/unlink 21601 (time 1779310897.08 total 396.02 last 77.19) - open/close/unlink 22448 (time 1779310907.08 total 406.03 last 84.68) - open/close/unlink 23454 (time 1779310917.10 total 416.04 last 100.46) - open/close/unlink 24034 (time 1779310927.10 total 426.04 last 58.00) - open/close/unlink 24731 (time 1779310937.11 total 436.05 last 69.64) - open/close/unlink 25382 (time 1779310947.12 total 446.06 last 65.05) - open/close/unlink 25914 (time 1779310957.12 total 456.07 last 53.15) - open/close/unlink 26536 (time 1779310967.13 total 466.07 last 62.20) - open/close/unlink 27230 (time 1779310977.13 total 476.07 last 69.39) - open/close/unlink 27787 (time 1779310987.15 total 486.09 last 55.59) - open/close/unlink 28303 (time 1779310997.16 total 496.10 last 51.52) - open/close/unlink 28796 (time 1779311007.17 total 506.11 last 49.28) - open/close/unlink 29405 (time 1779311017.18 total 516.12 last 60.83) - open/close/unlink 30000 (time 1779311025.39 total 524.33 last 72.46) - open/close/unlink 30552 (time 1779311035.39 total 534.33 last 55.18) - open/close/unlink 31266 (time 1779311045.40 total 544.34 last 71.37) - open/close/unlink 32002 (time 1779311055.41 total 554.35 last 73.53) - open/close/unlink 32732 (time 1779311065.41 total 564.35 last 72.99) - open/close/unlink 3348 - open/close/unlink 310 (time 1779310511.11 total 10.03 last 30.90) - open/close/unlink 627 (time 1779310521.11 total 20.03 last 31.70) - open/close/unlink 1042 (time 1779310531.12 total 30.04 last 41.48) - open/close/unlink 1366 (time 1779310541.12 total 40.04 last 32.40) - open/close/unlink 1732 (time 1779310551.12 total 50.04 last 36.59) - open/close/unlink 2174 (time 1779310561.14 total 60.06 last 44.12) - open/close/unlink 2589 (time 1779310571.16 total 70.09 last 41.38) - open/close/unlink 3016 (time 1779310581.17 total 80.10 last 42.66) - open/close/unlink 3456 (time 1779310591.19 total 90.11 last 43.93) - open/close/unlink 3969 (time 1779310601.20 total 100.12 last 51.27) - open/close/unlink 4441 (time 1779310611.23 total 110.15 last 47.05) - open/close/unlink 4874 (time 1779310621.24 total 120.16 last 43.26) - open/close/unlink 5346 (time 1779310631.24 total 130.17 last 47.17) - open/close/unlink 5740 (time 1779310641.26 total 140.19 last 39.33) - open/close/unlink 6138 (time 1779310651.28 total 150.20 last 39.73) - open/close/unlink 6559 (time 1779310661.29 total 160.22 last 42.04) - open/close/unlink 7001 (time 1779310671.31 total 170.23 last 44.15) - open/close/unlink 7385 (time 1779310681.33 total 180.25 last 38.32) - open/close/unlink 7769 (time 1779310691.34 total 190.26 last 38.36) - open/close/unlink 8165 (time 1779310701.35 total 200.27 last 39.56) - open/close/unlink 8741 (time 1779310711.36 total 210.29 last 57.52) - open/close/unlink 9365 (time 1779310721.37 total 220.29 last 62.36) - open/close/unlink 10000 (time 1779310731.12 total 230.05 last 65.10) - open/close/unlink 10575 (time 1779310741.13 total 240.05 last 57.47) - open/close/unlink 11111 (time 1779310751.14 total 250.06 last 53.56) - open/close/unlink 11700 (time 1779310761.15 total 260.07 last 58.80) - open/close/unlink 12245 (time 1779310771.17 total 270.09 last 54.41) - open/close/unlink 12910 (time 1779310781.20 total 280.12 last 66.31) - open/close/unlink 13551 (time 1779310791.20 total 290.12 last 64.10) - open/close/unlink 14154 (time 1779310801.20 total 300.13 last 60.26) - open/close/unlink 14909 (time 1779310811.22 total 310.14 last 75.39) - open/close/unlink 15749 (time 1779310821.22 total 320.15 last 83.96) - open/close/unlink 16650 (time 1779310831.23 total 330.15 last 90.03) - open/close/unlink 17509 (time 1779310841.25 total 340.17 last 85.77) - open/close/unlink 18257 (time 1779310851.26 total 350.18 last 74.73) - open/close/unlink 18984 (time 1779310861.26 total 360.18 last 72.69) - open/close/unlink 19588 (time 1779310871.27 total 370.19 last 60.35) - open/close/unlink 20000 (time 1779310876.90 total 375.82 last 73.18) - open/close/unlink 20820 (time 1779310886.90 total 385.82 last 81.98) - open/close/unlink 21591 (time 1779310896.91 total 395.83 last 77.05) - open/close/unlink 22424 (time 1779310906.91 total 405.83 last 83.28) - open/close/unlink 23444 (time 1779310916.91 total 415.84 last 101.93) - open/close/unlink 24033 (time 1779310926.93 total 425.85 last 58.81) - open/close/unlink 24713 (time 1779310936.94 total 435.86 last 67.93) - open/close/unlink 25373 (time 1779310946.95 total 445.87 last 65.92) - open/close/unlink 25909 (time 1779310956.96 total 455.88 last 53.58) - open/close/unlink 26529 (time 1779310966.96 total 465.88 last 61.97) - open/close/unlink 27229 (time 1779310976.97 total 475.89 last 69.92) - open/close/unlink 27785 (time 1779310986.98 total 485.90 last 55.55) - open/close/unlink 28305 (time 1779310997.00 total 495.92 last 51.89) - open/close/unlink 28792 (time 1779311007.02 total 505.95 last 48.59) - open/close/unlink 29399 (time 1779311017.03 total 515.95 last 60.67) - open/close/unlink 30000 (time 1779311025.42 total 524.34 last 71.66) - open/close/unlink 30551 (time 1779311035.42 total 534.34 last 55.09) - open/close/unlink 31267 (time 1779311045.42 total 544.34 last 71.59) - open/close/unlink 32003 (time 1779311055.42 total 554.35 last 73.56) - open/close/unlink 32741 (time 1779311065.43 total 564.35 last 73.74) - open/close/unlink 334 - open/close/unlink 314 (time 1779310511.19 total 10.04 last 31.28) - open/close/unlink 632 (time 1779310521.19 total 20.04 last 31.78) - open/close/unlink 1046 (time 1779310531.20 total 30.05 last 41.39) - open/close/unlink 1364 (time 1779310541.21 total 40.06 last 31.77) - open/close/unlink 1727 (time 1779310551.24 total 50.09 last 36.19) - open/close/unlink 2163 (time 1779310561.24 total 60.09 last 43.58) - open/close/unlink 2580 (time 1779310571.24 total 70.09 last 41.69) - open/close/unlink 3012 (time 1779310581.25 total 80.10 last 43.17) - open/close/unlink 3451 (time 1779310591.25 total 90.10 last 43.89) - open/close/unlink 3969 (time 1779310601.27 total 100.12 last 51.70) - open/close/unlink 4432 (time 1779310611.27 total 110.12 last 46.29) - open/close/unlink 4865 (time 1779310621.31 total 120.16 last 43.13) - open/close/unlink 5336 (time 1779310631.33 total 130.18 last 47.01) - open/close/unlink 5734 (time 1779310641.34 total 140.19 last 39.77) - open/close/unlink 6132 (time 1779310651.36 total 150.21 last 39.73) - open/close/unlink 6560 (time 1779310661.36 total 160.21 last 42.80) - open/close/unlink 7004 (time 1779310671.38 total 170.23 last 44.32) - open/close/unlink 7398 (time 1779310681.41 total 180.26 last 39.29) - open/close/unlink 7783 (time 1779310691.41 total 190.26 last 38.48) - open/close/unlink 8169 (time 1779310701.44 total 200.29 last 38.49) - open/close/unlink 8736 (time 1779310711.44 total 210.29 last 56.69) - open/close/unlink 9349 (time 1779310721.46 total 220.31 last 61.21) - open/close/unlink 9999 (time 1779310731.46 total 230.31 last 64.95) - open/close/unlink 10562 (time 1779310741.47 total 240.32 last 56.24) - open/close/unlink 11100 (time 1779310751.49 total 250.33 last 53.74) - open/close/unlink 11683 (time 1779310761.49 total 260.34 last 58.25) - open/close/unlink 12226 (time 1779310771.51 total 270.35 last 54.24) - open/close/unlink 12895 (time 1779310781.52 total 280.37 last 66.82) - open/close/unlink 13534 (time 1779310791.53 total 290.38 last 63.78) - open/close/unlink 14142 (time 1779310801.54 total 300.39 last 60.76) - open/close/unlink 14914 (time 1779310811.55 total 310.40 last 77.12) - open/close/unlink 15769 (time 1779310821.55 total 320.40 last 85.49) - open/close/unlink 16653 (time 1779310831.56 total 330.41 last 88.35) - open/close/unlink 17504 (time 1779310841.57 total 340.42 last 85.04) - open/close/unlink 18253 (time 1779310851.57 total 350.42 last 74.85) - open/close/unlink 18972 (time 1779310861.58 total 360.43 last 71.83) - open/close/unlink 19581 (time 1779310871.59 total 370.43 last 60.89) - open/close/unlink 20000 (time 1779310877.22 total 376.07 last 74.31) - open/close/unlink 20827 (time 1779310887.23 total 386.08 last 82.67) - open/close/unlink 21593 (time 1779310897.23 total 396.08 last 76.57) - open/close/unlink 22447 (time 1779310907.23 total 406.08 last 85.40) - open/close/unlink 23446 (time 1779310917.23 total 416.08 last 99.90) - open/close/unlink 24032 (time 1779310927.24 total 426.09 last 58.55) - open/close/unlink 24736 (time 1779310937.24 total 436.09 last 70.38) - open/close/unlink 25379 (time 1779310947.24 total 446.09 last 64.30) - open/close/unlink 25921 (time 1779310957.25 total 456.10 last 54.16) - open/close/unlink 26545 (time 1779310967.26 total 466.11 last 62.31) - open/close/unlink 27235 (time 1779310977.27 total 476.12 last 68.94) - open/close/unlink 27789 (time 1779310987.27 total 486.12 last 55.39) - open/close/unlink 28305 (time 1779310997.28 total 496.13 last 51.57) - open/close/unlink 28798 (time 1779311007.29 total 506.14 last 49.27) - open/close/unlink 29401 (time 1779311017.29 total 516.14 last 60.26) - open/close/unlink 30000 (time 1779311025.74 total 524.59 last 70.93) - open/close/unlink 30562 (time 1779311035.75 total 534.59 last 56.16) - open/close/unlink 31279 (time 1779311045.75 total 544.59 last 71.70) - open/close/unlink 32034 (time 1779311055.75 total 554.60 last 75.48) - open/close/unlink 32785 (time 1779311065.76 total 564.60 last 75.05) - open/close/unlink 3352872 (time 1779311074.30 total 573.31 last 78.18) - open/close/unlink 34196 (time 1779311084.31 total 583.32 last 72.34) - open/close/unlink 34902 (time 1779311094.31 total 593.32 last 70.57) - open/close/unlink 35577 (time 1779311104.32 total 603.33 last 67.43) - open/close/unlink 36146 (time 1779311114.33 total 613.34 last 56.85) - open/close/unlink 36781 (time 1779311124.33 total 623.34 last 63.48) - open/close/unlink 37543 (time 1779311134.34 total 633.35 last 76.13) - open/close/unlink 38208 (time 1779311144.35 total 643.36 last 66.48) - open/close/unlink 38941 (time 1779311154.37 total 653.38 last 73.13) - open/close/unlink 39665 (time 1779311164.37 total 663.39 last 72.36) - open/close/unlink 40000 (time 1779311169.29 total 668.31 last 68.09) - open/close/unlink 40927 (time 1779311179.30 total 678.32 last 92.60) - open/close/unlink 41719 (time 1779311189.31 total 688.32 last 79.20) - open/close/unlink 42450 (time 1779311199.32 total 698.33 last 73.01) - open/close/unlink 43346 (time 1779311209.32 total 708.33 last 89.58) - open/close/unlink 44050 (time 1779311219.33 total 718.34 last 70.33) - open/close/unlink 44877 (time 1779311229.33 total 728.34 last 82.69) - open/close/unlink 45615 (time 1779311239.34 total 738.35 last 73.75) - open/close/unlink 46421 (time 1779311249.35 total 748.36 last 80.55) - open/close/unlink 47240 (time 1779311259.35 total 758.36 last 81.90) - open/close/unlink 48018 (time 1779311269.35 total 768.36 last 77.78) - open/close/unlink 48822 (time 1779311279.36 total 778.37 last 80.34) - open/close/unlink 49616 (time 1779311289.36 total 788.37 last 79.37) - open/close/unlink 50000 (time 1779311296.13 total 795.14 last 56.74) - open/close/unlink 50765 (time 1779311306.14 total 805.15 last 76.44) - open/close/unlink 51544 (time 1779311316.15 total 815.16 last 77.77) - open/close/unlink 52364 (time 1779311326.16 total 825.17 last 81.92) - open/close/unlink 53195 (time 1779311336.17 total 835.18 last 83.06) - open/close/unlink 53968 (time 1779311346.17 total 845.18 last 77.29) - open/close/unlink 54845 (time 1779311356.18 total 855.19 last 87.61) - open/close/unlink 55687 (time 1779311366.18 total 865.19 last 84.18) - open/close/unlink 56572 (time 1779311376.20 total 875.21 last 88.38) - open/close/unlink 57578 (time 1779311386.20 total 885.21 last 100.59) - open/close/unlink 58567 (time 1779311396.20 total 895.21 last 98.89) - open/close/unlink 59353 (time 1779311406.21 total 905.22 last 78.49) - open/close/unlink 60000 (time 1779311413.60 total 912.61 last 87.59) - open/close/unlink 60917 (time 1779311423.61 total 922.63 last 91.55) - open/close/unlink 61980 (time 1779311433.62 total 932.63 last 106.20) - open/close/unlink 62881 (time 1779311443.63 total 942.64 last 90.07) - open/close/unlink 63741 (time 1779311453.63 total 952.64 last 85.97) - open/close/unlink 64621 (time 1779311463.65 total 962.66 last 87.83) total: 64768 open/close/unlink in 964.75 seconds: 67.13 ops/second 9 (time 1779311075.42 total 574.36 last 75.63) - open/close/unlink 34197 (time 1779311085.42 total 584.36 last 70.76) - open/close/unlink 34900 (time 1779311095.43 total 594.37 last 70.27) - open/close/unlink 35575 (time 1779311105.43 total 604.37 last 67.47) - open/close/unlink 36150 (time 1779311115.45 total 614.39 last 57.42) - open/close/unlink 36798 (time 1779311125.45 total 624.39 last 64.77) - open/close/unlink 37572 (time 1779311135.45 total 634.39 last 77.38) - open/close/unlink 38228 (time 1779311145.46 total 644.40 last 65.58) - open/close/unlink 38942 (time 1779311155.47 total 654.41 last 71.30) - open/close/unlink 39673 (time 1779311165.49 total 664.44 last 72.92) - open/close/unlink 40000 (time 1779311169.97 total 668.91 last 73.02) - open/close/unlink 40934 (time 1779311179.98 total 678.93 last 93.29) - open/close/unlink 41711 (time 1779311189.99 total 688.93 last 77.63) - open/close/unlink 42455 (time 1779311200.01 total 698.95 last 74.31) - open/close/unlink 43342 (time 1779311210.01 total 708.95 last 88.64) - open/close/unlink 44053 (time 1779311220.02 total 718.96 last 71.05) - open/close/unlink 44898 (time 1779311230.02 total 728.96 last 84.46) - open/close/unlink 45615 (time 1779311240.03 total 738.97 last 71.63) - open/close/unlink 46433 (time 1779311250.04 total 748.98 last 81.72) - open/close/unlink 47236 (time 1779311260.05 total 758.99 last 80.28) - open/close/unlink 48025 (time 1779311270.05 total 768.99 last 78.87) - open/close/unlink 48815 (time 1779311280.06 total 779.00 last 78.96) - open/close/unlink 49609 (time 1779311290.06 total 789.00 last 79.37) - open/close/unlink 50000 (time 1779311296.93 total 795.87 last 56.95) - open/close/unlink 50775 (time 1779311306.93 total 805.87 last 77.46) - open/close/unlink 51554 (time 1779311316.94 total 815.88 last 77.83) - open/close/unlink 52378 (time 1779311326.94 total 825.88 last 82.38) - open/close/unlink 53205 (time 1779311336.95 total 835.89 last 82.61) - open/close/unlink 53984 (time 1779311346.95 total 845.89 last 77.90) - open/close/unlink 54868 (time 1779311356.96 total 855.90 last 88.38) - open/close/unlink 55680 (time 1779311366.96 total 865.90 last 81.20) - open/close/unlink 56597 (time 1779311376.96 total 875.90 last 91.64) - open/close/unlink 57608 (time 1779311386.97 total 885.91 last 101.05) - open/close/unlink 58591 (time 1779311396.98 total 895.92 last 98.21) - open/close/unlink 59348 (time 1779311406.98 total 905.92 last 75.67) - open/close/unlink 60000 (time 1779311414.25 total 913.19 last 89.63) - open/close/unlink 60905 (time 1779311424.26 total 923.20 last 90.42) - open/close/unlink 61995 (time 1779311434.26 total 933.21 last 108.98) - open/close/unlink 62883 (time 1779311444.28 total 943.22 last 88.69) - open/close/unlink 63757 (time 1779311454.28 total 953.22 last 87.38) - open/close/unlink 64598 (time 1779311464.28 total 963.22 last 84.09) total: 64768 open/close/unlink in 967.08 seconds: 66.97 ops/second 96 (time 1779311075.44 total 574.36 last 75.45) - open/close/unlink 34202 (time 1779311085.44 total 584.36 last 70.58) - open/close/unlink 34897 (time 1779311095.44 total 594.37 last 69.48) - open/close/unlink 35558 (time 1779311105.46 total 604.38 last 66.00) - open/close/unlink 36137 (time 1779311115.47 total 614.39 last 57.83) - open/close/unlink 36780 (time 1779311125.48 total 624.40 last 64.27) - open/close/unlink 37541 (time 1779311135.48 total 634.40 last 76.06) - open/close/unlink 38192 (time 1779311145.50 total 644.42 last 65.00) - open/close/unlink 38912 (time 1779311155.50 total 654.42 last 71.98) - open/close/unlink 39641 (time 1779311165.51 total 664.43 last 72.80) - open/close/unlink 40000 (time 1779311170.39 total 669.31 last 73.58) - open/close/unlink 40943 (time 1779311180.40 total 679.32 last 94.25) - open/close/unlink 41721 (time 1779311190.40 total 689.32 last 77.76) - open/close/unlink 42467 (time 1779311200.41 total 699.33 last 74.53) - open/close/unlink 43335 (time 1779311210.42 total 709.34 last 86.72) - open/close/unlink 44044 (time 1779311220.42 total 719.34 last 70.90) - open/close/unlink 44892 (time 1779311230.43 total 729.35 last 84.72) - open/close/unlink 45619 (time 1779311240.44 total 739.36 last 72.64) - open/close/unlink 46426 (time 1779311250.45 total 749.37 last 80.63) - open/close/unlink 47238 (time 1779311260.46 total 759.38 last 81.13) - open/close/unlink 48024 (time 1779311270.46 total 769.38 last 78.60) - open/close/unlink 48830 (time 1779311280.47 total 779.39 last 80.49) - open/close/unlink 49603 (time 1779311290.48 total 789.40 last 77.25) - open/close/unlink 50000 (time 1779311297.29 total 796.21 last 58.26) - open/close/unlink 50770 (time 1779311307.30 total 806.22 last 76.96) - open/close/unlink 51531 (time 1779311317.31 total 816.23 last 75.98) - open/close/unlink 52371 (time 1779311327.32 total 826.24 last 83.97) - open/close/unlink 53181 (time 1779311337.33 total 836.25 last 80.92) - open/close/unlink 53976 (time 1779311347.33 total 846.25 last 79.47) - open/close/unlink 54849 (time 1779311357.33 total 856.25 last 87.29) - open/close/unlink 55669 (time 1779311367.33 total 866.26 last 81.97) - open/close/unlink 56597 (time 1779311377.34 total 876.26 last 92.77) - open/close/unlink 57618 (time 1779311387.34 total 886.26 last 102.08) - open/close/unlink 58592 (time 1779311397.34 total 896.26 last 97.39) - open/close/unlink 59360 (time 1779311407.35 total 906.27 last 76.76) - open/close/unlink 60000 (time 1779311414.46 total 913.38 last 89.98) - open/close/unlink 60895 (time 1779311424.47 total 923.39 last 89.45) - open/close/unlink 61988 (time 1779311434.47 total 933.39 last 109.26) - open/close/unlink 62865 (time 1779311444.49 total 943.41 last 87.54) - open/close/unlink 63743 (time 1779311454.49 total 953.42 last 87.73) - open/close/unlink 64594 (time 1779311464.50 total 963.42 last 85.06) total: 64768 open/close/unlink in 968.23 seconds: 66.89 ops/second (time 1779311075.77 total 574.62 last 74.22) - open/close/unlink 34241 (time 1779311085.77 total 584.62 last 71.25) - open/close/unlink 34944 (time 1779311095.78 total 594.63 last 70.22) - open/close/unlink 35609 (time 1779311105.79 total 604.64 last 66.48) - open/close/unlink 36179 (time 1779311115.81 total 614.66 last 56.88) - open/close/unlink 36832 (time 1779311125.81 total 624.66 last 65.28) - open/close/unlink 37596 (time 1779311135.82 total 634.67 last 76.33) - open/close/unlink 38237 (time 1779311145.82 total 644.67 last 64.10) - open/close/unlink 38959 (time 1779311155.82 total 654.67 last 72.18) - open/close/unlink 39682 (time 1779311165.83 total 664.68 last 72.25) - open/close/unlink 40000 (time 1779311170.00 total 668.85 last 76.30) - open/close/unlink 40925 (time 1779311180.00 total 678.85 last 92.47) - open/close/unlink 41703 (time 1779311190.01 total 688.86 last 77.75) - open/close/unlink 42437 (time 1779311200.01 total 698.86 last 73.36) - open/close/unlink 43321 (time 1779311210.02 total 708.87 last 88.32) - open/close/unlink 44035 (time 1779311220.03 total 718.88 last 71.34) - open/close/unlink 44884 (time 1779311230.03 total 728.88 last 84.90) - open/close/unlink 45602 (time 1779311240.04 total 738.89 last 71.75) - open/close/unlink 46408 (time 1779311250.05 total 748.90 last 80.52) - open/close/unlink 47211 (time 1779311260.06 total 758.91 last 80.22) - open/close/unlink 48002 (time 1779311270.06 total 768.91 last 79.10) - open/close/unlink 48801 (time 1779311280.07 total 778.91 last 79.85) - open/close/unlink 49590 (time 1779311290.07 total 788.92 last 78.87) - open/close/unlink 50000 (time 1779311297.12 total 795.97 last 58.13) - open/close/unlink 50768 (time 1779311307.13 total 805.98 last 76.75) - open/close/unlink 51544 (time 1779311317.13 total 815.98 last 77.60) - open/close/unlink 52381 (time 1779311327.13 total 825.98 last 83.69) - open/close/unlink 53202 (time 1779311337.13 total 835.98 last 82.10) - open/close/unlink 53990 (time 1779311347.13 total 845.98 last 78.77) - open/close/unlink 54859 (time 1779311357.14 total 855.99 last 86.86) - open/close/unlink 55674 (time 1779311367.15 total 866.00 last 81.37) - open/close/unlink 56598 (time 1779311377.16 total 876.01 last 92.36) - open/close/unlink 57588 (time 1779311387.16 total 886.01 last 98.97) - open/close/unlink 58572 (time 1779311397.17 total 896.01 last 98.36) - open/close/unlink 59328 (time 1779311407.17 total 906.02 last 75.55) - open/close/unlink 60000 (time 1779311414.55 total 913.40 last 91.05) - open/close/unlink 60902 (time 1779311424.55 total 923.40 last 90.19) - open/close/unlink 61998 (time 1779311434.56 total 933.41 last 109.56) - open/close/unlink 62874 (time 1779311444.57 total 943.41 last 87.53) - open/close/unlink 63748 (time 1779311454.57 total 953.42 last 87.34) - open/close/unlink 64596 (time 1779311464.58 total 963.42 last 84.77) total: 64768 open/close/unlink in 968.41 seconds: 66.88 ops/second 2 (time 1779311075.29 total 574.88 last 76.25) - open/close/unlink 34205 (time 1779311085.30 total 584.89 last 71.25) - open/close/unlink 34909 (time 1779311095.31 total 594.90 last 70.30) - open/close/unlink 35579 (time 1779311105.32 total 604.91 last 66.97) - open/close/unlink 36156 (time 1779311115.32 total 614.91 last 57.69) - open/close/unlink 36790 (time 1779311125.33 total 624.92 last 63.29) - open/close/unlink 37548 (time 1779311135.34 total 634.93 last 75.78) - open/close/unlink 38211 (time 1779311145.34 total 644.93 last 66.28) - open/close/unlink 38933 (time 1779311155.36 total 654.95 last 72.04) - open/close/unlink 39670 (time 1779311165.40 total 664.99 last 73.44) - open/close/unlink 40000 (time 1779311169.91 total 669.50 last 73.10) - open/close/unlink 40934 (time 1779311179.91 total 679.51 last 93.36) - open/close/unlink 41718 (time 1779311189.92 total 689.51 last 78.36) - open/close/unlink 42458 (time 1779311199.92 total 699.52 last 73.96) - open/close/unlink 43338 (time 1779311209.94 total 709.53 last 87.87) - open/close/unlink 44045 (time 1779311219.96 total 719.55 last 70.58) - open/close/unlink 44887 (time 1779311229.97 total 729.56 last 84.10) - open/close/unlink 45611 (time 1779311239.98 total 739.57 last 72.35) - open/close/unlink 46421 (time 1779311249.98 total 749.57 last 80.99) - open/close/unlink 47220 (time 1779311259.99 total 759.58 last 79.81) - open/close/unlink 48004 (time 1779311269.99 total 769.58 last 78.39) - open/close/unlink 48802 (time 1779311280.00 total 779.59 last 79.72) - open/close/unlink 49595 (time 1779311290.01 total 789.60 last 79.20) - open/close/unlink 50000 (time 1779311297.07 total 796.66 last 57.37) - open/close/unlink 50775 (time 1779311307.08 total 806.67 last 77.40) - open/close/unlink 51555 (time 1779311317.10 total 816.69 last 77.87) - open/close/unlink 52380 (time 1779311327.10 total 826.69 last 82.47) - open/close/unlink 53201 (time 1779311337.11 total 836.70 last 82.08) - open/close/unlink 53984 (time 1779311347.11 total 846.70 last 78.23) - open/close/unlink 54857 (time 1779311357.12 total 856.71 last 87.23) - open/close/unlink 55668 (time 1779311367.13 total 866.72 last 81.03) - open/close/unlink 56585 (time 1779311377.13 total 876.73 last 91.66) - open/close/unlink 57594 (time 1779311387.14 total 886.73 last 100.83) - open/close/unlink 58579 (time 1779311397.14 total 896.74 last 98.47) - open/close/unlink 59335 (time 1779311407.15 total 906.74 last 75.55) - open/close/unlink 60000 (time 1779311414.47 total 914.06 last 90.85) - open/close/unlink 60904 (time 1779311424.48 total 924.07 last 90.30) - open/close/unlink 61994 (time 1779311434.49 total 934.08 last 108.94) - open/close/unlink 62865 (time 1779311444.50 total 944.09 last 87.01) - open/close/unlink 63733 (time 1779311454.50 total 954.09 last 86.76) - open/close/unlink 64584 (time 1779311464.51 total 964.10 last 85.03) total: 64768 open/close/unlink in 969.31 seconds: 66.82 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete oleg344-server: cannot open 'lustre-ost2': no such pool pdsh@oleg344-client: oleg344-server: ssh exited with exit code 255 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg344-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg344-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg344-server stop mds service on oleg344-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg344-server unloading modules via unload_modules_local on: 'oleg344-server' oleg344-server: oleg344-server.virtnet: executing unload_modules_local oleg344-server: modules unloaded. pdsh@oleg344-client: oleg344-client: ssh exited with exit code 2 pdsh@oleg344-client: oleg344-server: ssh exited with exit code 2 pdsh@oleg344-client: oleg344-client: ssh exited with exit code 2 pdsh@oleg344-client: oleg344-server: ssh exited with exit code 2