== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 16:15:11 (1784232911) start mds service on oleg304-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg304-server: oleg304-server.virtnet: executing set_default_debug -1 all pdsh@oleg304-client: oleg304-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg304-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg304-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg304-server: oleg304-server.virtnet: executing set_default_debug -1 all pdsh@oleg304-client: oleg304-server: ssh exited with exit code 1 Started lustre-OST0000 oleg304-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg304-client.virtnet: -o user_xattr,flock 192.168.203.104@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12297 393 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 1108 (time 1784232940.30 total 10.00 last 110.76) - open/close/unlink 2108 (time 1784232950.30 total 20.01 last 99.97) - open/close/unlink 3104 (time 1784232960.30 total 30.01 last 99.57) - open/close/unlink 4306 (time 1784232970.31 total 40.01 last 120.18) - open/close/unlink 5211 (time 1784232980.31 total 50.02 last 90.42) - open/close/unlink 6007 (time 1784232990.32 total 60.03 last 79.53) - open/close/unlink 6828 (time 1784233000.33 total 70.03 last 82.07) - open/close/unlink 7685 (time 1784233010.33 total 80.04 last 85.65) - open/close/unlink 8423 (time 1784233020.34 total 90.05 last 73.74) - open/close/unlink 9223 (time 1784233030.36 total 100.06 last 79.89) - open/close/unlink 9946 (time 1784233040.36 total 110.07 last 72.25) - open/close/unlink 10479 (time 1784233050.38 total 120.09 last 53.20) - open/close/unlink 11102 (time 1784233060.38 total 130.09 last 62.28) - open/close/unlink 11948 (time 1784233070.38 total 140.09 last 84.59) - open/close/unlink 12944 (time 1784233080.40 total 150.11 last 99.45) - open/close/unlink 13992 (time 1784233090.41 total 160.11 last 104.75) - open/close/unlink 15119 (time 1784233100.44 total 170.15 last 112.32) - open/close/unlink 16398 (time 1784233110.44 total 180.15 last 127.85) - open/close/unlink 17449 (time 1784233120.45 total 190.16 last 105.01) - open/close/unlink 18491 (time 1784233130.45 total 200.16 last 104.19) - open/close/unlink 19699 (time 1784233140.45 total 210.16 last 120.80) - open/close/unlink 20000 (time 1784233143.47 total 213.18 last 99.81) - open/close/unlink 21037 (time 1784233153.47 total 223.18 last 103.68) - open/close/unlink 21983 (time 1784233163.47 total 233.18 last 94.60) - open/close/unlink 23108 (time 1784233173.48 total 243.18 last 112.46) - open/close/unlink 24261 (time 1784233183.49 total 253.19 last 115.17) - open/close/unlink 25337 (time 1784233193.49 total 263.20 last 107.56) - open/close/unlink 26386 (time 1784233203.50 total 273.20 last 104.84) - open/close/unlink 27364 (time 1784233213.50 total 283.20 last 97.78) - open/close/unlink 28374 (time 1784233223.50 total 293.21 last 100.97) - open/close/unlink 29579 (time 1784233233.51 total 303.21 last 120.41) - open/close/unlink 30000 (time 1784233238.19 total 307.90 last 89.88) - open/close/unlink 30946 (time 1784233248.20 total 317.90 last 94.55) - open/close/unlink 32165 (time 1784233258.20 total 327.90 last 121.88) - open/close/unlink 32618 (time 1784233268.20 total 337.91 last 45.28) - open/close/unlink 32964 (time 1784233278.23 total 347.93 last 34.52) - open/close/unlink 33303 (time 1784233288.24 total 357.95 last 33.85) - open/close/unlink 33599 (time 1784233298.25 total 367.96 last 29.57) - open/close/unlink 33888 (time 1784233308.26 total 377.97 last 28.86) - open/close/unlink 34433 (time 1784233318.27 total 387.97 last 54.48) - open/close/unlink 34840 (time 1784233328.27 total 397.98 last 40.68) - open/close/unlink 35210 (time 1784233338.28 total 407.98 last 36.98) - open/close/unlink 35754 (time 1784233348.28 total 417.98 last 54.39) - open/close/unlink 36292 (time 1784233358.28 total 427.99 last 53.78) - open/close/unlink 36917 (time 1784233368.29 total 437.99 last 62.46) - open/close/unlink 37393 (time 1784233378.29 total 448.00 last 47.57) - open/close/unlink 38034 (time 1784233388.30 total 458.01 last 64.03) - open/close/unlink 38654 (time 1784233398.30 total 468.01 last 62.00) - open/close/unlink 39269 (time 1784233408.32 total 478.02 last 61.43) - open/close/unlink 40000 (time 1784233417.19 total 486.90 last 82.38) - open/close/unlink 40878 (time 1784233427.19 total 496.90 last 87.79) - open/close/unlink 41658 (time 1784233437.19 total 506.90 last 77.99) - open/close/unlink 42563 (time 1784233447.20 total 516.90 last 90.46) - open/close/unlink 43444 (time 1784233457.20 total 526.91 last 88.02) - open/close/unlink 44178 (time 1784233467.22 total 536.93 last 73.27) - open/close/unlink 44849 (time 1784233477.22 total 546.93 last 67.08) - open/close/unlink 45556 (time 1784233487.23 total 556.94 last 70. - open/close/unlink 1099 (time 1784232940.11 total 10.00 last 109.87) - open/close/unlink 2107 (time 1784232950.12 total 20.01 last 100.74) - open/close/unlink 3091 (time 1784232960.12 total 30.01 last 98.38) - open/close/unlink 4291 (time 1784232970.13 total 40.02 last 119.93) - open/close/unlink 5204 (time 1784232980.13 total 50.02 last 91.24) - open/close/unlink 6010 (time 1784232990.15 total 60.04 last 80.49) - open/close/unlink 6828 (time 1784233000.16 total 70.05 last 81.69) - open/close/unlink 7687 (time 1784233010.16 total 80.05 last 85.89) - open/close/unlink 8419 (time 1784233020.16 total 90.06 last 73.16) - open/close/unlink 9220 (time 1784233030.17 total 100.06 last 80.07) - open/close/unlink 9950 (time 1784233040.18 total 110.07 last 72.91) - open/close/unlink 10483 (time 1784233050.18 total 120.07 last 53.29) - open/close/unlink 11098 (time 1784233060.19 total 130.08 last 61.44) - open/close/unlink 11945 (time 1784233070.20 total 140.09 last 84.67) - open/close/unlink 12955 (time 1784233080.20 total 150.09 last 100.97) - open/close/unlink 14000 (time 1784233090.21 total 160.10 last 104.38) - open/close/unlink 15118 (time 1784233100.22 total 170.11 last 111.73) - open/close/unlink 16394 (time 1784233110.23 total 180.12 last 127.39) - open/close/unlink 17439 (time 1784233120.24 total 190.13 last 104.45) - open/close/unlink 18457 (time 1784233130.24 total 200.13 last 101.74) - open/close/unlink 19693 (time 1784233140.25 total 210.14 last 123.58) - open/close/unlink 20000 (time 1784233143.37 total 213.26 last 98.14) - open/close/unlink 21035 (time 1784233153.38 total 223.27 last 103.45) - open/close/unlink 21979 (time 1784233163.39 total 233.28 last 94.32) - open/close/unlink 23088 (time 1784233173.39 total 243.28 last 110.90) - open/close/unlink 24243 (time 1784233183.39 total 253.28 last 115.46) - open/close/unlink 25315 (time 1784233193.40 total 263.29 last 107.14) - open/close/unlink 26360 (time 1784233203.40 total 273.29 last 104.50) - open/close/unlink 27335 (time 1784233213.41 total 283.30 last 97.40) - open/close/unlink 28359 (time 1784233223.41 total 293.30 last 102.38) - open/close/unlink 29563 (time 1784233233.41 total 303.31 last 120.32) - open/close/unlink 30000 (time 1784233238.30 total 308.19 last 89.47) - open/close/unlink 30941 (time 1784233248.30 total 318.19 last 94.10) - open/close/unlink 32154 (time 1784233258.30 total 328.19 last 121.29) - open/close/unlink 32601 (time 1784233268.31 total 338.20 last 44.67) - open/close/unlink 32932 (time 1784233278.34 total 348.23 last 33.00) - open/close/unlink 33277 (time 1784233288.36 total 358.25 last 34.43) - open/close/unlink 33575 (time 1784233298.37 total 368.27 last 29.75) - open/close/unlink 33869 (time 1784233308.39 total 378.28 last 29.35) - open/close/unlink 34417 (time 1784233318.41 total 388.30 last 54.69) - open/close/unlink 34821 (time 1784233328.42 total 398.31 last 40.36) - open/close/unlink 35183 (time 1784233338.42 total 408.31 last 36.18) - open/close/unlink 35737 (time 1784233348.43 total 418.32 last 55.38) - open/close/unlink 36277 (time 1784233358.43 total 428.32 last 53.97) - open/close/unlink 36905 (time 1784233368.43 total 438.32 last 62.79) - open/close/unlink 37380 (time 1784233378.44 total 448.33 last 47.49) - open/close/unlink 38019 (time 1784233388.44 total 458.33 last 63.89) - open/close/unlink 38638 (time 1784233398.44 total 468.33 last 61.88) - open/close/unlink 39255 (time 1784233408.44 total 478.33 last 61.67) - open/close/unlink 40000 (time 1784233417.59 total 487.48 last 81.45) - open/close/unlink 40873 (time 1784233427.59 total 497.49 last 87.27) - open/close/unlink 41663 (time 1784233437.60 total 507.49 last 78.97) - open/close/unlink 42570 (time 1784233447.61 total 517.50 last 90.59) - open/close/unlink 43458 (time 1784233457.62 total 527.51 last 88.71) - open/close/unlink 44176 (time 1784233467.63 total 537.52 last 71.74) - open/close/unlink 44873 (time 1784233477.63 total 547.52 last 69.69) - open/close/unlink 45572 (time 1784233487.63 total 557.53 last 6 - open/close/unlink 1095 (time 1784232940.15 total 10.00 last 109.48) - open/close/unlink 2093 (time 1784232950.16 total 20.01 last 99.68) - open/close/unlink 3093 (time 1784232960.17 total 30.02 last 99.94) - open/close/unlink 4291 (time 1784232970.17 total 40.03 last 119.71) - open/close/unlink 5193 (time 1784232980.18 total 50.03 last 90.17) - open/close/unlink 5998 (time 1784232990.18 total 60.03 last 80.50) - open/close/unlink 6817 (time 1784233000.18 total 70.03 last 81.87) - open/close/unlink 7674 (time 1784233010.19 total 80.05 last 85.59) - open/close/unlink 8414 (time 1784233020.20 total 90.06 last 73.93) - open/close/unlink 9222 (time 1784233030.21 total 100.06 last 80.74) - open/close/unlink 9939 (time 1784233040.22 total 110.08 last 71.62) - open/close/unlink 10476 (time 1784233050.24 total 120.09 last 53.63) - open/close/unlink 11096 (time 1784233060.24 total 130.09 last 61.98) - open/close/unlink 11938 (time 1784233070.24 total 140.09 last 84.17) - open/close/unlink 12941 (time 1784233080.25 total 150.10 last 100.24) - open/close/unlink 13976 (time 1784233090.27 total 160.12 last 103.28) - open/close/unlink 15103 (time 1784233100.27 total 170.12 last 112.67) - open/close/unlink 16367 (time 1784233110.28 total 180.13 last 126.31) - open/close/unlink 17408 (time 1784233120.28 total 190.13 last 104.09) - open/close/unlink 18443 (time 1784233130.28 total 200.14 last 103.46) - open/close/unlink 19664 (time 1784233140.29 total 210.14 last 122.00) - open/close/unlink 20000 (time 1784233143.57 total 213.43 last 102.34) - open/close/unlink 21036 (time 1784233153.58 total 223.43 last 103.58) - open/close/unlink 21979 (time 1784233163.58 total 233.43 last 94.28) - open/close/unlink 23100 (time 1784233173.58 total 243.43 last 112.06) - open/close/unlink 24235 (time 1784233183.59 total 253.45 last 113.39) - open/close/unlink 25311 (time 1784233193.60 total 263.45 last 107.56) - open/close/unlink 26353 (time 1784233203.63 total 273.48 last 103.86) - open/close/unlink 27338 (time 1784233213.63 total 283.49 last 98.46) - open/close/unlink 28350 (time 1784233223.66 total 293.51 last 100.94) - open/close/unlink 29560 (time 1784233233.66 total 303.52 last 120.96) - open/close/unlink 30000 (time 1784233238.53 total 308.39 last 90.33) - open/close/unlink 30955 (time 1784233248.54 total 318.39 last 95.45) - open/close/unlink 32157 (time 1784233258.54 total 328.39 last 120.19) - open/close/unlink 32592 (time 1784233268.55 total 338.41 last 43.44) - open/close/unlink 32936 (time 1784233278.56 total 348.42 last 34.37) - open/close/unlink 33275 (time 1784233288.59 total 358.45 last 33.79) - open/close/unlink 33570 (time 1784233298.61 total 368.46 last 29.45) - open/close/unlink 33860 (time 1784233308.65 total 378.50 last 28.89) - open/close/unlink 34399 (time 1784233318.65 total 388.50 last 53.89) - open/close/unlink 34806 (time 1784233328.68 total 398.53 last 40.60) - open/close/unlink 35183 (time 1784233338.70 total 408.55 last 37.62) - open/close/unlink 35745 (time 1784233348.71 total 418.56 last 56.13) - open/close/unlink 36272 (time 1784233358.73 total 428.58 last 52.59) - open/close/unlink 36904 (time 1784233368.75 total 438.61 last 63.05) - open/close/unlink 37378 (time 1784233378.76 total 448.61 last 47.39) - open/close/unlink 38023 (time 1784233388.77 total 458.62 last 64.42) - open/close/unlink 38647 (time 1784233398.78 total 468.64 last 62.31) - open/close/unlink 39266 (time 1784233408.78 total 478.64 last 61.89) - open/close/unlink 40000 (time 1784233417.84 total 487.69 last 81.10) - open/close/unlink 40872 (time 1784233427.84 total 497.70 last 87.13) - open/close/unlink 41662 (time 1784233437.85 total 507.71 last 78.92) - open/close/unlink 42565 (time 1784233447.86 total 517.71 last 90.24) - open/close/unlink 43451 (time 1784233457.86 total 527.72 last 88.57) - open/close/unlink 44147 (time 1784233467.87 total 537.72 last 69.57) - open/close/unlink 44856 (time 1784233477.87 total 547.73 last 70.85) - open/close/unlink 45554 (time 1784233487.88 total 557.73 last 6 - open/close/unlink 1106 (time 1784232940.30 total 10.01 last 110.52) - open/close/unlink 2106 (time 1784232950.31 total 20.01 last 99.93) - open/close/unlink 3099 (time 1784232960.31 total 30.02 last 99.26) - open/close/unlink 4301 (time 1784232970.31 total 40.02 last 120.18) - open/close/unlink 5199 (time 1784232980.32 total 50.02 last 89.77) - open/close/unlink 5995 (time 1784232990.32 total 60.02 last 79.60) - open/close/unlink 6817 (time 1784233000.33 total 70.04 last 82.08) - open/close/unlink 7665 (time 1784233010.34 total 80.04 last 84.75) - open/close/unlink 8406 (time 1784233020.35 total 90.05 last 74.04) - open/close/unlink 9206 (time 1784233030.36 total 100.07 last 79.89) - open/close/unlink 9925 (time 1784233040.37 total 110.07 last 71.85) - open/close/unlink 10456 (time 1784233050.38 total 120.08 last 53.07) - open/close/unlink 11078 (time 1784233060.38 total 130.09 last 62.14) - open/close/unlink 11919 (time 1784233070.39 total 140.10 last 84.02) - open/close/unlink 12926 (time 1784233080.40 total 150.11 last 100.63) - open/close/unlink 13963 (time 1784233090.40 total 160.11 last 103.67) - open/close/unlink 15089 (time 1784233100.44 total 170.14 last 112.20) - open/close/unlink 16349 (time 1784233110.44 total 180.15 last 125.99) - open/close/unlink 17405 (time 1784233120.44 total 190.15 last 105.58) - open/close/unlink 18453 (time 1784233130.45 total 200.15 last 104.74) - open/close/unlink 19661 (time 1784233140.45 total 210.16 last 120.74) - open/close/unlink 20000 (time 1784233143.76 total 213.46 last 102.53) - open/close/unlink 21023 (time 1784233153.76 total 223.47 last 102.27) - open/close/unlink 21970 (time 1784233163.77 total 233.47 last 94.64) - open/close/unlink 23100 (time 1784233173.77 total 243.48 last 112.98) - open/close/unlink 24233 (time 1784233183.78 total 253.48 last 113.21) - open/close/unlink 25318 (time 1784233193.79 total 263.50 last 108.36) - open/close/unlink 26350 (time 1784233203.80 total 273.51 last 103.08) - open/close/unlink 27330 (time 1784233213.81 total 283.52 last 97.89) - open/close/unlink 28338 (time 1784233223.82 total 293.52 last 100.76) - open/close/unlink 29546 (time 1784233233.82 total 303.52 last 120.78) - open/close/unlink 30000 (time 1784233238.96 total 308.66 last 88.33) - open/close/unlink 30967 (time 1784233248.98 total 318.68 last 96.52) - open/close/unlink 32160 (time 1784233258.99 total 328.69 last 119.15) - open/close/unlink 32558 (time 1784233269.02 total 338.72 last 39.68) - open/close/unlink 32911 (time 1784233279.02 total 348.73 last 35.29) - open/close/unlink 33242 (time 1784233289.03 total 358.73 last 33.08) - open/close/unlink 33544 (time 1784233299.08 total 368.79 last 30.04) - open/close/unlink 33843 (time 1784233309.10 total 378.80 last 29.87) - open/close/unlink 34392 (time 1784233319.12 total 388.83 last 54.75) - open/close/unlink 34789 (time 1784233329.13 total 398.83 last 39.68) - open/close/unlink 35176 (time 1784233339.13 total 408.83 last 38.70) - open/close/unlink 35741 (time 1784233349.14 total 418.84 last 56.45) - open/close/unlink 36275 (time 1784233359.14 total 428.85 last 53.36) - open/close/unlink 36901 (time 1784233369.15 total 438.85 last 62.56) - open/close/unlink 37389 (time 1784233379.16 total 448.86 last 48.77) - open/close/unlink 38021 (time 1784233389.16 total 458.87 last 63.15) - open/close/unlink 38648 (time 1784233399.18 total 468.88 last 62.63) - open/close/unlink 39272 (time 1784233409.18 total 478.88 last 62.39) - open/close/unlink 40000 (time 1784233418.24 total 487.95 last 80.30) - open/close/unlink 40882 (time 1784233428.24 total 497.95 last 88.19) - open/close/unlink 41682 (time 1784233438.26 total 507.96 last 79.90) - open/close/unlink 42594 (time 1784233448.27 total 517.97 last 91.13) - open/close/unlink 43472 (time 1784233458.28 total 527.98 last 87.71) - open/close/unlink 44157 (time 1784233468.29 total 538.00 last 68.38) - open/close/unlink 44869 (time 1784233478.30 total 548.01 last 71.14) - open/close/unlink 45561 (time 1784233488.30 total 558.01 last 6 - open/close/unlink 1113 (time 1784232940.28 total 10.01 last 111.22) - open/close/unlink 2115 (time 1784232950.28 total 20.01 last 100.20) - open/close/unlink 3103 (time 1784232960.28 total 30.01 last 98.77) - open/close/unlink 4291 (time 1784232970.28 total 40.01 last 118.75) - open/close/unlink 5196 (time 1784232980.28 total 50.02 last 90.48) - open/close/unlink 5997 (time 1784232990.30 total 60.03 last 79.98) - open/close/unlink 6816 (time 1784233000.31 total 70.04 last 81.82) - open/close/unlink 7670 (time 1784233010.32 total 80.05 last 85.33) - open/close/unlink 8404 (time 1784233020.32 total 90.05 last 73.40) - open/close/unlink 9211 (time 1784233030.33 total 100.06 last 80.63) - open/close/unlink 9930 (time 1784233040.33 total 110.07 last 71.84) - open/close/unlink 10457 (time 1784233050.35 total 120.08 last 52.61) - open/close/unlink 11079 (time 1784233060.35 total 130.09 last 62.19) - open/close/unlink 11923 (time 1784233070.35 total 140.09 last 84.40) - open/close/unlink 12922 (time 1784233080.37 total 150.10 last 99.74) - open/close/unlink 13967 (time 1784233090.37 total 160.11 last 104.46) - open/close/unlink 15100 (time 1784233100.38 total 170.12 last 113.19) - open/close/unlink 16361 (time 1784233110.38 total 180.12 last 126.09) - open/close/unlink 17407 (time 1784233120.39 total 190.13 last 104.50) - open/close/unlink 18450 (time 1784233130.40 total 200.13 last 104.25) - open/close/unlink 19664 (time 1784233140.41 total 210.14 last 121.32) - open/close/unlink 20000 (time 1784233143.71 total 213.45 last 101.54) - open/close/unlink 21024 (time 1784233153.72 total 223.45 last 102.33) - open/close/unlink 21963 (time 1784233163.73 total 233.46 last 93.84) - open/close/unlink 23082 (time 1784233173.73 total 243.46 last 111.86) - open/close/unlink 24211 (time 1784233183.73 total 253.47 last 112.86) - open/close/unlink 25285 (time 1784233193.74 total 263.47 last 107.33) - open/close/unlink 26323 (time 1784233203.75 total 273.48 last 103.68) - open/close/unlink 27313 (time 1784233213.77 total 283.50 last 98.86) - open/close/unlink 28332 (time 1784233223.78 total 293.51 last 101.75) - open/close/unlink 29540 (time 1784233233.79 total 303.53 last 120.63) - open/close/unlink 30000 (time 1784233239.05 total 308.78 last 87.56) - open/close/unlink 30966 (time 1784233249.06 total 318.80 last 96.44) - open/close/unlink 32159 (time 1784233259.08 total 328.81 last 119.17) - open/close/unlink 32559 (time 1784233269.09 total 338.82 last 39.96) - open/close/unlink 32913 (time 1784233279.11 total 348.84 last 35.31) - open/close/unlink 33243 (time 1784233289.14 total 358.87 last 32.91) - open/close/unlink 33546 (time 1784233299.16 total 368.89 last 30.24) - open/close/unlink 33846 (time 1784233309.17 total 378.90 last 29.97) - open/close/unlink 34398 (time 1784233319.19 total 388.93 last 55.06) - open/close/unlink 34790 (time 1784233329.19 total 398.93 last 39.20) - open/close/unlink 35176 (time 1784233339.19 total 408.93 last 38.60) - open/close/unlink 35749 (time 1784233349.20 total 418.94 last 57.24) - open/close/unlink 36272 (time 1784233359.22 total 428.95 last 52.24) - open/close/unlink 36897 (time 1784233369.24 total 438.97 last 62.36) - open/close/unlink 37388 (time 1784233379.24 total 448.97 last 49.08) - open/close/unlink 38024 (time 1784233389.25 total 458.99 last 63.52) - open/close/unlink 38656 (time 1784233399.26 total 468.99 last 63.14) - open/close/unlink 39274 (time 1784233409.26 total 479.00 last 61.80) - open/close/unlink 40000 (time 1784233418.25 total 487.98 last 80.80) - open/close/unlink 40869 (time 1784233428.25 total 497.99 last 86.85) - open/close/unlink 41669 (time 1784233438.27 total 508.01 last 79.84) - open/close/unlink 42583 (time 1784233448.27 total 518.01 last 91.40) - open/close/unlink 43466 (time 1784233458.29 total 528.02 last 88.19) - open/close/unlink 44164 (time 1784233468.29 total 538.02 last 69.76) - open/close/unlink 44873 (time 1784233478.30 total 548.03 last 70.86) - open/close/unlink 45559 (time 1784233488.30 total 558.04 last 69.87) - open/close/unlink 46428 (time 1784233497.64 total 567.53 last 85.57) - open/close/unlink 47517 (time 1784233507.64 total 577.53 last 108.89) - open/close/unlink 48609 (time 1784233517.65 total 587.54 last 109.12) - open/close/unlink 49846 (time 1784233527.65 total 597.54 last 123.67) - open/close/unlink 51138 (time 1784233537.65 total 607.54 last 129.14) - open/close/unlink 52302 (time 1784233547.66 total 617.55 last 116.33) - open/close/unlink 53534 (time 1784233557.67 total 627.56 last 123.14) - open/close/unlink 54725 (time 1784233567.67 total 637.56 last 119.10) - open/close/unlink 55927 (time 1784233577.67 total 647.57 last 120.09) - open/close/unlink 57003 (time 1784233587.69 total 657.58 last 107.46) - open/close/unlink 58161 (time 1784233597.70 total 667.59 last 115.71) - open/close/unlink 59323 (time 1784233607.70 total 677.59 last 116.14) - open/close/unlink 60000 (time 1784233613.66 total 683.55 last 113.67) - open/close/unlink 61323 (time 1784233623.67 total 693.56 last 132.14) - open/close/unlink 62450 (time 1784233633.68 total 703.57 last 112.57) - open/close/unlink 63562 (time 1784233643.70 total 713.59 last 111.00) - open/close/unlink 64728 (time 1784233653.71 total 723.60 last 116.50) total: 64768 open/close/unlink in 724.26 seconds: 89.43 ops/second 9.77) - open/close/unlink 46418 (time 1784233497.88 total 567.74 last 86.37) - open/close/unlink 47522 (time 1784233507.89 total 577.74 last 110.36) - open/close/unlink 48617 (time 1784233517.89 total 587.75 last 109.42) - open/close/unlink 49844 (time 1784233527.89 total 597.75 last 122.69) - open/close/unlink 51130 (time 1784233537.91 total 607.76 last 128.44) - open/close/unlink 52310 (time 1784233547.91 total 617.76 last 117.94) - open/close/unlink 53544 (time 1784233557.92 total 627.77 last 123.35) - open/close/unlink 54734 (time 1784233567.92 total 637.77 last 118.95) - open/close/unlink 55910 (time 1784233577.92 total 647.77 last 117.60) - open/close/unlink 56997 (time 1784233587.92 total 657.77 last 108.69) - open/close/unlink 58152 (time 1784233597.94 total 667.79 last 115.29) - open/close/unlink 59305 (time 1784233607.96 total 677.81 last 115.06) - open/close/unlink 60000 (time 1784233613.92 total 683.77 last 116.60) - open/close/unlink 61321 (time 1784233623.93 total 693.78 last 132.00) - open/close/unlink 62449 (time 1784233633.94 total 703.79 last 112.68) - open/close/unlink 63559 (time 1784233643.94 total 713.79 last 110.99) - open/close/unlink 64730 (time 1784233653.94 total 723.80 last 117.04) total: 64768 open/close/unlink in 724.44 seconds: 89.40 ops/second 64) - open/close/unlink 46398 (time 1784233497.24 total 566.95 last 84.14) - open/close/unlink 47475 (time 1784233507.24 total 576.95 last 107.66) - open/close/unlink 48579 (time 1784233517.24 total 586.95 last 110.40) - open/close/unlink 49792 (time 1784233527.25 total 596.96 last 121.23) - open/close/unlink 51085 (time 1784233537.26 total 606.96 last 129.23) - open/close/unlink 52235 (time 1784233547.26 total 616.97 last 114.96) - open/close/unlink 53491 (time 1784233557.27 total 626.98 last 125.48) - open/close/unlink 54685 (time 1784233567.30 total 637.01 last 119.00) - open/close/unlink 55874 (time 1784233577.31 total 647.01 last 118.85) - open/close/unlink 56959 (time 1784233587.32 total 657.03 last 108.32) - open/close/unlink 58117 (time 1784233597.35 total 667.06 last 115.47) - open/close/unlink 59264 (time 1784233607.36 total 677.07 last 114.62) - open/close/unlink 60000 (time 1784233613.94 total 683.65 last 111.81) - open/close/unlink 61323 (time 1784233623.94 total 693.65 last 132.27) - open/close/unlink 62460 (time 1784233633.96 total 703.67 last 113.52) - open/close/unlink 63569 (time 1784233643.97 total 713.68 last 110.77) - open/close/unlink 64727 (time 1784233653.98 total 723.68 last 115.75) total: 64768 open/close/unlink in 724.38 seconds: 89.41 ops/second 9.19) - open/close/unlink 46444 (time 1784233498.31 total 568.02 last 88.22) - open/close/unlink 47555 (time 1784233508.32 total 578.02 last 111.04) - open/close/unlink 48659 (time 1784233518.32 total 588.02 last 110.38) - open/close/unlink 49889 (time 1784233528.33 total 598.03 last 122.90) - open/close/unlink 51170 (time 1784233538.33 total 608.03 last 128.07) - open/close/unlink 52329 (time 1784233548.33 total 618.04 last 115.88) - open/close/unlink 53557 (time 1784233558.34 total 628.04 last 122.71) - open/close/unlink 54733 (time 1784233568.34 total 638.04 last 117.59) - open/close/unlink 55903 (time 1784233578.34 total 648.04 last 116.99) - open/close/unlink 56990 (time 1784233588.34 total 658.05 last 108.69) - open/close/unlink 58115 (time 1784233598.35 total 668.06 last 112.35) - open/close/unlink 59284 (time 1784233608.36 total 678.06 last 116.84) - open/close/unlink 60000 (time 1784233614.36 total 684.07 last 119.30) - open/close/unlink 61320 (time 1784233624.37 total 694.07 last 131.92) - open/close/unlink 62481 (time 1784233634.37 total 704.08 last 116.03) - open/close/unlink 63570 (time 1784233644.37 total 714.08 last 108.89) - open/close/unlink 64717 (time 1784233654.39 total 724.09 last 114.51) total: 64768 open/close/unlink in 724.93 seconds: 89.34 ops/second 8.55) - open/close/unlink 46431 (time 1784233498.31 total 568.04 last 87.18) - open/close/unlink 47537 (time 1784233508.31 total 578.04 last 110.59) - open/close/unlink 48623 (time 1784233518.31 total 588.04 last 108.59) - open/close/unlink 49860 (time 1784233528.32 total 598.05 last 123.62) - open/close/unlink 51124 (time 1784233538.32 total 608.05 last 126.33) - open/close/unlink 52300 (time 1784233548.32 total 618.05 last 117.59) - open/close/unlink 53533 (time 1784233558.33 total 628.06 last 123.25) - open/close/unlink 54710 (time 1784233568.33 total 638.06 last 117.68) - open/close/unlink 55878 (time 1784233578.33 total 648.06 last 116.76) - open/close/unlink 56964 (time 1784233588.33 total 658.06 last 108.57) - open/close/unlink 58087 (time 1784233598.34 total 668.07 last 112.20) - open/close/unlink 59256 (time 1784233608.35 total 678.09 last 116.76) - open/close/unlink 60000 (time 1784233614.55 total 684.28 last 120.12) - open/close/unlink 61294 (time 1784233624.56 total 694.29 last 129.28) - open/close/unlink 62457 (time 1784233634.56 total 704.29 last 116.27) - open/close/unlink 63549 (time 1784233644.56 total 714.30 last 109.14) - open/close/unlink 64676 (time 1784233654.59 total 724.32 last 112.47) total: 64768 open/close/unlink in 725.72 seconds: 89.25 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete oleg304-server: cannot open 'lustre-ost2': no such pool pdsh@oleg304-client: oleg304-server: ssh exited with exit code 255 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg304-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg304-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg304-server stop mds service on oleg304-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg304-server unloading modules via unload_modules_local on: 'oleg304-server' oleg304-server: oleg304-server.virtnet: executing unload_modules_local oleg304-server: modules unloaded. pdsh@oleg304-client: oleg304-client: ssh exited with exit code 2 pdsh@oleg304-client: oleg304-server: ssh exited with exit code 2 pdsh@oleg304-client: oleg304-client: ssh exited with exit code 2 pdsh@oleg304-client: oleg304-server: ssh exited with exit code 2