== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 14:11:54 (1777572714) start mds service on oleg448-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg448-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-OST0000 oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg448-client.virtnet: -o user_xattr,flock 192.168.204.148@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12328 424 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 991 (time 1777572741.96 total 10.00 last 99.07) - open/close/unlink 2041 (time 1777572751.97 total 20.01 last 104.97) - open/close/unlink 3066 (time 1777572761.97 total 30.01 last 102.45) - open/close/unlink 3867 (time 1777572771.98 total 40.02 last 80.03) - open/close/unlink 4561 (time 1777572781.99 total 50.03 last 69.33) - open/close/unlink 5156 (time 1777572792.00 total 60.03 last 59.48) - open/close/unlink 5811 (time 1777572802.00 total 70.04 last 65.47) - open/close/unlink 6735 (time 1777572812.01 total 80.05 last 92.34) - open/close/unlink 7732 (time 1777572822.01 total 90.05 last 99.62) - open/close/unlink 8678 (time 1777572832.02 total 100.06 last 94.51) - open/close/unlink 9629 (time 1777572842.02 total 110.06 last 95.09) - open/close/unlink 10000 (time 1777572845.92 total 113.96 last 95.22) - open/close/unlink 10999 (time 1777572855.92 total 123.96 last 99.90) - open/close/unlink 12137 (time 1777572865.93 total 133.97 last 113.69) - open/close/unlink 13225 (time 1777572875.94 total 143.97 last 108.76) - open/close/unlink 14365 (time 1777572885.95 total 153.99 last 113.88) - open/close/unlink 15338 (time 1777572895.95 total 163.99 last 97.23) - open/close/unlink 16333 (time 1777572905.96 total 174.00 last 99.43) - open/close/unlink 17319 (time 1777572915.96 total 184.00 last 98.55) - open/close/unlink 18439 (time 1777572925.97 total 194.01 last 111.97) - open/close/unlink 19482 (time 1777572935.97 total 204.01 last 104.27) - open/close/unlink 20000 (time 1777572940.31 total 208.34 last 119.49) - open/close/unlink 21056 (time 1777572950.31 total 218.35 last 105.55) - open/close/unlink 21921 (time 1777572960.31 total 228.35 last 86.47) - open/close/unlink 22802 (time 1777572970.32 total 238.36 last 88.00) - open/close/unlink 23856 (time 1777572980.33 total 248.37 last 105.37) - open/close/unlink 24759 (time 1777572990.34 total 258.38 last 90.21) - open/close/unlink 25697 (time 1777573000.35 total 268.38 last 93.73) - open/close/unlink 26789 (time 1777573010.36 total 278.39 last 109.08) - open/close/unlink 27807 (time 1777573020.36 total 288.40 last 101.76) - open/close/unlink 28622 (time 1777573030.38 total 298.42 last 81.35) - open/close/unlink 29426 (time 1777573040.38 total 308.42 last 80.37) - open/close/unlink 30000 (time 1777573047.86 total 315.90 last 76.79) - open/close/unlink 31048 (time 1777573057.86 total 325.90 last 104.73) - open/close/unlink 32152 (time 1777573067.87 total 335.91 last 110.35) - open/close/unlink 33158 (time 1777573077.87 total 345.91 last 100.54) - open/close/unlink 34147 (time 1777573087.88 total 355.92 last 98.87) - open/close/unlink 35243 (time 1777573097.88 total 365.92 last 109.53) - open/close/unlink 36236 (time 1777573107.89 total 375.93 last 99.25) - open/close/unlink 37250 (time 1777573117.90 total 385.94 last 101.28) - open/close/unlink 37882 (time 1777573127.90 total 395.94 last 63.18) - open/close/unlink 38519 (time 1777573137.92 total 405.96 last 63.58) - open/close/unlink 39093 (time 1777573147.94 total 415.98 last 57.32) - open/close/unlink 39650 (time 1777573157.95 total 425.98 last 55.65) - open/close/unlink 40000 (time 1777573165.60 total 433.63 last 45.76) - open/close/unlink 40676 (time 1777573175.60 total 443.64 last 67.59) - open/close/unlink 41334 (time 1777573185.60 total 453.64 last 65.76) - open/close/unlink 42014 (time 1777573195.62 total 463.66 last 67.87) - open/close/unlink 42749 (time 1777573205.62 total 473.66 last 73.50) - open/close/unlink 43560 (time 1777573215.63 total 483.67 last 81.03) - open/close/unlink 44365 (time 1777573225.64 total 493.67 last 80.47) - open/close/unlink 45238 (time 1777573235.64 total 503.68 last 87.23) - open/close/unlink 46110 (time 1777573245.64 total 513.68 last 87.19) - open/close/unlink 46908 (time 1777573255.65 total 523.69 last 79.75) - open/close/unlink 47655 (time 1777573265.66 total 533.70 last 74.63) - open/close/unlink 48333 (time 1777573275.67 total 543.71 last 67.75) - open/close/unlink 49074 (time 1777573285.67 total 553.71 last 74. - open/close/unlink 1007 (time 1777572742.16 total 10.01 last 100.65) - open/close/unlink 2061 (time 1777572752.16 total 20.01 last 105.39) - open/close/unlink 3082 (time 1777572762.17 total 30.02 last 102.01) - open/close/unlink 3878 (time 1777572772.17 total 40.02 last 79.58) - open/close/unlink 4569 (time 1777572782.19 total 50.03 last 68.99) - open/close/unlink 5169 (time 1777572792.20 total 60.05 last 59.93) - open/close/unlink 5836 (time 1777572802.21 total 70.05 last 66.64) - open/close/unlink 6763 (time 1777572812.22 total 80.06 last 92.64) - open/close/unlink 7758 (time 1777572822.22 total 90.07 last 99.41) - open/close/unlink 8701 (time 1777572832.23 total 100.07 last 94.27) - open/close/unlink 9654 (time 1777572842.23 total 110.08 last 95.25) - open/close/unlink 10000 (time 1777572845.81 total 113.66 last 96.63) - open/close/unlink 10992 (time 1777572855.82 total 123.66 last 99.17) - open/close/unlink 12128 (time 1777572865.83 total 133.67 last 113.49) - open/close/unlink 13217 (time 1777572875.83 total 143.67 last 108.86) - open/close/unlink 14369 (time 1777572885.83 total 153.68 last 115.15) - open/close/unlink 15341 (time 1777572895.83 total 163.68 last 97.20) - open/close/unlink 16336 (time 1777572905.84 total 173.68 last 99.49) - open/close/unlink 17325 (time 1777572915.84 total 183.68 last 98.87) - open/close/unlink 18437 (time 1777572925.85 total 193.69 last 111.13) - open/close/unlink 19477 (time 1777572935.85 total 203.69 last 103.95) - open/close/unlink 20000 (time 1777572940.24 total 208.08 last 119.13) - open/close/unlink 21054 (time 1777572950.24 total 218.09 last 105.36) - open/close/unlink 21921 (time 1777572960.24 total 228.09 last 86.70) - open/close/unlink 22798 (time 1777572970.25 total 238.10 last 87.62) - open/close/unlink 23860 (time 1777572980.25 total 248.10 last 106.19) - open/close/unlink 24776 (time 1777572990.26 total 258.10 last 91.55) - open/close/unlink 25713 (time 1777573000.26 total 268.11 last 93.65) - open/close/unlink 26809 (time 1777573010.27 total 278.11 last 109.58) - open/close/unlink 27819 (time 1777573020.28 total 288.12 last 100.90) - open/close/unlink 28633 (time 1777573030.31 total 298.16 last 81.11) - open/close/unlink 29433 (time 1777573040.32 total 308.17 last 79.92) - open/close/unlink 30000 (time 1777573047.68 total 315.52 last 77.09) - open/close/unlink 31045 (time 1777573057.68 total 325.52 last 104.47) - open/close/unlink 32149 (time 1777573067.68 total 335.53 last 110.35) - open/close/unlink 33154 (time 1777573077.69 total 345.54 last 100.44) - open/close/unlink 34131 (time 1777573087.70 total 355.54 last 97.64) - open/close/unlink 35224 (time 1777573097.70 total 365.55 last 109.25) - open/close/unlink 36222 (time 1777573107.71 total 375.56 last 99.70) - open/close/unlink 37240 (time 1777573117.71 total 385.56 last 101.79) - open/close/unlink 37868 (time 1777573127.73 total 395.58 last 62.67) - open/close/unlink 38505 (time 1777573137.74 total 405.58 last 63.68) - open/close/unlink 39073 (time 1777573147.75 total 415.59 last 56.74) - open/close/unlink 39630 (time 1777573157.75 total 425.60 last 55.68) - open/close/unlink 40000 (time 1777573165.77 total 433.62 last 46.13) - open/close/unlink 40685 (time 1777573175.77 total 443.62 last 68.49) - open/close/unlink 41342 (time 1777573185.78 total 453.62 last 65.69) - open/close/unlink 42026 (time 1777573195.78 total 463.63 last 68.35) - open/close/unlink 42768 (time 1777573205.78 total 473.63 last 74.19) - open/close/unlink 43572 (time 1777573215.80 total 483.64 last 80.30) - open/close/unlink 44380 (time 1777573225.81 total 493.65 last 80.72) - open/close/unlink 45246 (time 1777573235.83 total 503.67 last 86.43) - open/close/unlink 46115 (time 1777573245.83 total 513.68 last 86.86) - open/close/unlink 46905 (time 1777573255.84 total 523.68 last 78.97) - open/close/unlink 47667 (time 1777573265.84 total 533.68 last 76.20) - open/close/unlink 48345 (time 1777573275.84 total 543.69 last 67.74) - open/close/unlink 49089 (time 1777573285.85 total 553.70 last 7 - open/close/unlink 1000 (time 1777572741.97 total 10.00 last 99.99) - open/close/unlink 2062 (time 1777572751.98 total 20.01 last 106.13) - open/close/unlink 3092 (time 1777572761.98 total 30.01 last 102.99) - open/close/unlink 3903 (time 1777572771.99 total 40.01 last 81.06) - open/close/unlink 4596 (time 1777572781.99 total 50.02 last 69.27) - open/close/unlink 5186 (time 1777572792.00 total 60.03 last 58.94) - open/close/unlink 5835 (time 1777572802.00 total 70.03 last 64.89) - open/close/unlink 6760 (time 1777572812.01 total 80.04 last 92.42) - open/close/unlink 7753 (time 1777572822.02 total 90.05 last 99.23) - open/close/unlink 8704 (time 1777572832.03 total 100.06 last 95.00) - open/close/unlink 9657 (time 1777572842.03 total 110.06 last 95.28) - open/close/unlink 10000 (time 1777572845.66 total 113.69 last 94.48) - open/close/unlink 10985 (time 1777572855.67 total 123.70 last 98.42) - open/close/unlink 12130 (time 1777572865.67 total 133.70 last 114.46) - open/close/unlink 13216 (time 1777572875.68 total 143.71 last 108.54) - open/close/unlink 14374 (time 1777572885.69 total 153.71 last 115.69) - open/close/unlink 15356 (time 1777572895.69 total 163.72 last 98.18) - open/close/unlink 16357 (time 1777572905.70 total 173.73 last 99.97) - open/close/unlink 17343 (time 1777572915.71 total 183.73 last 98.56) - open/close/unlink 18455 (time 1777572925.71 total 193.74 last 111.13) - open/close/unlink 19500 (time 1777572935.72 total 203.74 last 104.47) - open/close/unlink 20000 (time 1777572939.99 total 208.02 last 117.01) - open/close/unlink 21055 (time 1777572949.99 total 218.02 last 105.49) - open/close/unlink 21931 (time 1777572960.00 total 228.02 last 87.54) - open/close/unlink 22810 (time 1777572970.01 total 238.03 last 87.82) - open/close/unlink 23857 (time 1777572980.02 total 248.04 last 104.60) - open/close/unlink 24771 (time 1777572990.02 total 258.05 last 91.33) - open/close/unlink 25715 (time 1777573000.02 total 268.05 last 94.39) - open/close/unlink 26808 (time 1777573010.03 total 278.06 last 109.21) - open/close/unlink 27808 (time 1777573020.04 total 288.06 last 99.95) - open/close/unlink 28623 (time 1777573030.04 total 298.07 last 81.45) - open/close/unlink 29423 (time 1777573040.05 total 308.08 last 79.91) - open/close/unlink 30000 (time 1777573047.61 total 315.63 last 76.40) - open/close/unlink 31034 (time 1777573057.61 total 325.63 last 103.40) - open/close/unlink 32144 (time 1777573067.61 total 335.63 last 110.99) - open/close/unlink 33145 (time 1777573077.61 total 345.64 last 100.05) - open/close/unlink 34121 (time 1777573087.61 total 355.64 last 97.58) - open/close/unlink 35211 (time 1777573097.62 total 365.65 last 108.89) - open/close/unlink 36216 (time 1777573107.63 total 375.65 last 100.49) - open/close/unlink 37224 (time 1777573117.63 total 385.66 last 100.75) - open/close/unlink 37864 (time 1777573127.63 total 395.66 last 63.99) - open/close/unlink 38503 (time 1777573137.63 total 405.66 last 63.89) - open/close/unlink 39072 (time 1777573147.65 total 415.68 last 56.79) - open/close/unlink 39625 (time 1777573157.66 total 425.69 last 55.23) - open/close/unlink 40000 (time 1777573165.84 total 433.87 last 45.87) - open/close/unlink 40682 (time 1777573175.84 total 443.87 last 68.18) - open/close/unlink 41345 (time 1777573185.85 total 453.88 last 66.25) - open/close/unlink 42020 (time 1777573195.86 total 463.88 last 67.45) - open/close/unlink 42752 (time 1777573205.86 total 473.89 last 73.16) - open/close/unlink 43560 (time 1777573215.88 total 483.90 last 80.68) - open/close/unlink 44370 (time 1777573225.88 total 493.90 last 80.99) - open/close/unlink 45232 (time 1777573235.88 total 503.91 last 86.17) - open/close/unlink 46108 (time 1777573245.89 total 513.92 last 87.49) - open/close/unlink 46892 (time 1777573255.89 total 523.92 last 78.39) - open/close/unlink 47648 (time 1777573265.91 total 533.93 last 75.52) - open/close/unlink 48318 (time 1777573275.92 total 543.95 last 66.88) - open/close/unlink 49058 (time 1777573285.93 total 553.96 last 73 - open/close/unlink 997 (time 1777572742.14 total 10.00 last 99.68) - open/close/unlink 2044 (time 1777572752.15 total 20.01 last 104.60) - open/close/unlink 3075 (time 1777572762.16 total 30.02 last 103.01) - open/close/unlink 3870 (time 1777572772.17 total 40.03 last 79.40) - open/close/unlink 4552 (time 1777572782.17 total 50.04 last 68.19) - open/close/unlink 5147 (time 1777572792.19 total 60.05 last 59.42) - open/close/unlink 5800 (time 1777572802.19 total 70.05 last 65.30) - open/close/unlink 6729 (time 1777572812.19 total 80.05 last 92.87) - open/close/unlink 7723 (time 1777572822.20 total 90.06 last 99.29) - open/close/unlink 8665 (time 1777572832.20 total 100.07 last 94.19) - open/close/unlink 9618 (time 1777572842.21 total 110.07 last 95.23) - open/close/unlink 10000 (time 1777572846.26 total 114.12 last 94.40) - open/close/unlink 11019 (time 1777572856.26 total 124.12 last 101.84) - open/close/unlink 12153 (time 1777572866.27 total 134.13 last 113.34) - open/close/unlink 13242 (time 1777572876.28 total 144.14 last 108.82) - open/close/unlink 14383 (time 1777572886.29 total 154.15 last 113.96) - open/close/unlink 15356 (time 1777572896.30 total 164.16 last 97.19) - open/close/unlink 16354 (time 1777572906.30 total 174.16 last 99.77) - open/close/unlink 17341 (time 1777572916.31 total 184.17 last 98.60) - open/close/unlink 18456 (time 1777572926.32 total 194.18 last 111.44) - open/close/unlink 19508 (time 1777572936.32 total 204.19 last 105.14) - open/close/unlink 20000 (time 1777572940.48 total 208.34 last 118.32) - open/close/unlink 21043 (time 1777572950.48 total 218.35 last 104.27) - open/close/unlink 21905 (time 1777572960.49 total 228.36 last 86.12) - open/close/unlink 22797 (time 1777572970.50 total 238.36 last 89.13) - open/close/unlink 23851 (time 1777572980.50 total 248.37 last 105.38) - open/close/unlink 24753 (time 1777572990.51 total 258.37 last 90.16) - open/close/unlink 25701 (time 1777573000.51 total 268.37 last 94.80) - open/close/unlink 26790 (time 1777573010.51 total 278.37 last 108.90) - open/close/unlink 27798 (time 1777573020.51 total 288.37 last 100.78) - open/close/unlink 28606 (time 1777573030.52 total 298.38 last 80.71) - open/close/unlink 29411 (time 1777573040.53 total 308.39 last 80.42) - open/close/unlink 30000 (time 1777573048.07 total 315.93 last 78.11) - open/close/unlink 31057 (time 1777573058.08 total 325.94 last 105.62) - open/close/unlink 32175 (time 1777573068.08 total 335.95 last 111.76) - open/close/unlink 33156 (time 1777573078.09 total 345.95 last 98.07) - open/close/unlink 34144 (time 1777573088.09 total 355.95 last 98.78) - open/close/unlink 35236 (time 1777573098.10 total 365.96 last 109.13) - open/close/unlink 36233 (time 1777573108.10 total 375.96 last 99.66) - open/close/unlink 37232 (time 1777573118.12 total 385.98 last 99.76) - open/close/unlink 37865 (time 1777573128.12 total 395.98 last 63.26) - open/close/unlink 38498 (time 1777573138.12 total 405.98 last 63.29) - open/close/unlink 39069 (time 1777573148.12 total 415.98 last 57.10) - open/close/unlink 39629 (time 1777573158.14 total 426.00 last 55.91) - open/close/unlink 40000 (time 1777573166.21 total 434.08 last 45.94) - open/close/unlink 40695 (time 1777573176.22 total 444.08 last 69.49) - open/close/unlink 41346 (time 1777573186.23 total 454.09 last 65.02) - open/close/unlink 42021 (time 1777573196.24 total 464.10 last 67.45) - open/close/unlink 42779 (time 1777573206.24 total 474.10 last 75.79) - open/close/unlink 43585 (time 1777573216.26 total 484.12 last 80.45) - open/close/unlink 44394 (time 1777573226.26 total 494.12 last 80.90) - open/close/unlink 45250 (time 1777573236.27 total 504.13 last 85.49) - open/close/unlink 46140 (time 1777573246.27 total 514.13 last 89.00) - open/close/unlink 46918 (time 1777573256.27 total 524.14 last 77.76) - open/close/unlink 47674 (time 1777573266.29 total 534.15 last 75.50) - open/close/unlink 48350 (time 1777573276.29 total 544.16 last 67.56) - open/close/unlink 49090 (time 1777573286.32 total 554.18 last 73.8 - open/close/unlink 1006 (time 1777572742.17 total 10.00 last 100.60) - open/close/unlink 2054 (time 1777572752.17 total 20.00 last 104.76) - open/close/unlink 3077 (time 1777572762.18 total 30.01 last 102.25) - open/close/unlink 3880 (time 1777572772.19 total 40.02 last 80.23) - open/close/unlink 4574 (time 1777572782.21 total 50.04 last 69.23) - open/close/unlink 5170 (time 1777572792.23 total 60.06 last 59.50) - open/close/unlink 5838 (time 1777572802.23 total 70.06 last 66.78) - open/close/unlink 6766 (time 1777572812.23 total 80.06 last 92.80) - open/close/unlink 7758 (time 1777572822.24 total 90.07 last 99.10) - open/close/unlink 8690 (time 1777572832.25 total 100.08 last 93.09) - open/close/unlink 9643 (time 1777572842.26 total 110.10 last 95.17) - open/close/unlink 10000 (time 1777572845.90 total 113.73 last 98.17) - open/close/unlink 10999 (time 1777572855.90 total 123.74 last 99.87) - open/close/unlink 12126 (time 1777572865.91 total 133.74 last 112.62) - open/close/unlink 13219 (time 1777572875.91 total 143.75 last 109.27) - open/close/unlink 14355 (time 1777572885.92 total 153.75 last 113.57) - open/close/unlink 15324 (time 1777572895.92 total 163.75 last 96.86) - open/close/unlink 16309 (time 1777572905.92 total 173.76 last 98.46) - open/close/unlink 17295 (time 1777572915.93 total 183.76 last 98.53) - open/close/unlink 18422 (time 1777572925.93 total 193.77 last 112.67) - open/close/unlink 19463 (time 1777572935.94 total 203.77 last 104.06) - open/close/unlink 20000 (time 1777572940.41 total 208.24 last 120.01) - open/close/unlink 21054 (time 1777572950.42 total 218.25 last 105.36) - open/close/unlink 21915 (time 1777572960.42 total 228.25 last 86.10) - open/close/unlink 22805 (time 1777572970.42 total 238.25 last 88.95) - open/close/unlink 23856 (time 1777572980.43 total 248.26 last 105.05) - open/close/unlink 24752 (time 1777572990.43 total 258.27 last 89.54) - open/close/unlink 25701 (time 1777573000.43 total 268.27 last 94.90) - open/close/unlink 26794 (time 1777573010.44 total 278.27 last 109.25) - open/close/unlink 27806 (time 1777573020.44 total 288.27 last 101.16) - open/close/unlink 28615 (time 1777573030.45 total 298.28 last 80.85) - open/close/unlink 29417 (time 1777573040.45 total 308.29 last 80.15) - open/close/unlink 30000 (time 1777573047.95 total 315.78 last 77.81) - open/close/unlink 31046 (time 1777573057.95 total 325.78 last 104.58) - open/close/unlink 32153 (time 1777573067.95 total 335.79 last 110.66) - open/close/unlink 33153 (time 1777573077.96 total 345.79 last 99.96) - open/close/unlink 34134 (time 1777573087.96 total 355.79 last 98.07) - open/close/unlink 35236 (time 1777573097.96 total 365.80 last 110.15) - open/close/unlink 36228 (time 1777573107.97 total 375.80 last 99.14) - open/close/unlink 37232 (time 1777573117.97 total 385.81 last 100.38) - open/close/unlink 37860 (time 1777573127.98 total 395.82 last 62.72) - open/close/unlink 38497 (time 1777573137.99 total 405.82 last 63.70) - open/close/unlink 39067 (time 1777573148.00 total 415.83 last 56.92) - open/close/unlink 39618 (time 1777573158.01 total 425.85 last 55.03) - open/close/unlink 40000 (time 1777573166.26 total 434.09 last 46.34) - open/close/unlink 40697 (time 1777573176.26 total 444.09 last 69.66) - open/close/unlink 41357 (time 1777573186.27 total 454.10 last 65.96) - open/close/unlink 42025 (time 1777573196.28 total 464.11 last 66.70) - open/close/unlink 42772 (time 1777573206.29 total 474.12 last 74.65) - open/close/unlink 43574 (time 1777573216.30 total 484.13 last 80.13) - open/close/unlink 44394 (time 1777573226.30 total 494.13 last 81.97) - open/close/unlink 45253 (time 1777573236.31 total 504.14 last 85.83) - open/close/unlink 46139 (time 1777573246.31 total 514.14 last 88.59) - open/close/unlink 46915 (time 1777573256.32 total 524.15 last 77.51) - open/close/unlink 47664 (time 1777573266.34 total 534.18 last 74.75) - open/close/unlink 48336 (time 1777573276.36 total 544.19 last 67.11) - open/close/unlink 49079 (time 1777573286.38 total 554.21 last 744.33) - open/close/unlink 49782 (time 1777573295.86 total 563.71 last 69.24) - open/close/unlink 50000 (time 1777573298.85 total 566.69 last 73.07) - open/close/unlink 50757 (time 1777573308.85 total 576.70 last 75.67) - open/close/unlink 51554 (time 1777573318.86 total 586.70 last 79.65) - open/close/unlink 52350 (time 1777573328.87 total 596.71 last 79.53) - open/close/unlink 53109 (time 1777573338.87 total 606.71 last 75.90) - open/close/unlink 53842 (time 1777573348.87 total 616.72 last 73.24) - open/close/unlink 54567 (time 1777573358.88 total 626.73 last 72.43) - open/close/unlink 55222 (time 1777573368.91 total 636.75 last 65.34) - open/close/unlink 55952 (time 1777573378.91 total 646.76 last 72.97) - open/close/unlink 56825 (time 1777573388.92 total 656.77 last 87.23) - open/close/unlink 57729 (time 1777573398.95 total 666.79 last 90.14) - open/close/unlink 58670 (time 1777573408.95 total 676.80 last 94.07) - open/close/unlink 59683 (time 1777573418.95 total 686.80 last 101.29) - open/close/unlink 60000 (time 1777573422.19 total 690.03 last 98.08) - open/close/unlink 60822 (time 1777573432.19 total 700.04 last 82.17) - open/close/unlink 61613 (time 1777573442.20 total 710.04 last 79.05) - open/close/unlink 62449 (time 1777573452.20 total 720.04 last 83.59) - open/close/unlink 63281 (time 1777573462.20 total 730.04 last 83.18) - open/close/unlink 64118 (time 1777573472.21 total 740.05 last 83.66) total: 64768 open/close/unlink in 747.54 seconds: 86.64 ops/second 10) - open/close/unlink 49768 (time 1777573295.67 total 563.71 last 69.38) - open/close/unlink 50000 (time 1777573298.85 total 566.89 last 72.89) - open/close/unlink 50753 (time 1777573308.86 total 576.90 last 75.25) - open/close/unlink 51545 (time 1777573318.87 total 586.91 last 79.13) - open/close/unlink 52340 (time 1777573328.88 total 596.92 last 79.43) - open/close/unlink 53097 (time 1777573338.88 total 606.92 last 75.68) - open/close/unlink 53830 (time 1777573348.89 total 616.92 last 73.27) - open/close/unlink 54558 (time 1777573358.90 total 626.94 last 72.72) - open/close/unlink 55205 (time 1777573368.92 total 636.96 last 64.55) - open/close/unlink 55927 (time 1777573378.93 total 646.97 last 72.13) - open/close/unlink 56801 (time 1777573388.95 total 656.98 last 87.26) - open/close/unlink 57697 (time 1777573398.96 total 667.00 last 89.47) - open/close/unlink 58628 (time 1777573408.97 total 677.00 last 93.05) - open/close/unlink 59642 (time 1777573418.97 total 687.01 last 101.37) - open/close/unlink 60000 (time 1777573422.72 total 690.76 last 95.50) - open/close/unlink 60806 (time 1777573432.73 total 700.77 last 80.53) - open/close/unlink 61603 (time 1777573442.73 total 710.77 last 79.70) - open/close/unlink 62449 (time 1777573452.73 total 720.77 last 84.55) - open/close/unlink 63278 (time 1777573462.73 total 730.77 last 82.89) - open/close/unlink 64121 (time 1777573472.74 total 740.78 last 84.24) total: 64768 open/close/unlink in 748.86 seconds: 86.49 ops/second 1) - open/close/unlink 49787 (time 1777573296.32 total 564.18 last 69.68) - open/close/unlink 50000 (time 1777573299.16 total 567.02 last 75.06) - open/close/unlink 50750 (time 1777573309.17 total 577.03 last 74.96) - open/close/unlink 51552 (time 1777573319.17 total 587.03 last 80.18) - open/close/unlink 52334 (time 1777573329.17 total 597.03 last 78.19) - open/close/unlink 53098 (time 1777573339.17 total 607.03 last 76.40) - open/close/unlink 53830 (time 1777573349.17 total 617.03 last 73.19) - open/close/unlink 54553 (time 1777573359.18 total 627.04 last 72.26) - open/close/unlink 55196 (time 1777573369.19 total 637.05 last 64.22) - open/close/unlink 55922 (time 1777573379.20 total 647.06 last 72.55) - open/close/unlink 56787 (time 1777573389.22 total 657.08 last 86.33) - open/close/unlink 57702 (time 1777573399.23 total 667.09 last 91.37) - open/close/unlink 58633 (time 1777573409.24 total 677.10 last 93.01) - open/close/unlink 59671 (time 1777573419.24 total 687.10 last 103.79) - open/close/unlink 60000 (time 1777573422.74 total 690.61 last 93.87) - open/close/unlink 60807 (time 1777573432.75 total 700.61 last 80.66) - open/close/unlink 61603 (time 1777573442.75 total 710.62 last 79.57) - open/close/unlink 62435 (time 1777573452.75 total 720.62 last 83.19) - open/close/unlink 63260 (time 1777573462.76 total 730.62 last 82.49) - open/close/unlink 64102 (time 1777573472.76 total 740.62 last 84.16) total: 64768 open/close/unlink in 749.65 seconds: 86.40 ops/second .15) - open/close/unlink 49791 (time 1777573296.38 total 564.21 last 71.18) - open/close/unlink 50000 (time 1777573299.16 total 566.99 last 75.14) - open/close/unlink 50747 (time 1777573309.17 total 577.00 last 74.65) - open/close/unlink 51543 (time 1777573319.18 total 587.01 last 79.54) - open/close/unlink 52336 (time 1777573329.18 total 597.01 last 79.30) - open/close/unlink 53087 (time 1777573339.18 total 607.01 last 75.08) - open/close/unlink 53817 (time 1777573349.19 total 617.02 last 72.91) - open/close/unlink 54537 (time 1777573359.19 total 627.02 last 71.99) - open/close/unlink 55179 (time 1777573369.20 total 637.04 last 64.12) - open/close/unlink 55911 (time 1777573379.20 total 647.04 last 73.19) - open/close/unlink 56780 (time 1777573389.22 total 657.05 last 86.78) - open/close/unlink 57681 (time 1777573399.23 total 667.07 last 89.96) - open/close/unlink 58629 (time 1777573409.24 total 677.07 last 94.77) - open/close/unlink 59657 (time 1777573419.25 total 687.08 last 102.70) - open/close/unlink 60000 (time 1777573422.92 total 690.75 last 93.47) - open/close/unlink 60803 (time 1777573432.93 total 700.76 last 80.21) - open/close/unlink 61594 (time 1777573442.93 total 710.77 last 79.06) - open/close/unlink 62439 (time 1777573452.94 total 720.77 last 84.48) - open/close/unlink 63274 (time 1777573462.94 total 730.77 last 83.46) - open/close/unlink 64116 (time 1777573472.94 total 740.77 last 84.19) total: 64768 open/close/unlink in 749.66 seconds: 86.40 ops/second .93) - open/close/unlink 49755 (time 1777573295.94 total 563.97 last 69.63) - open/close/unlink 50000 (time 1777573299.26 total 567.29 last 73.86) - open/close/unlink 50748 (time 1777573309.27 total 577.29 last 74.77) - open/close/unlink 51544 (time 1777573319.27 total 587.30 last 79.56) - open/close/unlink 52334 (time 1777573329.27 total 597.30 last 78.98) - open/close/unlink 53095 (time 1777573339.28 total 607.30 last 76.07) - open/close/unlink 53842 (time 1777573349.29 total 617.31 last 74.63) - open/close/unlink 54562 (time 1777573359.29 total 627.31 last 71.98) - open/close/unlink 55208 (time 1777573369.30 total 637.33 last 64.53) - open/close/unlink 55937 (time 1777573379.31 total 647.34 last 72.80) - open/close/unlink 56794 (time 1777573389.32 total 657.34 last 85.68) - open/close/unlink 57697 (time 1777573399.32 total 667.34 last 90.28) - open/close/unlink 58637 (time 1777573409.33 total 677.36 last 93.87) - open/close/unlink 59673 (time 1777573419.34 total 687.36 last 103.53) - open/close/unlink 60000 (time 1777573422.89 total 690.92 last 92.10) - open/close/unlink 60805 (time 1777573432.90 total 700.92 last 80.45) - open/close/unlink 61593 (time 1777573442.90 total 710.93 last 78.77) - open/close/unlink 62437 (time 1777573452.90 total 720.93 last 84.40) - open/close/unlink 63269 (time 1777573462.90 total 730.93 last 83.19) - open/close/unlink 64105 (time 1777573472.90 total 740.93 last 83.58) total: 64768 open/close/unlink in 750.25 seconds: 86.33 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete oleg448-server: cannot open 'lustre-ost2': no such pool pdsh@oleg448-client: oleg448-server: ssh exited with exit code 255 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg448-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server stop mds service on oleg448-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server unloading modules via unload_modules_local on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing unload_modules_local oleg448-server: modules unloaded. pdsh@oleg448-client: oleg448-client: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-client: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2