== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 11:57:04 (1777910224) start mds service on oleg337-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg337-server: oleg337-server.virtnet: executing set_default_debug -1 all pdsh@oleg337-client: oleg337-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg337-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg337-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg337-server: oleg337-server.virtnet: executing set_default_debug -1 all pdsh@oleg337-client: oleg337-server: ssh exited with exit code 1 Started lustre-OST0000 oleg337-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg337-client.virtnet: -o user_xattr,flock 192.168.203.137@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12328 424 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 524 (time 1777910261.45 total 10.01 last 52.33) - open/close/unlink 1096 (time 1777910271.47 total 20.03 last 57.09) - open/close/unlink 1630 (time 1777910281.49 total 30.05 last 53.31) - open/close/unlink 2110 (time 1777910291.49 total 40.06 last 47.98) - open/close/unlink 2548 (time 1777910301.50 total 50.06 last 43.76) - open/close/unlink 2931 (time 1777910311.51 total 60.07 last 38.28) - open/close/unlink 3308 (time 1777910321.53 total 70.09 last 37.63) - open/close/unlink 3657 (time 1777910331.53 total 80.10 last 34.87) - open/close/unlink 4049 (time 1777910341.54 total 90.10 last 39.17) - open/close/unlink 4435 (time 1777910351.56 total 100.13 last 38.51) - open/close/unlink 4806 (time 1777910361.57 total 110.14 last 37.06) - open/close/unlink 5255 (time 1777910371.58 total 120.14 last 44.88) - open/close/unlink 5685 (time 1777910381.60 total 130.16 last 42.93) - open/close/unlink 6129 (time 1777910391.60 total 140.16 last 44.37) - open/close/unlink 6530 (time 1777910401.62 total 150.18 last 40.04) - open/close/unlink 6915 (time 1777910411.63 total 160.19 last 38.44) - open/close/unlink 7351 (time 1777910421.65 total 170.21 last 43.53) - open/close/unlink 7778 (time 1777910431.67 total 180.23 last 42.63) - open/close/unlink 8243 (time 1777910441.68 total 190.24 last 46.42) - open/close/unlink 8666 (time 1777910451.69 total 200.25 last 42.27) - open/close/unlink 9240 (time 1777910461.71 total 210.28 last 57.25) - open/close/unlink 9799 (time 1777910471.73 total 220.29 last 55.83) - open/close/unlink 10000 (time 1777910474.64 total 223.21 last 68.89) - open/close/unlink 10625 (time 1777910484.66 total 233.22 last 62.42) - open/close/unlink 11401 (time 1777910494.66 total 243.22 last 77.60) - open/close/unlink 12137 (time 1777910504.66 total 253.22 last 73.57) - open/close/unlink 13141 (time 1777910514.67 total 263.23 last 100.34) - open/close/unlink 14027 (time 1777910524.67 total 273.23 last 88.56) - open/close/unlink 14782 (time 1777910534.67 total 283.23 last 75.49) - open/close/unlink 15639 (time 1777910544.68 total 293.24 last 85.63) - open/close/unlink 16589 (time 1777910554.69 total 303.25 last 94.95) - open/close/unlink 17221 (time 1777910564.70 total 313.26 last 63.13) - open/close/unlink 17882 (time 1777910574.71 total 323.27 last 66.04) - open/close/unlink 18609 (time 1777910584.71 total 333.27 last 72.69) - open/close/unlink 19187 (time 1777910594.71 total 343.27 last 57.79) - open/close/unlink 19912 (time 1777910604.72 total 353.28 last 72.46) - open/close/unlink 20601 (time 1777910614.74 total 363.30 last 68.76) - open/close/unlink 21311 (time 1777910624.74 total 373.30 last 70.98) - open/close/unlink 22114 (time 1777910634.75 total 383.31 last 80.26) - open/close/unlink 22734 (time 1777910644.76 total 393.32 last 61.93) - open/close/unlink 23477 (time 1777910654.76 total 403.32 last 74.29) - open/close/unlink 24150 (time 1777910664.77 total 413.33 last 67.25) - open/close/unlink 24864 (time 1777910674.77 total 423.33 last 71.38) - open/close/unlink 25628 (time 1777910684.78 total 433.34 last 76.34) - open/close/unlink 26299 (time 1777910694.79 total 443.35 last 67.00) - open/close/unlink 27071 (time 1777910704.80 total 453.36 last 77.18) - open/close/unlink 27813 (time 1777910714.81 total 463.37 last 74.12) - open/close/unlink 28692 (time 1777910724.81 total 473.37 last 87.89) - open/close/unlink 29585 (time 1777910734.82 total 483.38 last 89.20) - open/close/unlink 30000 (time 1777910739.93 total 488.50 last 81.13) - open/close/unlink 30713 (time 1777910749.94 total 498.50 last 71.24) - open/close/unlink 31606 (time 1777910759.95 total 508.51 last 89.26) - open/close/unlink 32470 (time 1777910769.95 total 518.51 last 86.35) - open/close/unlink 33300 (time 1777910779.97 total 528.53 last 82.89) - open/close/unlink 34100 (time 1777910789.98 total 538.54 last 79.89) - open/close/unlink 34800 (time 1777910799.98 total 548.54 last 70.00) - open/close/unlink 35461 (time 1777910810.00 total 558.56 last 65.94) - open/close/unlink 36 - open/close/unlink 525 (time 1777910261.31 total 10.01 last 52.46) - open/close/unlink 1101 (time 1777910271.32 total 20.01 last 57.59) - open/close/unlink 1635 (time 1777910281.32 total 30.01 last 53.40) - open/close/unlink 2120 (time 1777910291.33 total 40.03 last 48.43) - open/close/unlink 2558 (time 1777910301.34 total 50.03 last 43.77) - open/close/unlink 2948 (time 1777910311.37 total 60.07 last 38.86) - open/close/unlink 3327 (time 1777910321.40 total 70.09 last 37.80) - open/close/unlink 3670 (time 1777910331.40 total 80.10 last 34.29) - open/close/unlink 4057 (time 1777910341.41 total 90.10 last 38.69) - open/close/unlink 4433 (time 1777910351.42 total 100.12 last 37.54) - open/close/unlink 4803 (time 1777910361.46 total 110.15 last 36.87) - open/close/unlink 5249 (time 1777910371.47 total 120.17 last 44.54) - open/close/unlink 5680 (time 1777910381.49 total 130.18 last 43.04) - open/close/unlink 6123 (time 1777910391.50 total 140.20 last 44.23) - open/close/unlink 6527 (time 1777910401.51 total 150.20 last 40.38) - open/close/unlink 6918 (time 1777910411.53 total 160.22 last 39.02) - open/close/unlink 7352 (time 1777910421.54 total 170.23 last 43.36) - open/close/unlink 7781 (time 1777910431.55 total 180.24 last 42.85) - open/close/unlink 8239 (time 1777910441.56 total 190.25 last 45.75) - open/close/unlink 8659 (time 1777910451.57 total 200.26 last 41.97) - open/close/unlink 9237 (time 1777910461.57 total 210.27 last 57.76) - open/close/unlink 9786 (time 1777910471.58 total 220.27 last 54.87) - open/close/unlink 10000 (time 1777910474.75 total 223.44 last 67.49) - open/close/unlink 10627 (time 1777910484.76 total 233.45 last 62.65) - open/close/unlink 11405 (time 1777910494.76 total 243.46 last 77.76) - open/close/unlink 12136 (time 1777910504.77 total 253.46 last 73.08) - open/close/unlink 13140 (time 1777910514.77 total 263.47 last 100.32) - open/close/unlink 14025 (time 1777910524.78 total 273.48 last 88.42) - open/close/unlink 14779 (time 1777910534.80 total 283.49 last 75.29) - open/close/unlink 15639 (time 1777910544.81 total 293.50 last 85.93) - open/close/unlink 16585 (time 1777910554.81 total 303.51 last 94.54) - open/close/unlink 17214 (time 1777910564.83 total 313.52 last 62.82) - open/close/unlink 17866 (time 1777910574.85 total 323.54 last 65.07) - open/close/unlink 18603 (time 1777910584.85 total 333.55 last 73.66) - open/close/unlink 19185 (time 1777910594.86 total 343.55 last 58.17) - open/close/unlink 19917 (time 1777910604.87 total 353.57 last 73.09) - open/close/unlink 20603 (time 1777910614.89 total 363.58 last 68.50) - open/close/unlink 21296 (time 1777910624.89 total 373.59 last 69.26) - open/close/unlink 22099 (time 1777910634.92 total 383.62 last 80.06) - open/close/unlink 22718 (time 1777910644.94 total 393.63 last 61.81) - open/close/unlink 23468 (time 1777910654.95 total 403.65 last 74.89) - open/close/unlink 24137 (time 1777910664.96 total 413.65 last 66.87) - open/close/unlink 24844 (time 1777910674.96 total 423.66 last 70.65) - open/close/unlink 25605 (time 1777910684.97 total 433.66 last 76.08) - open/close/unlink 26277 (time 1777910694.97 total 443.67 last 67.16) - open/close/unlink 27053 (time 1777910704.98 total 453.67 last 77.56) - open/close/unlink 27795 (time 1777910714.98 total 463.68 last 74.17) - open/close/unlink 28680 (time 1777910724.98 total 473.68 last 88.49) - open/close/unlink 29578 (time 1777910734.99 total 483.68 last 89.72) - open/close/unlink 30000 (time 1777910740.23 total 488.93 last 80.47) - open/close/unlink 30712 (time 1777910750.24 total 498.93 last 71.18) - open/close/unlink 31603 (time 1777910760.24 total 508.94 last 89.05) - open/close/unlink 32458 (time 1777910770.25 total 518.95 last 85.43) - open/close/unlink 33292 (time 1777910780.26 total 528.96 last 83.31) - open/close/unlink 34081 (time 1777910790.27 total 538.96 last 78.84) - open/close/unlink 34782 (time 1777910800.28 total 548.97 last 70.05) - open/close/unlink 35435 (time 1777910810.29 total 558.98 last 65.24) - open/close/unlink 36 - open/close/unlink 522 (time 1777910261.40 total 10.04 last 52.00) - open/close/unlink 1100 (time 1777910271.40 total 20.04 last 57.77) - open/close/unlink 1635 (time 1777910281.41 total 30.05 last 53.47) - open/close/unlink 2123 (time 1777910291.42 total 40.06 last 48.74) - open/close/unlink 2560 (time 1777910301.44 total 50.08 last 43.62) - open/close/unlink 2945 (time 1777910311.44 total 60.08 last 38.49) - open/close/unlink 3320 (time 1777910321.45 total 70.09 last 37.47) - open/close/unlink 3679 (time 1777910331.45 total 80.09 last 35.90) - open/close/unlink 4068 (time 1777910341.45 total 90.09 last 38.89) - open/close/unlink 4453 (time 1777910351.47 total 100.11 last 38.43) - open/close/unlink 4827 (time 1777910361.47 total 110.11 last 37.39) - open/close/unlink 5270 (time 1777910371.50 total 120.14 last 44.20) - open/close/unlink 5700 (time 1777910381.51 total 130.15 last 42.94) - open/close/unlink 6143 (time 1777910391.53 total 140.16 last 44.24) - open/close/unlink 6545 (time 1777910401.55 total 150.19 last 40.12) - open/close/unlink 6936 (time 1777910411.55 total 160.19 last 39.09) - open/close/unlink 7367 (time 1777910421.56 total 170.20 last 43.06) - open/close/unlink 7799 (time 1777910431.56 total 180.20 last 43.19) - open/close/unlink 8264 (time 1777910441.56 total 190.20 last 46.50) - open/close/unlink 8686 (time 1777910451.57 total 200.21 last 42.18) - open/close/unlink 9259 (time 1777910461.57 total 210.21 last 57.29) - open/close/unlink 9818 (time 1777910471.58 total 220.22 last 55.85) - open/close/unlink 10000 (time 1777910474.26 total 222.90 last 67.81) - open/close/unlink 10624 (time 1777910484.28 total 232.92 last 62.31) - open/close/unlink 11389 (time 1777910494.28 total 242.92 last 76.44) - open/close/unlink 12119 (time 1777910504.29 total 252.93 last 72.99) - open/close/unlink 13118 (time 1777910514.29 total 262.93 last 99.85) - open/close/unlink 14009 (time 1777910524.29 total 272.93 last 89.10) - open/close/unlink 14767 (time 1777910534.29 total 282.93 last 75.78) - open/close/unlink 15610 (time 1777910544.30 total 292.94 last 84.24) - open/close/unlink 16569 (time 1777910554.31 total 302.95 last 95.83) - open/close/unlink 17206 (time 1777910564.32 total 312.95 last 63.66) - open/close/unlink 17857 (time 1777910574.32 total 322.96 last 65.07) - open/close/unlink 18593 (time 1777910584.32 total 332.96 last 73.59) - open/close/unlink 19159 (time 1777910594.33 total 342.97 last 56.56) - open/close/unlink 19889 (time 1777910604.35 total 352.99 last 72.84) - open/close/unlink 20581 (time 1777910614.36 total 363.00 last 69.12) - open/close/unlink 21269 (time 1777910624.37 total 373.00 last 68.77) - open/close/unlink 22076 (time 1777910634.37 total 383.01 last 80.64) - open/close/unlink 22698 (time 1777910644.39 total 393.02 last 62.12) - open/close/unlink 23448 (time 1777910654.39 total 403.03 last 74.94) - open/close/unlink 24109 (time 1777910664.39 total 413.03 last 66.09) - open/close/unlink 24829 (time 1777910674.41 total 423.05 last 71.91) - open/close/unlink 25584 (time 1777910684.41 total 433.05 last 75.46) - open/close/unlink 26261 (time 1777910694.42 total 443.06 last 67.68) - open/close/unlink 27029 (time 1777910704.42 total 453.06 last 76.75) - open/close/unlink 27766 (time 1777910714.43 total 463.07 last 73.67) - open/close/unlink 28637 (time 1777910724.44 total 473.07 last 87.03) - open/close/unlink 29533 (time 1777910734.44 total 483.08 last 89.54) - open/close/unlink 30000 (time 1777910740.31 total 488.95 last 79.54) - open/close/unlink 30726 (time 1777910750.32 total 498.96 last 72.57) - open/close/unlink 31613 (time 1777910760.32 total 508.96 last 88.65) - open/close/unlink 32453 (time 1777910770.32 total 518.96 last 83.99) - open/close/unlink 33285 (time 1777910780.33 total 528.97 last 83.12) - open/close/unlink 34066 (time 1777910790.33 total 538.97 last 78.10) - open/close/unlink 34768 (time 1777910800.34 total 548.97 last 70.19) - open/close/unlink 35422 (time 1777910810.34 total 558.98 last 65.35) - open/close/unlink 363 - open/close/unlink 527 (time 1777910261.50 total 10.03 last 52.57) - open/close/unlink 1095 (time 1777910271.50 total 20.03 last 56.76) - open/close/unlink 1626 (time 1777910281.51 total 30.04 last 53.05) - open/close/unlink 2114 (time 1777910291.54 total 40.07 last 48.67) - open/close/unlink 2554 (time 1777910301.55 total 50.08 last 43.95) - open/close/unlink 2940 (time 1777910311.57 total 60.10 last 38.54) - open/close/unlink 3310 (time 1777910321.59 total 70.12 last 36.91) - open/close/unlink 3672 (time 1777910331.61 total 80.14 last 36.13) - open/close/unlink 4063 (time 1777910341.62 total 90.14 last 39.07) - open/close/unlink 4451 (time 1777910351.62 total 100.15 last 38.79) - open/close/unlink 4820 (time 1777910361.62 total 110.15 last 36.89) - open/close/unlink 5260 (time 1777910371.62 total 120.15 last 43.99) - open/close/unlink 5688 (time 1777910381.63 total 130.16 last 42.78) - open/close/unlink 6132 (time 1777910391.64 total 140.17 last 44.33) - open/close/unlink 6529 (time 1777910401.66 total 150.19 last 39.62) - open/close/unlink 6910 (time 1777910411.69 total 160.22 last 38.00) - open/close/unlink 7350 (time 1777910421.70 total 170.23 last 43.96) - open/close/unlink 7776 (time 1777910431.72 total 180.25 last 42.52) - open/close/unlink 8243 (time 1777910441.73 total 190.26 last 46.64) - open/close/unlink 8667 (time 1777910451.73 total 200.26 last 42.40) - open/close/unlink 9230 (time 1777910461.74 total 210.27 last 56.27) - open/close/unlink 9793 (time 1777910471.74 total 220.27 last 56.29) - open/close/unlink 10000 (time 1777910474.78 total 223.31 last 68.10) - open/close/unlink 10628 (time 1777910484.78 total 233.31 last 62.76) - open/close/unlink 11400 (time 1777910494.79 total 243.32 last 77.14) - open/close/unlink 12130 (time 1777910504.79 total 253.32 last 72.99) - open/close/unlink 13139 (time 1777910514.80 total 263.33 last 100.82) - open/close/unlink 14019 (time 1777910524.80 total 273.33 last 87.99) - open/close/unlink 14763 (time 1777910534.81 total 283.34 last 74.33) - open/close/unlink 15621 (time 1777910544.82 total 293.35 last 85.73) - open/close/unlink 16569 (time 1777910554.83 total 303.36 last 94.71) - open/close/unlink 17201 (time 1777910564.83 total 313.36 last 63.19) - open/close/unlink 17849 (time 1777910574.84 total 323.37 last 64.72) - open/close/unlink 18582 (time 1777910584.84 total 333.37 last 73.29) - open/close/unlink 19156 (time 1777910594.86 total 343.39 last 57.28) - open/close/unlink 19889 (time 1777910604.87 total 353.40 last 73.22) - open/close/unlink 20563 (time 1777910614.89 total 363.42 last 67.30) - open/close/unlink 21274 (time 1777910624.90 total 373.43 last 71.01) - open/close/unlink 22080 (time 1777910634.91 total 383.44 last 80.50) - open/close/unlink 22700 (time 1777910644.92 total 393.45 last 61.95) - open/close/unlink 23447 (time 1777910654.93 total 403.45 last 74.66) - open/close/unlink 24126 (time 1777910664.93 total 413.46 last 67.85) - open/close/unlink 24838 (time 1777910674.94 total 423.47 last 71.15) - open/close/unlink 25597 (time 1777910684.94 total 433.47 last 75.88) - open/close/unlink 26265 (time 1777910694.95 total 443.48 last 66.76) - open/close/unlink 27036 (time 1777910704.95 total 453.48 last 77.08) - open/close/unlink 27779 (time 1777910714.95 total 463.48 last 74.27) - open/close/unlink 28661 (time 1777910724.96 total 473.49 last 88.16) - open/close/unlink 29551 (time 1777910734.96 total 483.49 last 88.96) - open/close/unlink 30000 (time 1777910740.64 total 489.17 last 79.04) - open/close/unlink 30725 (time 1777910750.65 total 499.18 last 72.44) - open/close/unlink 31601 (time 1777910760.66 total 509.18 last 87.57) - open/close/unlink 32463 (time 1777910770.66 total 519.19 last 86.19) - open/close/unlink 33308 (time 1777910780.66 total 529.19 last 84.44) - open/close/unlink 34070 (time 1777910790.68 total 539.21 last 76.10) - open/close/unlink 34771 (time 1777910800.68 total 549.21 last 70.07) - open/close/unlink 35422 (time 1777910810.69 total 559.22 last 65.03) - open/close/unlink 36 - open/close/unlink 524 (time 1777910261.02 total 10.01 last 52.34) - open/close/unlink 1086 (time 1777910271.03 total 20.02 last 56.14) - open/close/unlink 1625 (time 1777910281.05 total 30.05 last 53.76) - open/close/unlink 2113 (time 1777910291.08 total 40.07 last 48.70) - open/close/unlink 2547 (time 1777910301.08 total 50.08 last 43.36) - open/close/unlink 2940 (time 1777910311.10 total 60.10 last 39.22) - open/close/unlink 3311 (time 1777910321.11 total 70.10 last 37.09) - open/close/unlink 3663 (time 1777910331.11 total 80.11 last 35.19) - open/close/unlink 4052 (time 1777910341.11 total 90.11 last 38.89) - open/close/unlink 4426 (time 1777910351.14 total 100.13 last 37.32) - open/close/unlink 4791 (time 1777910361.15 total 110.14 last 36.45) - open/close/unlink 5241 (time 1777910371.15 total 120.15 last 44.99) - open/close/unlink 5661 (time 1777910381.16 total 130.15 last 41.97) - open/close/unlink 6100 (time 1777910391.17 total 140.17 last 43.83) - open/close/unlink 6505 (time 1777910401.21 total 150.20 last 40.34) - open/close/unlink 6892 (time 1777910411.23 total 160.23 last 38.61) - open/close/unlink 7325 (time 1777910421.26 total 170.26 last 43.18) - open/close/unlink 7755 (time 1777910431.27 total 180.27 last 42.96) - open/close/unlink 8218 (time 1777910441.28 total 190.27 last 46.27) - open/close/unlink 8645 (time 1777910451.28 total 200.27 last 42.69) - open/close/unlink 9227 (time 1777910461.32 total 210.32 last 57.95) - open/close/unlink 9772 (time 1777910471.33 total 220.32 last 54.49) - open/close/unlink 10000 (time 1777910474.75 total 223.74 last 66.64) - open/close/unlink 10630 (time 1777910484.75 total 233.75 last 62.96) - open/close/unlink 11402 (time 1777910494.77 total 243.76 last 77.08) - open/close/unlink 12129 (time 1777910504.77 total 253.77 last 72.66) - open/close/unlink 13141 (time 1777910514.78 total 263.77 last 101.16) - open/close/unlink 14025 (time 1777910524.79 total 273.78 last 88.34) - open/close/unlink 14778 (time 1777910534.79 total 283.79 last 75.24) - open/close/unlink 15636 (time 1777910544.80 total 293.79 last 85.76) - open/close/unlink 16587 (time 1777910554.81 total 303.80 last 94.97) - open/close/unlink 17223 (time 1777910564.82 total 313.81 last 63.55) - open/close/unlink 17878 (time 1777910574.83 total 323.82 last 65.43) - open/close/unlink 18606 (time 1777910584.84 total 333.84 last 72.72) - open/close/unlink 19187 (time 1777910594.86 total 343.85 last 58.02) - open/close/unlink 19911 (time 1777910604.87 total 353.86 last 72.32) - open/close/unlink 20593 (time 1777910614.88 total 363.87 last 68.11) - open/close/unlink 21295 (time 1777910624.88 total 373.88 last 70.18) - open/close/unlink 22101 (time 1777910634.89 total 383.88 last 80.54) - open/close/unlink 22720 (time 1777910644.90 total 393.89 last 61.85) - open/close/unlink 23470 (time 1777910654.90 total 403.90 last 74.97) - open/close/unlink 24139 (time 1777910664.90 total 413.90 last 66.89) - open/close/unlink 24847 (time 1777910674.90 total 423.90 last 70.79) - open/close/unlink 25603 (time 1777910684.91 total 433.90 last 75.56) - open/close/unlink 26272 (time 1777910694.92 total 443.92 last 66.82) - open/close/unlink 27045 (time 1777910704.93 total 453.92 last 77.26) - open/close/unlink 27785 (time 1777910714.94 total 463.93 last 73.93) - open/close/unlink 28665 (time 1777910724.94 total 473.93 last 88.00) - open/close/unlink 29557 (time 1777910734.94 total 483.93 last 89.16) - open/close/unlink 30000 (time 1777910740.64 total 489.63 last 77.77) - open/close/unlink 30734 (time 1777910750.64 total 499.63 last 73.38) - open/close/unlink 31611 (time 1777910760.65 total 509.64 last 87.63) - open/close/unlink 32462 (time 1777910770.66 total 519.66 last 84.99) - open/close/unlink 33312 (time 1777910780.67 total 529.66 last 84.95) - open/close/unlink 34069 (time 1777910790.68 total 539.68 last 75.60) - open/close/unlink 34775 (time 1777910800.69 total 549.68 last 70.55) - open/close/unlink 35425 (time 1777910810.70 total 559.69 last 64.94) - open/close/unlink 36379 (time 1777910820.29 total 568.99 last 94.36) - open/close/unlink 37144 (time 1777910830.30 total 578.99 last 76.45) - open/close/unlink 38134 (time 1777910840.30 total 589.00 last 98.95) - open/close/unlink 39141 (time 1777910850.32 total 599.01 last 100.56) - open/close/unlink 40000 (time 1777910859.69 total 608.38 last 91.65) - open/close/unlink 41027 (time 1777910869.69 total 618.39 last 102.65) - open/close/unlink 41760 (time 1777910879.69 total 628.39 last 73.30) - open/close/unlink 42588 (time 1777910889.70 total 638.40 last 82.73) - open/close/unlink 43444 (time 1777910899.71 total 648.40 last 85.57) - open/close/unlink 44273 (time 1777910909.72 total 658.41 last 82.82) - open/close/unlink 45238 (time 1777910919.73 total 668.42 last 96.37) - open/close/unlink 45990 (time 1777910929.73 total 678.43 last 75.18) - open/close/unlink 46854 (time 1777910939.74 total 688.44 last 86.31) - open/close/unlink 47739 (time 1777910949.75 total 698.44 last 88.44) - open/close/unlink 48747 (time 1777910959.76 total 708.45 last 100.73) - open/close/unlink 49771 (time 1777910969.76 total 718.46 last 102.32) - open/close/unlink 50000 (time 1777910971.89 total 720.58 last 107.71) - open/close/unlink 50981 (time 1777910981.89 total 730.59 last 98.07) - open/close/unlink 51996 (time 1777910991.90 total 740.59 last 101.45) - open/close/unlink 52983 (time 1777911001.90 total 750.60 last 98.65) - open/close/unlink 54077 (time 1777911011.91 total 760.60 last 109.38) - open/close/unlink 55072 (time 1777911021.91 total 770.61 last 99.44) - open/close/unlink 56146 (time 1777911031.92 total 780.61 last 107.36) - open/close/unlink 57109 (time 1777911041.92 total 790.61 last 96.28) - open/close/unlink 57933 (time 1777911051.93 total 800.62 last 82.34) - open/close/unlink 58732 (time 1777911061.93 total 810.63 last 79.85) - open/close/unlink 59419 (time 1777911071.94 total 820.63 last 68.66) - open/close/unlink 60000 (time 1777911079.26 total 827.96 last 79.31) - open/close/unlink 60774 (time 1777911089.28 total 837.97 last 77.32) - open/close/unlink 61577 (time 1777911099.28 total 847.98 last 80.23) - open/close/unlink 62430 (time 1777911109.29 total 857.98 last 85.25) - open/close/unlink 63100 (time 1777911119.30 total 867.99 last 66.93) - open/close/unlink 63747 (time 1777911129.30 total 878.00 last 64.67) - open/close/unlink 64314 (time 1777911139.32 total 888.01 last 56.63) total: 64768 open/close/unlink in 896.03 seconds: 72.28 ops/second 395 (time 1777910820.00 total 568.57 last 93.39) - open/close/unlink 37169 (time 1777910830.01 total 578.57 last 77.37) - open/close/unlink 38155 (time 1777910840.01 total 588.57 last 98.56) - open/close/unlink 39155 (time 1777910850.01 total 598.58 last 99.99) - open/close/unlink 40000 (time 1777910859.35 total 607.91 last 90.51) - open/close/unlink 41032 (time 1777910869.36 total 617.92 last 103.15) - open/close/unlink 41769 (time 1777910879.36 total 627.93 last 73.63) - open/close/unlink 42603 (time 1777910889.37 total 637.93 last 83.34) - open/close/unlink 43463 (time 1777910899.39 total 647.95 last 85.86) - open/close/unlink 44291 (time 1777910909.40 total 657.96 last 82.74) - open/close/unlink 45253 (time 1777910919.40 total 667.96 last 96.14) - open/close/unlink 46009 (time 1777910929.41 total 677.97 last 75.55) - open/close/unlink 46857 (time 1777910939.41 total 687.97 last 84.79) - open/close/unlink 47742 (time 1777910949.41 total 697.97 last 88.48) - open/close/unlink 48747 (time 1777910959.41 total 707.97 last 100.49) - open/close/unlink 49778 (time 1777910969.42 total 717.99 last 102.98) - open/close/unlink 50000 (time 1777910971.52 total 720.08 last 105.94) - open/close/unlink 50982 (time 1777910981.52 total 730.08 last 98.17) - open/close/unlink 51999 (time 1777910991.53 total 740.09 last 101.64) - open/close/unlink 52974 (time 1777911001.53 total 750.09 last 97.48) - open/close/unlink 54075 (time 1777911011.54 total 760.10 last 110.06) - open/close/unlink 55072 (time 1777911021.55 total 770.11 last 99.56) - open/close/unlink 56143 (time 1777911031.55 total 780.11 last 107.07) - open/close/unlink 57114 (time 1777911041.56 total 790.12 last 96.99) - open/close/unlink 57946 (time 1777911051.57 total 800.13 last 83.13) - open/close/unlink 58737 (time 1777911061.58 total 810.14 last 79.04) - open/close/unlink 59415 (time 1777911071.58 total 820.14 last 67.78) - open/close/unlink 60000 (time 1777911078.86 total 827.42 last 80.43) - open/close/unlink 60775 (time 1777911088.86 total 837.42 last 77.49) - open/close/unlink 61551 (time 1777911098.86 total 847.42 last 77.59) - open/close/unlink 62406 (time 1777911108.87 total 857.43 last 85.41) - open/close/unlink 63090 (time 1777911118.88 total 867.44 last 68.37) - open/close/unlink 63725 (time 1777911128.88 total 877.45 last 63.44) - open/close/unlink 64296 (time 1777911138.89 total 887.45 last 57.06) total: 64768 open/close/unlink in 895.93 seconds: 72.29 ops/second 70 (time 1777910820.34 total 568.98 last 94.79) - open/close/unlink 37133 (time 1777910830.35 total 578.99 last 76.25) - open/close/unlink 38108 (time 1777910840.36 total 588.99 last 97.46) - open/close/unlink 39109 (time 1777910850.36 total 599.00 last 100.05) - open/close/unlink 40000 (time 1777910860.13 total 608.77 last 91.19) - open/close/unlink 41035 (time 1777910870.14 total 618.78 last 103.41) - open/close/unlink 41770 (time 1777910880.15 total 628.79 last 73.43) - open/close/unlink 42596 (time 1777910890.16 total 638.80 last 82.52) - open/close/unlink 43449 (time 1777910900.17 total 648.81 last 85.23) - open/close/unlink 44297 (time 1777910910.18 total 658.82 last 84.71) - open/close/unlink 45262 (time 1777910920.18 total 668.82 last 96.48) - open/close/unlink 46014 (time 1777910930.19 total 678.83 last 75.14) - open/close/unlink 46885 (time 1777910940.19 total 688.83 last 87.09) - open/close/unlink 47766 (time 1777910950.20 total 698.83 last 88.04) - open/close/unlink 48786 (time 1777910960.20 total 708.84 last 101.97) - open/close/unlink 49810 (time 1777910970.20 total 718.84 last 102.36) - open/close/unlink 50809 (time 1777910980.21 total 728.85 last 99.86) - open/close/unlink 51848 (time 1777910990.21 total 738.85 last 103.86) - open/close/unlink 52782 (time 1777911000.22 total 748.86 last 93.32) - open/close/unlink 53871 (time 1777911010.22 total 758.86 last 108.86) - open/close/unlink 54857 (time 1777911020.23 total 768.87 last 98.53) - open/close/unlink 55947 (time 1777911030.24 total 778.88 last 108.92) - open/close/unlink 56947 (time 1777911040.24 total 788.88 last 100.00) - open/close/unlink 57792 (time 1777911050.24 total 798.88 last 84.44) - open/close/unlink 58595 (time 1777911060.26 total 808.90 last 80.16) - open/close/unlink 59276 (time 1777911070.26 total 818.90 last 68.09) - open/close/unlink 60000 (time 1777911079.39 total 828.03 last 79.32) - open/close/unlink 60774 (time 1777911089.40 total 838.04 last 77.36) - open/close/unlink 61561 (time 1777911099.40 total 848.04 last 78.67) - open/close/unlink 62415 (time 1777911109.41 total 858.05 last 85.34) - open/close/unlink 63087 (time 1777911119.42 total 868.06 last 67.14) - open/close/unlink 63731 (time 1777911129.42 total 878.06 last 64.39) - open/close/unlink 64302 (time 1777911139.43 total 888.07 last 57.04) total: 64768 open/close/unlink in 896.49 seconds: 72.25 ops/second 389 (time 1777910820.70 total 569.69 last 96.38) - open/close/unlink 37148 (time 1777910830.70 total 579.70 last 75.86) - open/close/unlink 38153 (time 1777910840.71 total 589.71 last 100.41) - open/close/unlink 39134 (time 1777910850.73 total 599.72 last 97.97) - open/close/unlink 40000 (time 1777910859.92 total 608.92 last 94.17) - open/close/unlink 41028 (time 1777910869.93 total 618.92 last 102.77) - open/close/unlink 41776 (time 1777910879.93 total 628.93 last 74.74) - open/close/unlink 42605 (time 1777910889.94 total 638.94 last 82.84) - open/close/unlink 43465 (time 1777910899.94 total 648.94 last 85.99) - open/close/unlink 44303 (time 1777910909.95 total 658.94 last 83.74) - open/close/unlink 45262 (time 1777910919.96 total 668.95 last 95.82) - open/close/unlink 46015 (time 1777910929.97 total 678.96 last 75.23) - open/close/unlink 46871 (time 1777910939.97 total 688.96 last 85.57) - open/close/unlink 47759 (time 1777910949.98 total 698.97 last 88.74) - open/close/unlink 48772 (time 1777910959.98 total 708.97 last 101.26) - open/close/unlink 49783 (time 1777910969.99 total 718.98 last 101.03) - open/close/unlink 50780 (time 1777910980.00 total 728.99 last 99.63) - open/close/unlink 51819 (time 1777910990.00 total 739.00 last 103.83) - open/close/unlink 52760 (time 1777911000.01 total 749.00 last 94.07) - open/close/unlink 53857 (time 1777911010.01 total 759.00 last 109.69) - open/close/unlink 54836 (time 1777911020.01 total 769.00 last 97.87) - open/close/unlink 55927 (time 1777911030.01 total 779.01 last 109.05) - open/close/unlink 56931 (time 1777911040.02 total 789.01 last 100.33) - open/close/unlink 57793 (time 1777911050.03 total 799.02 last 86.15) - open/close/unlink 58590 (time 1777911060.03 total 809.02 last 79.68) - open/close/unlink 59265 (time 1777911070.03 total 819.03 last 67.46) - open/close/unlink 60000 (time 1777911079.36 total 828.35 last 78.86) - open/close/unlink 60772 (time 1777911089.36 total 838.36 last 77.14) - open/close/unlink 61568 (time 1777911099.37 total 848.37 last 79.51) - open/close/unlink 62421 (time 1777911109.39 total 858.39 last 85.16) - open/close/unlink 63089 (time 1777911119.41 total 868.40 last 66.70) - open/close/unlink 63726 (time 1777911129.41 total 878.41 last 63.64) - open/close/unlink 64290 (time 1777911139.42 total 888.42 last 56.35) total: 64768 open/close/unlink in 896.91 seconds: 72.21 ops/second 388 (time 1777910820.70 total 569.23 last 96.53) - open/close/unlink 37133 (time 1777910830.71 total 579.23 last 74.45) - open/close/unlink 38121 (time 1777910840.71 total 589.24 last 98.73) - open/close/unlink 39110 (time 1777910850.72 total 599.25 last 98.78) - open/close/unlink 40000 (time 1777910860.18 total 608.71 last 94.09) - open/close/unlink 41025 (time 1777910870.19 total 618.72 last 102.46) - open/close/unlink 41768 (time 1777910880.19 total 628.72 last 74.25) - open/close/unlink 42597 (time 1777910890.20 total 638.73 last 82.85) - open/close/unlink 43455 (time 1777910900.21 total 648.74 last 85.70) - open/close/unlink 44298 (time 1777910910.22 total 658.75 last 84.21) - open/close/unlink 45251 (time 1777910920.23 total 668.76 last 95.25) - open/close/unlink 45996 (time 1777910930.23 total 678.76 last 74.46) - open/close/unlink 46858 (time 1777910940.24 total 688.77 last 86.16) - open/close/unlink 47741 (time 1777910950.25 total 698.78 last 88.19) - open/close/unlink 48759 (time 1777910960.26 total 708.79 last 101.71) - open/close/unlink 49774 (time 1777910970.27 total 718.80 last 101.41) - open/close/unlink 50771 (time 1777910980.28 total 728.81 last 99.61) - open/close/unlink 51816 (time 1777910990.28 total 738.81 last 104.50) - open/close/unlink 52752 (time 1777911000.28 total 748.81 last 93.57) - open/close/unlink 53847 (time 1777911010.29 total 758.81 last 109.43) - open/close/unlink 54834 (time 1777911020.29 total 768.82 last 98.67) - open/close/unlink 55917 (time 1777911030.29 total 778.82 last 108.25) - open/close/unlink 56906 (time 1777911040.30 total 788.82 last 98.87) - open/close/unlink 57757 (time 1777911050.31 total 798.84 last 84.99) - open/close/unlink 58552 (time 1777911060.33 total 808.86 last 79.32) - open/close/unlink 59223 (time 1777911070.34 total 818.86 last 67.07) - open/close/unlink 60000 (time 1777911080.08 total 828.61 last 79.77) - open/close/unlink 60761 (time 1777911090.09 total 838.61 last 76.03) - open/close/unlink 61561 (time 1777911100.09 total 848.62 last 79.97) - open/close/unlink 62411 (time 1777911110.10 total 858.63 last 84.91) - open/close/unlink 63093 (time 1777911120.11 total 868.64 last 68.13) - open/close/unlink 63704 (time 1777911130.11 total 878.64 last 61.07) - open/close/unlink 64270 (time 1777911140.13 total 888.66 last 56.50) total: 64768 open/close/unlink in 898.31 seconds: 72.10 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete oleg337-server: cannot open 'lustre-ost2': no such pool pdsh@oleg337-client: oleg337-server: ssh exited with exit code 255 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg337-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg337-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg337-server stop mds service on oleg337-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg337-server unloading modules via unload_modules_local on: 'oleg337-server' oleg337-server: oleg337-server.virtnet: executing unload_modules_local oleg337-server: modules unloaded. pdsh@oleg337-client: oleg337-client: ssh exited with exit code 2 pdsh@oleg337-client: oleg337-server: ssh exited with exit code 2 pdsh@oleg337-client: oleg337-client: ssh exited with exit code 2 pdsh@oleg337-client: oleg337-server: ssh exited with exit code 2