== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 10:46:16 (1775832376) start mds service on oleg203-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg203-server: oleg203-server.virtnet: executing set_default_debug -1 all pdsh@oleg203-client: oleg203-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg203-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg203-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg203-server: oleg203-server.virtnet: executing set_default_debug -1 all pdsh@oleg203-client: oleg203-server: ssh exited with exit code 1 Started lustre-OST0000 oleg203-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg203-client.virtnet: -o user_xattr,flock 192.168.202.103@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12328 424 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 309 (time 1775832432.24 total 10.01 last 30.88) - open/close/unlink 645 (time 1775832442.27 total 20.03 last 33.50) - open/close/unlink 1062 (time 1775832452.27 total 30.04 last 41.70) - open/close/unlink 1385 (time 1775832462.30 total 40.07 last 32.20) - open/close/unlink 1734 (time 1775832472.32 total 50.09 last 34.81) - open/close/unlink 2102 (time 1775832482.34 total 60.10 last 36.75) - open/close/unlink 2520 (time 1775832492.34 total 70.11 last 41.78) - open/close/unlink 2984 (time 1775832502.35 total 80.12 last 46.33) - open/close/unlink 3393 (time 1775832512.36 total 90.13 last 40.87) - open/close/unlink 3799 (time 1775832522.37 total 100.13 last 40.58) - open/close/unlink 4200 (time 1775832532.38 total 110.15 last 40.05) - open/close/unlink 4610 (time 1775832542.39 total 120.16 last 40.94) - open/close/unlink 5061 (time 1775832552.40 total 130.17 last 45.07) - open/close/unlink 5522 (time 1775832562.43 total 140.20 last 45.95) - open/close/unlink 5980 (time 1775832572.45 total 150.22 last 45.71) - open/close/unlink 6377 (time 1775832582.46 total 160.23 last 39.66) - open/close/unlink 6796 (time 1775832592.49 total 170.26 last 41.78) - open/close/unlink 7218 (time 1775832602.50 total 180.27 last 42.15) - open/close/unlink 7647 (time 1775832612.50 total 190.27 last 42.90) - open/close/unlink 8066 (time 1775832622.51 total 200.28 last 41.85) - open/close/unlink 8506 (time 1775832632.53 total 210.29 last 43.94) - open/close/unlink 8872 (time 1775832642.53 total 220.30 last 36.57) - open/close/unlink 9273 (time 1775832652.54 total 230.31 last 40.08) - open/close/unlink 9774 (time 1775832662.56 total 240.32 last 50.01) - open/close/unlink 10000 (time 1775832667.68 total 245.44 last 44.16) - open/close/unlink 10493 (time 1775832677.69 total 255.46 last 49.24) - open/close/unlink 10936 (time 1775832687.70 total 265.47 last 44.24) - open/close/unlink 11386 (time 1775832697.70 total 275.47 last 44.99) - open/close/unlink 11913 (time 1775832707.71 total 285.47 last 52.69) - open/close/unlink 12404 (time 1775832717.74 total 295.50 last 48.95) - open/close/unlink 12916 (time 1775832727.74 total 305.51 last 51.15) - open/close/unlink 13500 (time 1775832737.76 total 315.52 last 58.32) - open/close/unlink 14080 (time 1775832747.76 total 325.53 last 57.96) - open/close/unlink 14634 (time 1775832757.77 total 335.54 last 55.37) - open/close/unlink 15226 (time 1775832767.80 total 345.56 last 59.04) - open/close/unlink 15720 (time 1775832777.80 total 355.56 last 49.40) - open/close/unlink 16233 (time 1775832787.80 total 365.57 last 51.29) - open/close/unlink 16846 (time 1775832797.82 total 375.58 last 61.20) - open/close/unlink 17405 (time 1775832807.85 total 385.61 last 55.72) - open/close/unlink 17927 (time 1775832817.86 total 395.63 last 52.11) - open/close/unlink 18424 (time 1775832827.88 total 405.65 last 49.62) - open/close/unlink 18878 (time 1775832837.89 total 415.66 last 45.34) - open/close/unlink 19333 (time 1775832847.90 total 425.67 last 45.46) - open/close/unlink 19800 (time 1775832857.91 total 435.68 last 46.66) - open/close/unlink 20000 (time 1775832862.07 total 439.84 last 48.06) - open/close/unlink 20497 (time 1775832872.09 total 449.85 last 49.61) - open/close/unlink 20951 (time 1775832882.09 total 459.86 last 45.39) - open/close/unlink 21438 (time 1775832892.09 total 469.86 last 48.70) - open/close/unlink 21894 (time 1775832902.10 total 479.87 last 45.55) - open/close/unlink 22311 (time 1775832912.10 total 489.87 last 41.69) - open/close/unlink 22757 (time 1775832922.11 total 499.88 last 44.56) - open/close/unlink 23147 (time 1775832932.12 total 509.88 last 38.99) - open/close/unlink 23551 (time 1775832942.13 total 519.90 last 40.34) - open/close/unlink 24040 (time 1775832952.14 total 529.90 last 48.87) - open/close/unlink 24575 (time 1775832962.14 total 539.90 last 53.50) - open/close/unlink 25088 (time 1775832972.16 total 549.93 last 51.19) - open/close/unlink 25684 (time 1775832982.16 total 559.93 last 59.59) - open/close/unlink 26324 - open/close/unlink 318 (time 1775832432.45 total 10.02 last 31.74) - open/close/unlink 650 (time 1775832442.47 total 20.04 last 33.14) - open/close/unlink 1071 (time 1775832452.49 total 30.06 last 42.01) - open/close/unlink 1401 (time 1775832462.50 total 40.07 last 32.95) - open/close/unlink 1749 (time 1775832472.52 total 50.09 last 34.73) - open/close/unlink 2107 (time 1775832482.53 total 60.10 last 35.76) - open/close/unlink 2525 (time 1775832492.54 total 70.11 last 41.76) - open/close/unlink 2982 (time 1775832502.56 total 80.13 last 45.60) - open/close/unlink 3396 (time 1775832512.60 total 90.17 last 41.26) - open/close/unlink 3798 (time 1775832522.60 total 100.17 last 40.19) - open/close/unlink 4204 (time 1775832532.60 total 110.18 last 40.58) - open/close/unlink 4605 (time 1775832542.62 total 120.19 last 40.04) - open/close/unlink 5046 (time 1775832552.64 total 130.21 last 44.01) - open/close/unlink 5496 (time 1775832562.65 total 140.22 last 44.94) - open/close/unlink 5937 (time 1775832572.68 total 150.25 last 44.00) - open/close/unlink 6331 (time 1775832582.69 total 160.26 last 39.33) - open/close/unlink 6757 (time 1775832592.72 total 170.29 last 42.49) - open/close/unlink 7182 (time 1775832602.72 total 180.29 last 42.48) - open/close/unlink 7613 (time 1775832612.74 total 190.31 last 43.03) - open/close/unlink 8047 (time 1775832622.75 total 200.32 last 43.36) - open/close/unlink 8489 (time 1775832632.76 total 210.33 last 44.16) - open/close/unlink 8855 (time 1775832642.77 total 220.34 last 36.55) - open/close/unlink 9251 (time 1775832652.78 total 230.35 last 39.57) - open/close/unlink 9758 (time 1775832662.80 total 240.37 last 50.58) - open/close/unlink 10000 (time 1775832668.15 total 245.72 last 45.21) - open/close/unlink 10492 (time 1775832678.16 total 255.73 last 49.16) - open/close/unlink 10926 (time 1775832688.17 total 265.74 last 43.36) - open/close/unlink 11388 (time 1775832698.18 total 275.76 last 46.14) - open/close/unlink 11920 (time 1775832708.20 total 285.77 last 53.12) - open/close/unlink 12394 (time 1775832718.21 total 295.78 last 47.33) - open/close/unlink 12909 (time 1775832728.22 total 305.79 last 51.49) - open/close/unlink 13494 (time 1775832738.22 total 315.79 last 58.47) - open/close/unlink 14083 (time 1775832748.23 total 325.80 last 58.84) - open/close/unlink 14647 (time 1775832758.24 total 335.81 last 56.35) - open/close/unlink 15240 (time 1775832768.25 total 345.82 last 59.25) - open/close/unlink 15732 (time 1775832778.27 total 355.84 last 49.09) - open/close/unlink 16253 (time 1775832788.29 total 365.86 last 51.98) - open/close/unlink 16854 (time 1775832798.31 total 375.88 last 59.99) - open/close/unlink 17411 (time 1775832808.32 total 385.89 last 55.65) - open/close/unlink 17922 (time 1775832818.32 total 395.89 last 51.09) - open/close/unlink 18419 (time 1775832828.33 total 405.90 last 49.65) - open/close/unlink 18879 (time 1775832838.34 total 415.91 last 45.98) - open/close/unlink 19339 (time 1775832848.36 total 425.93 last 45.91) - open/close/unlink 19813 (time 1775832858.37 total 435.94 last 47.34) - open/close/unlink 20000 (time 1775832862.36 total 439.93 last 46.82) - open/close/unlink 20489 (time 1775832872.37 total 449.94 last 48.86) - open/close/unlink 20940 (time 1775832882.37 total 459.94 last 45.09) - open/close/unlink 21423 (time 1775832892.38 total 469.95 last 48.28) - open/close/unlink 21877 (time 1775832902.39 total 479.96 last 45.36) - open/close/unlink 22298 (time 1775832912.39 total 489.96 last 42.09) - open/close/unlink 22738 (time 1775832922.40 total 499.97 last 43.94) - open/close/unlink 23128 (time 1775832932.41 total 509.98 last 38.97) - open/close/unlink 23542 (time 1775832942.43 total 520.00 last 41.33) - open/close/unlink 24036 (time 1775832952.44 total 530.01 last 49.36) - open/close/unlink 24580 (time 1775832962.44 total 540.01 last 54.39) - open/close/unlink 25084 (time 1775832972.45 total 550.02 last 50.34) - open/close/unlink 25681 (time 1775832982.45 total 560.02 last 59.69) - open/close/unlink 26312 - open/close/unlink 303 (time 1775832431.26 total 10.09 last 30.03) - open/close/unlink 635 (time 1775832441.27 total 20.10 last 33.16) - open/close/unlink 1043 (time 1775832451.28 total 30.11 last 40.77) - open/close/unlink 1372 (time 1775832461.30 total 40.12 last 32.85) - open/close/unlink 1706 (time 1775832471.30 total 50.13 last 33.39) - open/close/unlink 2076 (time 1775832481.36 total 60.19 last 36.78) - open/close/unlink 2474 (time 1775832491.37 total 70.20 last 39.78) - open/close/unlink 2949 (time 1775832501.37 total 80.20 last 47.49) - open/close/unlink 3350 (time 1775832511.37 total 90.20 last 40.09) - open/close/unlink 3763 (time 1775832521.38 total 100.21 last 41.27) - open/close/unlink 4162 (time 1775832531.40 total 110.23 last 39.82) - open/close/unlink 4573 (time 1775832541.40 total 120.23 last 41.10) - open/close/unlink 5007 (time 1775832551.44 total 130.26 last 43.24) - open/close/unlink 5485 (time 1775832561.46 total 140.28 last 47.70) - open/close/unlink 5928 (time 1775832571.47 total 150.30 last 44.25) - open/close/unlink 6314 (time 1775832581.47 total 160.30 last 38.60) - open/close/unlink 6729 (time 1775832591.48 total 170.31 last 41.45) - open/close/unlink 7139 (time 1775832601.51 total 180.34 last 40.88) - open/close/unlink 7582 (time 1775832611.52 total 190.35 last 44.24) - open/close/unlink 8004 (time 1775832621.56 total 200.39 last 42.06) - open/close/unlink 8446 (time 1775832631.58 total 210.41 last 44.11) - open/close/unlink 8816 (time 1775832641.60 total 220.43 last 36.90) - open/close/unlink 9210 (time 1775832651.63 total 230.45 last 39.31) - open/close/unlink 9717 (time 1775832661.64 total 240.47 last 50.63) - open/close/unlink 10000 (time 1775832667.85 total 246.68 last 45.59) - open/close/unlink 10484 (time 1775832677.87 total 256.70 last 48.29) - open/close/unlink 10919 (time 1775832687.88 total 266.71 last 43.45) - open/close/unlink 11378 (time 1775832697.89 total 276.71 last 45.88) - open/close/unlink 11906 (time 1775832707.89 total 286.72 last 52.79) - open/close/unlink 12385 (time 1775832717.91 total 296.73 last 47.83) - open/close/unlink 12888 (time 1775832727.92 total 306.75 last 50.24) - open/close/unlink 13463 (time 1775832737.92 total 316.75 last 57.49) - open/close/unlink 14040 (time 1775832747.93 total 326.76 last 57.63) - open/close/unlink 14602 (time 1775832757.93 total 336.76 last 56.18) - open/close/unlink 15186 (time 1775832767.94 total 346.77 last 58.38) - open/close/unlink 15688 (time 1775832777.94 total 356.77 last 50.19) - open/close/unlink 16199 (time 1775832787.94 total 366.77 last 51.08) - open/close/unlink 16791 (time 1775832797.95 total 376.78 last 59.17) - open/close/unlink 17346 (time 1775832807.95 total 386.78 last 55.49) - open/close/unlink 17862 (time 1775832817.97 total 396.79 last 51.52) - open/close/unlink 18365 (time 1775832827.98 total 406.81 last 50.22) - open/close/unlink 18833 (time 1775832838.00 total 416.83 last 46.71) - open/close/unlink 19286 (time 1775832848.01 total 426.84 last 45.27) - open/close/unlink 19757 (time 1775832858.02 total 436.85 last 47.05) - open/close/unlink 20000 (time 1775832863.12 total 441.95 last 47.60) - open/close/unlink 20486 (time 1775832873.14 total 451.97 last 48.53) - open/close/unlink 20947 (time 1775832883.15 total 461.97 last 46.07) - open/close/unlink 21409 (time 1775832893.15 total 471.98 last 46.18) - open/close/unlink 21870 (time 1775832903.17 total 482.00 last 46.01) - open/close/unlink 22281 (time 1775832913.19 total 492.02 last 41.00) - open/close/unlink 22740 (time 1775832923.20 total 502.03 last 45.88) - open/close/unlink 23130 (time 1775832933.21 total 512.04 last 38.97) - open/close/unlink 23552 (time 1775832943.21 total 522.04 last 42.20) - open/close/unlink 24044 (time 1775832953.22 total 532.05 last 49.16) - open/close/unlink 24591 (time 1775832963.24 total 542.07 last 54.58) - open/close/unlink 25105 (time 1775832973.25 total 552.08 last 51.34) - open/close/unlink 25695 (time 1775832983.28 total 562.11 last 58.81) - open/close/unlink 26342 - open/close/unlink 314 (time 1775832432.11 total 10.02 last 31.35) - open/close/unlink 649 (time 1775832442.13 total 20.03 last 33.45) - open/close/unlink 1064 (time 1775832452.14 total 30.04 last 41.44) - open/close/unlink 1387 (time 1775832462.15 total 40.05 last 32.27) - open/close/unlink 1726 (time 1775832472.17 total 50.08 last 33.82) - open/close/unlink 2092 (time 1775832482.20 total 60.10 last 36.51) - open/close/unlink 2506 (time 1775832492.21 total 70.11 last 41.35) - open/close/unlink 2959 (time 1775832502.22 total 80.12 last 45.27) - open/close/unlink 3366 (time 1775832512.23 total 90.14 last 40.63) - open/close/unlink 3770 (time 1775832522.25 total 100.16 last 40.32) - open/close/unlink 4171 (time 1775832532.27 total 110.17 last 40.04) - open/close/unlink 4578 (time 1775832542.29 total 120.19 last 40.61) - open/close/unlink 5020 (time 1775832552.30 total 130.21 last 44.14) - open/close/unlink 5477 (time 1775832562.32 total 140.22 last 45.65) - open/close/unlink 5927 (time 1775832572.33 total 150.23 last 44.94) - open/close/unlink 6314 (time 1775832582.35 total 160.26 last 38.61) - open/close/unlink 6733 (time 1775832592.43 total 170.33 last 41.58) - open/close/unlink 7150 (time 1775832602.43 total 180.34 last 41.68) - open/close/unlink 7585 (time 1775832612.43 total 190.34 last 43.50) - open/close/unlink 8005 (time 1775832622.44 total 200.35 last 41.96) - open/close/unlink 8441 (time 1775832632.45 total 210.35 last 43.59) - open/close/unlink 8805 (time 1775832642.45 total 220.35 last 36.38) - open/close/unlink 9196 (time 1775832652.47 total 230.38 last 39.01) - open/close/unlink 9695 (time 1775832662.49 total 240.39 last 49.84) - open/close/unlink 10000 (time 1775832669.01 total 246.91 last 46.76) - open/close/unlink 10480 (time 1775832679.04 total 256.95 last 47.83) - open/close/unlink 10920 (time 1775832689.05 total 266.95 last 43.97) - open/close/unlink 11389 (time 1775832699.06 total 276.96 last 46.87) - open/close/unlink 11940 (time 1775832709.06 total 286.97 last 55.07) - open/close/unlink 12395 (time 1775832719.07 total 296.97 last 45.47) - open/close/unlink 12902 (time 1775832729.07 total 306.98 last 50.69) - open/close/unlink 13488 (time 1775832739.08 total 316.98 last 58.57) - open/close/unlink 14067 (time 1775832749.09 total 326.99 last 57.83) - open/close/unlink 14637 (time 1775832759.10 total 337.00 last 56.94) - open/close/unlink 15233 (time 1775832769.11 total 347.01 last 59.53) - open/close/unlink 15710 (time 1775832779.11 total 357.01 last 47.70) - open/close/unlink 16236 (time 1775832789.12 total 367.02 last 52.56) - open/close/unlink 16831 (time 1775832799.13 total 377.03 last 59.45) - open/close/unlink 17384 (time 1775832809.15 total 387.05 last 55.19) - open/close/unlink 17896 (time 1775832819.15 total 397.06 last 51.18) - open/close/unlink 18388 (time 1775832829.16 total 407.06 last 49.17) - open/close/unlink 18840 (time 1775832839.16 total 417.07 last 45.17) - open/close/unlink 19293 (time 1775832849.18 total 427.08 last 45.24) - open/close/unlink 19779 (time 1775832859.18 total 437.08 last 48.59) - open/close/unlink 20000 (time 1775832864.08 total 441.98 last 45.12) - open/close/unlink 20480 (time 1775832874.09 total 451.99 last 47.94) - open/close/unlink 20960 (time 1775832884.10 total 462.00 last 47.96) - open/close/unlink 21411 (time 1775832894.11 total 472.01 last 45.06) - open/close/unlink 21881 (time 1775832904.12 total 482.03 last 46.93) - open/close/unlink 22285 (time 1775832914.13 total 492.04 last 40.36) - open/close/unlink 22736 (time 1775832924.17 total 502.07 last 44.95) - open/close/unlink 23125 (time 1775832934.18 total 512.09 last 38.84) - open/close/unlink 23547 (time 1775832944.19 total 522.10 last 42.16) - open/close/unlink 24042 (time 1775832954.21 total 532.11 last 49.42) - open/close/unlink 24595 (time 1775832964.22 total 542.13 last 55.22) - open/close/unlink 25117 (time 1775832974.24 total 552.14 last 52.13) - open/close/unlink 25708 (time 1775832984.25 total 562.15 last 59.04) - open/close/unlink 26363 - open/close/unlink 311 (time 1775832432.09 total 10.02 last 31.03) - open/close/unlink 641 (time 1775832442.09 total 20.03 last 32.98) - open/close/unlink 1050 (time 1775832452.11 total 30.04 last 40.83) - open/close/unlink 1377 (time 1775832462.13 total 40.07 last 32.63) - open/close/unlink 1712 (time 1775832472.15 total 50.08 last 33.45) - open/close/unlink 2072 (time 1775832482.17 total 60.11 last 35.90) - open/close/unlink 2484 (time 1775832492.18 total 70.12 last 41.16) - open/close/unlink 2941 (time 1775832502.20 total 80.13 last 45.65) - open/close/unlink 3359 (time 1775832512.22 total 90.16 last 41.69) - open/close/unlink 3765 (time 1775832522.24 total 100.17 last 40.54) - open/close/unlink 4167 (time 1775832532.25 total 110.18 last 40.15) - open/close/unlink 4571 (time 1775832542.27 total 120.21 last 40.31) - open/close/unlink 5014 (time 1775832552.27 total 130.21 last 44.30) - open/close/unlink 5471 (time 1775832562.28 total 140.22 last 45.66) - open/close/unlink 5917 (time 1775832572.31 total 150.24 last 44.48) - open/close/unlink 6310 (time 1775832582.34 total 160.27 last 39.18) - open/close/unlink 6733 (time 1775832592.37 total 170.31 last 42.16) - open/close/unlink 7148 (time 1775832602.39 total 180.32 last 41.43) - open/close/unlink 7583 (time 1775832612.40 total 190.33 last 43.47) - open/close/unlink 8007 (time 1775832622.40 total 200.34 last 42.37) - open/close/unlink 8448 (time 1775832632.41 total 210.34 last 44.08) - open/close/unlink 8819 (time 1775832642.41 total 220.35 last 37.09) - open/close/unlink 9210 (time 1775832652.44 total 230.37 last 39.01) - open/close/unlink 9707 (time 1775832662.45 total 240.39 last 49.63) - open/close/unlink 10000 (time 1775832668.80 total 246.74 last 46.11) - open/close/unlink 10476 (time 1775832678.82 total 256.75 last 47.53) - open/close/unlink 10909 (time 1775832688.83 total 266.76 last 43.27) - open/close/unlink 11370 (time 1775832698.84 total 276.78 last 46.02) - open/close/unlink 11920 (time 1775832708.85 total 286.79 last 54.95) - open/close/unlink 12375 (time 1775832718.86 total 296.79 last 45.48) - open/close/unlink 12883 (time 1775832728.87 total 306.81 last 50.72) - open/close/unlink 13466 (time 1775832738.88 total 316.82 last 58.24) - open/close/unlink 14052 (time 1775832748.91 total 326.84 last 58.48) - open/close/unlink 14613 (time 1775832758.92 total 336.85 last 56.03) - open/close/unlink 15209 (time 1775832768.93 total 346.86 last 59.56) - open/close/unlink 15695 (time 1775832778.93 total 356.87 last 48.57) - open/close/unlink 16206 (time 1775832788.93 total 366.87 last 51.09) - open/close/unlink 16813 (time 1775832798.94 total 376.87 last 60.66) - open/close/unlink 17368 (time 1775832808.95 total 386.88 last 55.46) - open/close/unlink 17881 (time 1775832818.96 total 396.90 last 51.23) - open/close/unlink 18365 (time 1775832828.96 total 406.90 last 48.39) - open/close/unlink 18823 (time 1775832838.98 total 416.92 last 45.72) - open/close/unlink 19275 (time 1775832849.00 total 426.93 last 45.13) - open/close/unlink 19756 (time 1775832859.00 total 436.93 last 48.08) - open/close/unlink 20000 (time 1775832864.40 total 442.34 last 45.16) - open/close/unlink 20482 (time 1775832874.41 total 452.35 last 48.16) - open/close/unlink 20968 (time 1775832884.42 total 462.36 last 48.54) - open/close/unlink 21433 (time 1775832894.45 total 472.38 last 46.40) - open/close/unlink 21911 (time 1775832904.46 total 482.40 last 47.74) - open/close/unlink 22319 (time 1775832914.47 total 492.40 last 40.77) - open/close/unlink 22773 (time 1775832924.51 total 502.44 last 45.22) - open/close/unlink 23161 (time 1775832934.53 total 512.46 last 38.72) - open/close/unlink 23590 (time 1775832944.53 total 522.46 last 42.90) - open/close/unlink 24076 (time 1775832954.53 total 532.46 last 48.60) - open/close/unlink 24629 (time 1775832964.54 total 542.47 last 55.26) - open/close/unlink 25146 (time 1775832974.54 total 552.48 last 51.66) - open/close/unlink 25736 (time 1775832984.55 total 562.49 last 58.95) - open/close/unlink 26389 (time 1775832992.17 total 569.94 last 63.94) - open/close/unlink 26858 (time 1775833002.18 total 579.94 last 53.37) - open/close/unlink 27404 (time 1775833012.18 total 589.95 last 54.56) - open/close/unlink 28050 (time 1775833022.20 total 599.97 last 64.50) - open/close/unlink 28665 (time 1775833032.22 total 609.98 last 61.39) - open/close/unlink 29216 (time 1775833042.23 total 620.00 last 55.02) - open/close/unlink 29828 (time 1775833052.24 total 630.00 last 61.17) - open/close/unlink 30000 (time 1775833054.95 total 632.72 last 63.32) - open/close/unlink 30637 (time 1775833064.97 total 642.73 last 63.62) - open/close/unlink 31248 (time 1775833074.98 total 652.75 last 61.00) - open/close/unlink 31938 (time 1775833084.99 total 662.76 last 68.93) - open/close/unlink 32649 (time 1775833095.00 total 672.76 last 71.07) - open/close/unlink 33275 (time 1775833105.00 total 682.77 last 62.58) - open/close/unlink 33978 (time 1775833115.00 total 692.77 last 70.30) - open/close/unlink 34656 (time 1775833125.01 total 702.78 last 67.74) - open/close/unlink 35292 (time 1775833135.03 total 712.79 last 63.50) - open/close/unlink 35922 (time 1775833145.03 total 722.79 last 63.00) - open/close/unlink 36565 (time 1775833155.03 total 732.80 last 64.27) - open/close/unlink 37218 (time 1775833165.03 total 742.80 last 65.30) - open/close/unlink 38022 (time 1775833175.04 total 752.81 last 80.34) - open/close/unlink 38809 (time 1775833185.05 total 762.81 last 78.63) - open/close/unlink 39483 (time 1775833195.05 total 772.82 last 67.38) - open/close/unlink 40000 (time 1775833202.42 total 780.18 last 70.18) - open/close/unlink 40730 (time 1775833212.42 total 790.19 last 72.95) - open/close/unlink 41481 (time 1775833222.42 total 800.19 last 75.09) - open/close/unlink 42348 (time 1775833232.43 total 810.20 last 86.62) - open/close/unlink 43212 (time 1775833242.44 total 820.21 last 86.34) - open/close/unlink 44030 (time 1775833252.44 total 830.21 last 81.76) - open/close/unlink 44799 (time 1775833262.45 total 840.22 last 76.86) - open/close/unlink 45636 (time 1775833272.46 total 850.22 last 83.65) - open/close/unlink 46523 (time 1775833282.47 total 860.23 last 88.61) - open/close/unlink 47392 (time 1775833292.47 total 870.24 last 86.82) - open/close/unlink 48293 (time 1775833302.48 total 880.25 last 90.05) - open/close/unlink 49142 (time 1775833312.48 total 890.25 last 84.87) - open/close/unlink 50000 (time 1775833321.40 total 899.17 last 96.19) - open/close/unlink 51285 (time 1775833331.41 total 909.17 last 128.46) - open/close/unlink 52333 (time 1775833341.42 total 919.18 last 104.70) - open/close/unlink 53532 (time 1775833351.42 total 929.19 last 119.85) - open/close/unlink 54740 (time 1775833361.42 total 939.19 last 120.77) - open/close/unlink 55904 (time 1775833371.43 total 949.19 last 116.35) - open/close/unlink 57045 (time 1775833381.43 total 959.20 last 114.03) - open/close/unlink 57885 (time 1775833391.44 total 969.20 last 83.98) - open/close/unlink 58901 (time 1775833401.44 total 979.21 last 101.53) - open/close/unlink 59989 (time 1775833411.45 total 989.21 last 108.75) - open/close/unlink 61130 (time 1775833421.46 total 999.22 last 114.00) - open/close/unlink 62225 (time 1775833431.46 total 1009.22 last 109.48) - open/close/unlink 63624 (time 1775833441.46 total 1019.23 last 139.83) total: 64768 open/close/unlink in 1028.28 seconds: 62.99 ops/second (time 1775832993.30 total 572.13 last 64.58) - open/close/unlink 26859 (time 1775833003.30 total 582.13 last 51.68) - open/close/unlink 27412 (time 1775833013.31 total 592.14 last 55.28) - open/close/unlink 28043 (time 1775833023.32 total 602.15 last 63.02) - open/close/unlink 28658 (time 1775833033.34 total 612.16 last 61.41) - open/close/unlink 29212 (time 1775833043.35 total 622.18 last 55.32) - open/close/unlink 29835 (time 1775833053.37 total 632.20 last 62.16) - open/close/unlink 30000 (time 1775833055.60 total 634.43 last 74.14) - open/close/unlink 30616 (time 1775833065.60 total 644.43 last 61.58) - open/close/unlink 31229 (time 1775833075.60 total 654.43 last 61.29) - open/close/unlink 31916 (time 1775833085.62 total 664.45 last 68.59) - open/close/unlink 32616 (time 1775833095.63 total 674.46 last 69.91) - open/close/unlink 33244 (time 1775833105.64 total 684.47 last 62.74) - open/close/unlink 33945 (time 1775833115.65 total 694.48 last 70.02) - open/close/unlink 34621 (time 1775833125.66 total 704.49 last 67.54) - open/close/unlink 35257 (time 1775833135.67 total 714.49 last 63.57) - open/close/unlink 35886 (time 1775833145.67 total 724.50 last 62.88) - open/close/unlink 36551 (time 1775833155.68 total 734.51 last 66.43) - open/close/unlink 37214 (time 1775833165.68 total 744.51 last 66.29) - open/close/unlink 38023 (time 1775833175.68 total 754.51 last 80.90) - open/close/unlink 38817 (time 1775833185.70 total 764.53 last 79.24) - open/close/unlink 39491 (time 1775833195.70 total 774.53 last 67.38) - open/close/unlink 40000 (time 1775833202.68 total 781.51 last 72.93) - open/close/unlink 40734 (time 1775833212.69 total 791.52 last 73.36) - open/close/unlink 41481 (time 1775833222.70 total 801.53 last 74.63) - open/close/unlink 42348 (time 1775833232.70 total 811.53 last 86.69) - open/close/unlink 43224 (time 1775833242.71 total 821.54 last 87.50) - open/close/unlink 44038 (time 1775833252.72 total 831.55 last 81.34) - open/close/unlink 44805 (time 1775833262.73 total 841.55 last 76.64) - open/close/unlink 45639 (time 1775833272.73 total 851.56 last 83.38) - open/close/unlink 46527 (time 1775833282.73 total 861.56 last 88.80) - open/close/unlink 47393 (time 1775833292.73 total 871.56 last 86.54) - open/close/unlink 48289 (time 1775833302.74 total 881.57 last 89.56) - open/close/unlink 49137 (time 1775833312.75 total 891.58 last 84.71) - open/close/unlink 50000 (time 1775833321.63 total 900.45 last 97.21) - open/close/unlink 51274 (time 1775833331.63 total 910.45 last 127.40) - open/close/unlink 52315 (time 1775833341.63 total 920.46 last 104.10) - open/close/unlink 53514 (time 1775833351.63 total 930.46 last 119.85) - open/close/unlink 54722 (time 1775833361.63 total 940.46 last 120.80) - open/close/unlink 55891 (time 1775833371.64 total 950.47 last 116.83) - open/close/unlink 57012 (time 1775833381.65 total 960.47 last 112.01) - open/close/unlink 57867 (time 1775833391.65 total 970.48 last 85.45) - open/close/unlink 58890 (time 1775833401.66 total 980.49 last 102.22) - open/close/unlink 59966 (time 1775833411.67 total 990.50 last 107.46) - open/close/unlink 61108 (time 1775833421.68 total 1000.51 last 114.12) - open/close/unlink 62209 (time 1775833431.68 total 1010.51 last 110.08) - open/close/unlink 63622 (time 1775833441.69 total 1020.51 last 141.21) total: 64768 open/close/unlink in 1030.00 seconds: 62.88 ops/second (time 1775832992.45 total 570.02 last 63.09) - open/close/unlink 26839 (time 1775833002.46 total 580.04 last 52.64) - open/close/unlink 27378 (time 1775833012.47 total 590.05 last 53.85) - open/close/unlink 28017 (time 1775833022.48 total 600.05 last 63.86) - open/close/unlink 28640 (time 1775833032.49 total 610.06 last 62.25) - open/close/unlink 29191 (time 1775833042.49 total 620.06 last 55.08) - open/close/unlink 29815 (time 1775833052.50 total 630.08 last 62.31) - open/close/unlink 30000 (time 1775833055.23 total 632.80 last 67.95) - open/close/unlink 30622 (time 1775833065.24 total 642.81 last 62.13) - open/close/unlink 31228 (time 1775833075.26 total 652.83 last 60.50) - open/close/unlink 31925 (time 1775833085.27 total 662.84 last 69.61) - open/close/unlink 32632 (time 1775833095.28 total 672.85 last 70.59) - open/close/unlink 33262 (time 1775833105.29 total 682.86 last 62.96) - open/close/unlink 33956 (time 1775833115.29 total 692.86 last 69.39) - open/close/unlink 34627 (time 1775833125.31 total 702.88 last 67.01) - open/close/unlink 35262 (time 1775833135.31 total 712.88 last 63.44) - open/close/unlink 35890 (time 1775833145.32 total 722.89 last 62.76) - open/close/unlink 36553 (time 1775833155.32 total 732.89 last 66.29) - open/close/unlink 37209 (time 1775833165.33 total 742.90 last 65.58) - open/close/unlink 38007 (time 1775833175.34 total 752.91 last 79.69) - open/close/unlink 38806 (time 1775833185.34 total 762.91 last 79.88) - open/close/unlink 39473 (time 1775833195.35 total 772.92 last 66.67) - open/close/unlink 40000 (time 1775833202.74 total 780.31 last 71.25) - open/close/unlink 40732 (time 1775833212.75 total 790.32 last 73.13) - open/close/unlink 41476 (time 1775833222.76 total 800.33 last 74.37) - open/close/unlink 42338 (time 1775833232.76 total 810.33 last 86.18) - open/close/unlink 43215 (time 1775833242.77 total 820.34 last 87.63) - open/close/unlink 44029 (time 1775833252.78 total 830.35 last 81.27) - open/close/unlink 44808 (time 1775833262.79 total 840.36 last 77.88) - open/close/unlink 45640 (time 1775833272.79 total 850.36 last 83.18) - open/close/unlink 46524 (time 1775833282.79 total 860.36 last 88.34) - open/close/unlink 47393 (time 1775833292.80 total 870.37 last 86.84) - open/close/unlink 48292 (time 1775833302.80 total 880.37 last 89.87) - open/close/unlink 49133 (time 1775833312.81 total 890.38 last 84.03) - open/close/unlink 50000 (time 1775833321.67 total 899.24 last 97.90) - open/close/unlink 51276 (time 1775833331.67 total 909.24 last 127.57) - open/close/unlink 52324 (time 1775833341.67 total 919.24 last 104.76) - open/close/unlink 53524 (time 1775833351.67 total 929.24 last 120.00) - open/close/unlink 54726 (time 1775833361.69 total 939.26 last 120.06) - open/close/unlink 55903 (time 1775833371.69 total 949.26 last 117.63) - open/close/unlink 57019 (time 1775833381.70 total 959.27 last 111.53) - open/close/unlink 57870 (time 1775833391.72 total 969.29 last 84.96) - open/close/unlink 58898 (time 1775833401.72 total 979.29 last 102.72) - open/close/unlink 59967 (time 1775833411.74 total 989.31 last 106.75) - open/close/unlink 61103 (time 1775833421.75 total 999.32 last 113.48) - open/close/unlink 62216 (time 1775833431.75 total 1009.33 last 111.23) - open/close/unlink 63627 (time 1775833441.76 total 1019.33 last 141.07) total: 64768 open/close/unlink in 1028.85 seconds: 62.95 ops/second (time 1775832994.25 total 572.16 last 65.45) - open/close/unlink 26863 (time 1775833004.27 total 582.17 last 49.94) - open/close/unlink 27437 (time 1775833014.27 total 592.18 last 57.36) - open/close/unlink 28050 (time 1775833024.27 total 602.18 last 61.30) - open/close/unlink 28659 (time 1775833034.27 total 612.18 last 60.90) - open/close/unlink 29214 (time 1775833044.28 total 622.19 last 55.45) - open/close/unlink 29837 (time 1775833054.29 total 632.19 last 62.28) - open/close/unlink 30000 (time 1775833056.35 total 634.26 last 78.87) - open/close/unlink 30612 (time 1775833066.37 total 644.27 last 61.12) - open/close/unlink 31224 (time 1775833076.37 total 654.27 last 61.17) - open/close/unlink 31935 (time 1775833086.38 total 664.28 last 71.04) - open/close/unlink 32642 (time 1775833096.39 total 674.29 last 70.62) - open/close/unlink 33276 (time 1775833106.40 total 684.30 last 63.35) - open/close/unlink 33961 (time 1775833116.40 total 694.30 last 68.48) - open/close/unlink 34625 (time 1775833126.40 total 704.30 last 66.39) - open/close/unlink 35262 (time 1775833136.41 total 714.32 last 63.63) - open/close/unlink 35891 (time 1775833146.42 total 724.33 last 62.83) - open/close/unlink 36548 (time 1775833156.43 total 734.34 last 65.64) - open/close/unlink 37204 (time 1775833166.44 total 744.34 last 65.56) - open/close/unlink 38031 (time 1775833176.44 total 754.35 last 82.64) - open/close/unlink 38806 (time 1775833186.45 total 764.36 last 77.43) - open/close/unlink 39462 (time 1775833196.47 total 774.37 last 65.51) - open/close/unlink 40000 (time 1775833203.79 total 781.69 last 73.47) - open/close/unlink 40734 (time 1775833213.80 total 791.71 last 73.32) - open/close/unlink 41503 (time 1775833223.81 total 801.71 last 76.87) - open/close/unlink 42374 (time 1775833233.81 total 811.71 last 87.08) - open/close/unlink 43230 (time 1775833243.81 total 821.72 last 85.55) - open/close/unlink 44022 (time 1775833253.82 total 831.72 last 79.17) - open/close/unlink 44802 (time 1775833263.82 total 841.73 last 77.95) - open/close/unlink 45652 (time 1775833273.83 total 851.73 last 84.96) - open/close/unlink 46528 (time 1775833283.83 total 861.74 last 87.54) - open/close/unlink 47423 (time 1775833293.84 total 871.74 last 89.47) - open/close/unlink 48313 (time 1775833303.84 total 881.75 last 88.96) - open/close/unlink 49170 (time 1775833313.84 total 891.75 last 85.69) - open/close/unlink 50000 (time 1775833322.22 total 900.12 last 99.09) - open/close/unlink 51275 (time 1775833332.23 total 910.13 last 127.43) - open/close/unlink 52325 (time 1775833342.23 total 920.13 last 104.98) - open/close/unlink 53526 (time 1775833352.23 total 930.13 last 120.06) - open/close/unlink 54712 (time 1775833362.23 total 940.14 last 118.58) - open/close/unlink 55920 (time 1775833372.23 total 950.14 last 120.76) - open/close/unlink 57004 (time 1775833382.24 total 960.14 last 108.39) - open/close/unlink 57860 (time 1775833392.25 total 970.15 last 85.49) - open/close/unlink 58891 (time 1775833402.25 total 980.16 last 103.04) - open/close/unlink 59984 (time 1775833412.26 total 990.16 last 109.23) - open/close/unlink 61116 (time 1775833422.26 total 1000.17 last 113.19) - open/close/unlink 62261 (time 1775833432.26 total 1010.17 last 114.47) - open/close/unlink 63678 (time 1775833442.27 total 1020.17 last 141.62) total: 64768 open/close/unlink in 1029.62 seconds: 62.90 ops/second (time 1775832994.56 total 572.50 last 65.26) - open/close/unlink 26889 (time 1775833004.58 total 582.51 last 49.91) - open/close/unlink 27473 (time 1775833014.59 total 592.52 last 58.35) - open/close/unlink 28088 (time 1775833024.59 total 602.52 last 61.50) - open/close/unlink 28703 (time 1775833034.59 total 612.52 last 61.49) - open/close/unlink 29268 (time 1775833044.60 total 622.53 last 56.44) - open/close/unlink 29893 (time 1775833054.61 total 632.54 last 62.47) - open/close/unlink 30529 (time 1775833064.61 total 642.54 last 63.57) - open/close/unlink 31136 (time 1775833074.62 total 652.56 last 60.63) - open/close/unlink 31823 (time 1775833084.63 total 662.56 last 68.64) - open/close/unlink 32528 (time 1775833094.63 total 672.57 last 70.49) - open/close/unlink 33168 (time 1775833104.64 total 682.57 last 63.95) - open/close/unlink 33871 (time 1775833114.68 total 692.61 last 70.04) - open/close/unlink 34554 (time 1775833124.68 total 702.61 last 68.28) - open/close/unlink 35192 (time 1775833134.68 total 712.61 last 63.80) - open/close/unlink 35817 (time 1775833144.68 total 722.62 last 62.47) - open/close/unlink 36459 (time 1775833154.68 total 732.62 last 64.20) - open/close/unlink 37103 (time 1775833164.69 total 742.62 last 64.37) - open/close/unlink 37909 (time 1775833174.70 total 752.63 last 80.52) - open/close/unlink 38698 (time 1775833184.70 total 762.64 last 78.89) - open/close/unlink 39390 (time 1775833194.71 total 772.64 last 69.14) - open/close/unlink 40000 (time 1775833203.35 total 781.28 last 70.61) - open/close/unlink 40729 (time 1775833213.35 total 791.28 last 72.89) - open/close/unlink 41492 (time 1775833223.37 total 801.30 last 76.17) - open/close/unlink 42341 (time 1775833233.37 total 811.31 last 84.86) - open/close/unlink 43202 (time 1775833243.38 total 821.31 last 86.07) - open/close/unlink 43999 (time 1775833253.40 total 831.33 last 79.55) - open/close/unlink 44782 (time 1775833263.41 total 841.34 last 78.22) - open/close/unlink 45623 (time 1775833273.42 total 851.35 last 84.01) - open/close/unlink 46508 (time 1775833283.43 total 861.37 last 88.35) - open/close/unlink 47388 (time 1775833293.44 total 871.38 last 87.92) - open/close/unlink 48280 (time 1775833303.45 total 881.39 last 89.10) - open/close/unlink 49131 (time 1775833313.46 total 891.40 last 85.04) - open/close/unlink 50000 (time 1775833322.27 total 900.21 last 98.63) - open/close/unlink 51276 (time 1775833332.28 total 910.21 last 127.55) - open/close/unlink 52328 (time 1775833342.29 total 920.22 last 105.10) - open/close/unlink 53530 (time 1775833352.29 total 930.22 last 120.16) - open/close/unlink 54704 (time 1775833362.29 total 940.22 last 117.39) - open/close/unlink 55926 (time 1775833372.29 total 950.23 last 122.15) - open/close/unlink 56995 (time 1775833382.30 total 960.23 last 106.83) - open/close/unlink 57849 (time 1775833392.30 total 970.24 last 85.39) - open/close/unlink 58881 (time 1775833402.31 total 980.24 last 103.12) - open/close/unlink 59978 (time 1775833412.31 total 990.25 last 109.64) - open/close/unlink 61089 (time 1775833422.32 total 1000.25 last 111.07) - open/close/unlink 62237 (time 1775833432.33 total 1010.26 last 114.68) - open/close/unlink 63661 (time 1775833442.35 total 1020.29 last 142.04) total: 64768 open/close/unlink in 1029.96 seconds: 62.88 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg203-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg203-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg203-server stop mds service on oleg203-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg203-server unloading modules via unload_modules_local on: 'oleg203-server' oleg203-server: oleg203-server.virtnet: executing unload_modules_local oleg203-server: modules unloaded. pdsh@oleg203-client: oleg203-client: ssh exited with exit code 2 pdsh@oleg203-client: oleg203-server: ssh exited with exit code 2 pdsh@oleg203-client: oleg203-server: ssh exited with exit code 2 pdsh@oleg203-client: oleg203-client: ssh exited with exit code 2