== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 14:26:53 (1773685613) Stopping clients: oleg121-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg121-client.virtnet /mnt/lustre2 (opts:-f) oleg121-server: oleg121-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg121-server' oleg121-server: oleg121-server.virtnet: executing load_modules_local oleg121-server: Loading modules from /home/green/git/lustre-release/lustre oleg121-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg121-server: detected 4 online CPUs by sysfs oleg121-server: MODOPTS_LIBCFS= oleg121-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg121-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg121-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg121-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg121-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg121-client.virtnet: -o user_xattr,flock 192.168.201.121@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 32648 392 32256 2% /mnt/lustre[OST:0] filesystem_summary: 32585 329 32256 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 722 (time 1773685711.23 total 10.01 last 72.13) - open/close 1430 (time 1773685721.23 total 20.01 last 70.78) - open/close 2129 (time 1773685731.24 total 30.02 last 69.83) - open/close 2858 (time 1773685741.25 total 40.03 last 72.87) - open/close 3642 (time 1773685751.25 total 50.03 last 78.35) - open/close 4485 (time 1773685761.26 total 60.04 last 84.23) - open/close 5168 (time 1773685771.27 total 70.05 last 68.25) - open/close 5856 (time 1773685781.29 total 80.07 last 68.66) - open/close 6524 (time 1773685791.29 total 90.07 last 66.78) - open/close 7238 (time 1773685801.30 total 100.08 last 71.32) - open/close 8012 (time 1773685811.31 total 110.09 last 77.33) - open/close 8741 (time 1773685821.32 total 120.10 last 72.86) - open/close 9382 (time 1773685831.32 total 130.10 last 64.07) - open/close 10000 (time 1773685840.42 total 139.20 last 67.90) - open/close 10673 (time 1773685850.44 total 149.21 last 67.23) - open/close 11412 (time 1773685860.44 total 159.22 last 73.84) - open/close 12166 (time 1773685870.44 total 169.22 last 75.39) - open/close 12822 (time 1773685880.45 total 179.23 last 65.54) - open/close 13515 (time 1773685890.46 total 189.24 last 69.25) - open/close 14196 (time 1773685900.46 total 199.24 last 68.08) - open/close 14897 (time 1773685910.47 total 209.25 last 70.05) - open/close 15575 (time 1773685920.49 total 219.27 last 67.67) - open/close 16295 (time 1773685930.49 total 229.27 last 71.97) - open/close 17067 (time 1773685940.50 total 239.28 last 77.13) - open/close 17889 (time 1773685950.50 total 249.28 last 82.19) - open/close 18668 (time 1773685960.52 total 259.30 last 77.74) - open/close 19420 (time 1773685970.53 total 269.31 last 75.18) - open/close 20000 (time 1773685977.44 total 276.22 last 83.90) - open/close 20818 (time 1773685987.44 total 286.22 last 81.79) - open/close 21551 (time 1773685997.45 total 296.23 last 73.23) - open/close 22325 (time 1773686007.45 total 306.23 last 77.40) - open/close 23067 (time 1773686017.46 total 316.24 last 74.15) - open/close 23950 (time 1773686027.47 total 326.24 last 88.24) - open/close 24714 (time 1773686037.47 total 336.25 last 76.33) - open/close 25611 (time 1773686047.48 total 346.26 last 89.67) - open/close 26449 (time 1773686057.49 total 356.27 last 83.73) - open/close 27232 (time 1773686067.49 total 366.27 last 78.26) - open/close 28023 (time 1773686077.49 total 376.27 last 79.08) - open/close 28828 (time 1773686087.50 total 386.28 last 80.45) - open/close 29583 (time 1773686097.52 total 396.30 last 75.37) - open/close 30000 (time 1773686102.97 total 401.75 last 76.43) - open/close 30779 (time 1773686112.98 total 411.76 last 77.87) - open/close 31546 (time 1773686122.98 total 421.76 last 76.66) - open/close 32423 (time 1773686132.99 total 431.77 last 87.64) - open/close 33356 (time 1773686142.99 total 441.77 last 93.25) - open/close 34354 (time 1773686152.99 total 451.77 last 99.80) - open/close 35207 (time 1773686163.01 total 461.79 last 85.19) - open/close 36092 (time 1773686173.01 total 471.79 last 88.47) - open/close 37161 (time 1773686183.01 total 481.79 last 106.88) - open/close 38196 (time 1773686193.02 total 491.80 last 103.46) - open/close 39042 (time 1773686203.02 total 501.80 last 84.55) - open/close 39808 (time 1773686213.03 total 511.81 last 76.50) - open/close 40000 (time 1773686215.38 total 514.16 last 81.94) - open/close 40818 (time 1773686225.40 total 524.18 last 81.65) - open/close 41665 (time 1773686235.40 total 534.18 last 84.64) - open/close 42533 (time 1773686245.41 total 544.19 last 86.72) - open/close 43451 (time 1773686255.42 total 554.20 last 91.75) - open/close 44312 (time 1773686265.42 total 564.20 last 86.05) - open/close 45134 (time 1773686275.43 total 574.20 last 82.19) - open/close 46136 (time 1773686285.43 total 584.21 last 100.15) - open/close 47473 (time 1773686295.43 total 594.21 last 133.66) - open/close 48311 (time 1773686305.43 total 604.21 last 83.79) - open/close 49141 (time 1773686315.44 total 614.22 last 82.92) - open/close 50000 (time 1773686324.65 total 623.43 last 93.33) - open/close 50926 (time 1773686334.65 total 633.43 last 92.55) - open/close 51717 (time 1773686344.66 total 643.44 last 79.05) - open/close 52459 (time 1773686354.67 total 653.45 last 74.15) - open/close 53381 (time 1773686364.67 total 663.45 last 92.14) - open/close 54251 (time 1773686374.68 total 673.45 last 86.98) - open/close 55170 (time 1773686384.68 total 683.46 last 91.86) - open/close 56009 (time 1773686394.68 total 693.46 last 83.88) - open/close 56853 (time 1773686404.68 total 703.46 last 84.39) - open/close 57683 (time 1773686414.77 total 713.55 last 82.24) - open/close 58457 (time 1773686424.78 total 723.55 last 77.40) - open/close 59274 (time 1773686434.78 total 733.56 last 81.68) - open/close 60000 (time 1773686443.93 total 742.70 last 79.36) - open/close 60754 (time 1773686453.93 total 752.71 last 75.39) - open/close 61660 (time 1773686463.93 total 762.71 last 90.56) - open/close 62602 (time 1773686473.94 total 772.72 last 94.12) - open/close 63532 (time 1773686483.95 total 782.73 last 92.87) - open/close 64545 (time 1773686493.96 total 792.74 last 101.22) total: 64768 open/close in 795.16 seconds: 81.45 ops/second - /unlink 932 (time 1773686508.90 total 10.01 last 93.14) - /unlink 1698 (time 1773686518.90 total 20.01 last 76.60) - /unlink 2483 (time 1773686528.91 total 30.01 last 78.49) - /unlink 3337 (time 1773686538.91 total 40.01 last 85.36) - /unlink 4223 (time 1773686548.91 total 50.01 last 88.60) - /unlink 5165 (time 1773686558.91 total 60.02 last 94.18) - /unlink 6008 (time 1773686568.92 total 70.02 last 84.28) - /unlink 6952 (time 1773686578.92 total 80.02 last 94.34) - /unlink 7820 (time 1773686588.92 total 90.03 last 86.77) - /unlink 8768 (time 1773686598.93 total 100.03 last 94.76) - /unlink 9687 (time 1773686608.93 total 110.03 last 91.89) - /unlink 10000 (time 1773686612.61 total 113.71 last 85.17) - /unlink 10922 (time 1773686622.61 total 123.71 last 92.20) - /unlink 11747 (time 1773686632.61 total 133.71 last 82.45) - /unlink 12679 (time 1773686642.61 total 143.72 last 93.17) - /unlink 13489 (time 1773686652.62 total 153.72 last 80.95) - /unlink 14345 (time 1773686662.63 total 163.73 last 85.55) - /unlink 15609 (time 1773686672.63 total 173.73 last 126.37) - /unlink 16851 (time 1773686682.63 total 183.74 last 124.15) - /unlink 17894 (time 1773686692.64 total 193.74 last 104.23) - /unlink 18971 (time 1773686702.64 total 203.75 last 107.65) - /unlink 20000 (time 1773686711.53 total 212.63 last 115.85) - /unlink 21148 (time 1773686721.54 total 222.64 last 114.67) - /unlink 22274 (time 1773686731.54 total 232.65 last 112.55) - /unlink 23522 (time 1773686741.55 total 242.65 last 124.77) - /unlink 24880 (time 1773686751.55 total 252.65 last 135.78) - /unlink 26042 (time 1773686761.55 total 262.65 last 116.16) - /unlink 27059 (time 1773686771.55 total 272.66 last 101.68) - /unlink 28423 (time 1773686781.56 total 282.66 last 136.36) - /unlink 29644 (time 1773686791.56 total 292.66 last 122.06) - /unlink 30000 (time 1773686794.86 total 295.97 last 107.71) - /unlink 31256 (time 1773686804.87 total 305.97 last 125.57) - /unlink 32336 (time 1773686814.87 total 315.97 last 107.96) - /unlink 33614 (time 1773686824.87 total 325.98 last 127.76) - /unlink 35220 (time 1773686834.87 total 335.98 last 160.59) - /unlink 36968 (time 1773686844.88 total 345.99 last 174.63) - /unlink 38663 (time 1773686854.89 total 355.99 last 169.44) - /unlink 40000 (time 1773686863.81 total 364.92 last 149.77) - /unlink 41486 (time 1773686873.83 total 374.93 last 148.40) - /unlink 42633 (time 1773686883.84 total 384.94 last 114.56) - /unlink 43879 (time 1773686893.85 total 394.95 last 124.51) - /unlink 45162 (time 1773686903.85 total 404.95 last 128.29) - /unlink 46920 (time 1773686913.85 total 414.95 last 175.73) - /unlink 48565 (time 1773686923.86 total 424.96 last 164.41) - /unlink 49889 (time 1773686933.86 total 434.96 last 132.36) - /unlink 52027 (time 1773686943.86 total 444.97 last 213.73) - /unlink 55901 (time 1773686953.86 total 454.97 last 387.38) - /unlink 59403 (time 1773686963.87 total 464.97 last 350.13) - /unlink 62652 (time 1773686973.87 total 474.97 last 324.84) total: 64768 /unlink in 481.27 seconds: 134.58 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 2414 (time 1773687016.29 total 10.00 last 241.32) - open/close 5132 (time 1773687026.30 total 20.01 last 271.74) - open/close 7730 (time 1773687036.30 total 30.01 last 259.73) - open/close 9747 (time 1773687046.30 total 40.01 last 201.60) - open/close 11966 (time 1773687056.31 total 50.02 last 221.75) - open/close 14173 (time 1773687066.31 total 60.02 last 220.68) - open/close 16494 (time 1773687076.31 total 70.02 last 232.04) - open/close 19098 (time 1773687086.32 total 80.03 last 260.31) - open/close 20000 (time 1773687089.58 total 83.29 last 276.46) - open/close 22010 (time 1773687099.58 total 93.29 last 200.93) - open/close 24196 (time 1773687109.59 total 103.30 last 218.55) - open/close 26143 (time 1773687119.59 total 113.30 last 194.69) - open/close 28006 (time 1773687129.59 total 123.30 last 186.28) - open/close 30000 (time 1773687138.55 total 132.26 last 222.56) - open/close 32526 (time 1773687148.55 total 142.26 last 252.55) - open/close 35122 (time 1773687158.55 total 152.26 last 259.50) - open/close 37972 (time 1773687168.55 total 162.26 last 284.97) - open/close 40000 (time 1773687176.20 total 169.91 last 265.17) - open/close 42429 (time 1773687186.20 total 179.91 last 242.81) - open/close 44612 (time 1773687196.21 total 189.92 last 218.28) - open/close 46661 (time 1773687206.21 total 199.92 last 204.83) - open/close 48975 (time 1773687216.21 total 209.92 last 231.34) - open/close 50000 (time 1773687219.97 total 213.68 last 272.60) - open/close 52832 (time 1773687229.97 total 223.68 last 283.20) - open/close 54897 (time 1773687239.97 total 233.68 last 206.48) - open/close 57694 (time 1773687250.09 total 243.80 last 276.38) - open/close 60000 (time 1773687258.53 total 252.24 last 273.36) - open/close 62924 (time 1773687268.53 total 262.24 last 292.35) total: 64768 open/close in 269.59 seconds: 240.25 ops/second - /unlink 2973 (time 1773687287.74 total 10.00 last 297.17) - /unlink 6939 (time 1773687297.74 total 20.00 last 396.59) - /unlink 10000 (time 1773687304.12 total 26.39 last 479.72) - /unlink 14076 (time 1773687314.13 total 36.39 last 407.44) - /unlink 17244 (time 1773687324.13 total 46.39 last 316.76) - /unlink 20000 (time 1773687332.54 total 54.80 last 327.59) - /unlink 23954 (time 1773687342.54 total 64.81 last 395.30) - /unlink 27637 (time 1773687352.55 total 74.81 last 368.26) - /unlink 30000 (time 1773687359.93 total 82.19 last 319.93) - /unlink 33617 (time 1773687369.93 total 92.19 last 361.66) - /unlink 36505 (time 1773687379.93 total 102.19 last 288.78) - /unlink 39352 (time 1773687389.93 total 112.20 last 284.67) - /unlink 42861 (time 1773687399.94 total 122.20 last 350.86) - /unlink 46593 (time 1773687409.94 total 132.20 last 373.00) - /unlink 49887 (time 1773687419.94 total 142.20 last 329.37) - /unlink 53107 (time 1773687429.95 total 152.21 last 321.87) - /unlink 56383 (time 1773687439.95 total 162.21 last 327.37) - /unlink 59923 (time 1773687449.96 total 172.22 last 353.65) - /unlink 63444 (time 1773687459.96 total 182.23 last 352.03) total: 64768 /unlink in 186.26 seconds: 347.72 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 2545 (time 1773687494.32 total 10.00 last 254.45) - open/close 4841 (time 1773687504.32 total 20.00 last 229.55) - open/close 7016 (time 1773687514.32 total 30.00 last 217.48) - open/close 8974 (time 1773687524.33 total 40.01 last 195.62) - open/close 10000 (time 1773687528.85 total 44.54 last 226.93) - open/close 12198 (time 1773687538.85 total 54.54 last 219.73) - open/close 14695 (time 1773687548.85 total 64.54 last 249.64) - open/close 16994 (time 1773687558.85 total 74.54 last 229.89) - open/close 18857 (time 1773687568.85 total 84.54 last 186.29) - open/close 20000 (time 1773687574.70 total 90.38 last 195.65) - open/close 22294 (time 1773687584.70 total 100.39 last 229.34) - open/close 24761 (time 1773687594.70 total 110.39 last 246.67) - open/close 27558 (time 1773687604.70 total 120.39 last 279.62) - open/close 29890 (time 1773687614.71 total 130.40 last 233.06) - open/close 32016 (time 1773687624.71 total 140.40 last 212.48) - open/close 34349 (time 1773687634.72 total 150.40 last 233.28) - open/close 36473 (time 1773687644.72 total 160.40 last 212.37) - open/close 38762 (time 1773687654.73 total 170.41 last 228.68) - open/close 40000 (time 1773687660.53 total 176.21 last 213.49) - open/close 42301 (time 1773687670.53 total 186.21 last 230.07) - open/close 44223 (time 1773687680.53 total 196.21 last 192.18) - open/close 46487 (time 1773687690.53 total 206.22 last 226.36) - open/close 48993 (time 1773687700.53 total 216.22 last 250.59) - open/close 50000 (time 1773687704.32 total 220.01 last 265.55) - open/close 52304 (time 1773687714.33 total 230.01 last 230.27) - open/close 55038 (time 1773687724.33 total 240.02 last 273.33) - open/close 57683 (time 1773687734.33 total 250.02 last 264.47) - open/close 60000 (time 1773687744.13 total 259.82 last 236.36) - open/close 62170 (time 1773687754.14 total 269.82 last 216.98) - open/close 64738 (time 1773687764.14 total 279.83 last 256.72) total: 64768 open/close in 279.93 seconds: 231.37 ops/second - /unlink 4481 (time 1773687776.07 total 10.00 last 448.06) - /unlink 7597 (time 1773687786.07 total 20.01 last 311.40) - /unlink 10000 (time 1773687793.22 total 27.16 last 336.06) - /unlink 15413 (time 1773687803.22 total 37.16 last 541.28) - /unlink 20000 (time 1773687811.63 total 45.56 last 545.83) - /unlink 26083 (time 1773687821.63 total 55.56 last 608.12) - /unlink 30000 (time 1773687830.05 total 63.99 last 465.14) - /unlink 35495 (time 1773687840.05 total 73.99 last 549.49) - /unlink 40000 (time 1773687848.63 total 82.57 last 525.11) - /unlink 45679 (time 1773687858.63 total 92.57 last 567.87) - /unlink 50000 (time 1773687866.93 total 100.86 last 520.91) - /unlink 55266 (time 1773687876.93 total 110.86 last 526.56) - /unlink 59503 (time 1773687886.93 total 120.86 last 423.64) - /unlink 64001 (time 1773687896.93 total 130.87 last 449.71) total: 64768 /unlink in 133.28 seconds: 485.95 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 2267 (time 1773687931.50 total 10.00 last 226.70) - open/close 4597 (time 1773687941.50 total 20.00 last 232.98) - open/close 7436 (time 1773687951.50 total 30.00 last 283.88) - open/close 10000 (time 1773687960.09 total 38.59 last 298.49) - open/close 13504 (time 1773687970.09 total 48.59 last 350.38) - open/close 16721 (time 1773687980.10 total 58.60 last 321.49) - open/close 19454 (time 1773687990.10 total 68.60 last 273.26) - open/close 22340 (time 1773688000.10 total 78.60 last 288.53) - open/close 25404 (time 1773688010.10 total 88.60 last 306.36) - open/close 29031 (time 1773688020.11 total 98.61 last 362.63) - open/close 30000 (time 1773688022.75 total 101.26 last 365.74) - open/close 33563 (time 1773688032.76 total 111.26 last 356.17) - open/close 36969 (time 1773688042.76 total 121.26 last 340.59) - open/close 40000 (time 1773688051.42 total 129.92 last 349.80) - open/close 42701 (time 1773688061.42 total 139.92 last 270.08) - open/close 45747 (time 1773688071.43 total 149.93 last 304.58) - open/close 48592 (time 1773688081.43 total 159.93 last 284.43) - open/close 50000 (time 1773688086.74 total 165.24 last 265.09) - open/close 52923 (time 1773688096.74 total 175.24 last 292.22) - open/close 56428 (time 1773688106.74 total 185.24 last 350.47) - open/close 59607 (time 1773688116.74 total 195.24 last 317.86) - open/close 63087 (time 1773688126.74 total 205.25 last 347.97) total: 64768 open/close in 210.25 seconds: 308.05 ops/second - /unlink 4883 (time 1773688143.39 total 10.00 last 488.21) - /unlink 9739 (time 1773688153.39 total 20.00 last 485.57) - /unlink 14332 (time 1773688163.39 total 30.00 last 459.28) - /unlink 19368 (time 1773688173.39 total 40.00 last 503.56) - /unlink 24694 (time 1773688183.40 total 50.01 last 532.34) - /unlink 29498 (time 1773688193.45 total 60.06 last 478.03) - /unlink 34938 (time 1773688203.45 total 70.06 last 543.97) - /unlink 39532 (time 1773688213.45 total 80.06 last 459.37) - /unlink 43756 (time 1773688223.45 total 90.06 last 422.33) - /unlink 49047 (time 1773688233.45 total 100.06 last 529.02) - /unlink 55841 (time 1773688243.45 total 110.06 last 679.38) - /unlink 60000 (time 1773688249.47 total 116.08 last 690.95) total: 64768 /unlink in 124.61 seconds: 519.75 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 4729 (time 1773688293.42 total 10.00 last 472.88) - open/close 9415 (time 1773688303.43 total 20.00 last 468.53) - open/close 14012 (time 1773688313.43 total 30.00 last 459.66) - open/close 18494 (time 1773688323.43 total 40.00 last 448.11) - open/close 20000 (time 1773688326.79 total 43.37 last 447.49) - open/close 24501 (time 1773688336.79 total 53.37 last 450.09) - open/close 29067 (time 1773688346.79 total 63.37 last 456.56) - open/close 33642 (time 1773688356.80 total 73.37 last 457.43) - open/close 38196 (time 1773688366.80 total 83.37 last 455.38) - open/close 40000 (time 1773688370.64 total 87.22 last 469.11) - open/close 44542 (time 1773688380.64 total 97.22 last 454.11) - open/close 48941 (time 1773688390.64 total 107.22 last 439.85) - open/close 50000 (time 1773688393.09 total 109.66 last 433.85) - open/close 54339 (time 1773688403.09 total 119.66 last 433.88) - open/close 58645 (time 1773688413.09 total 129.66 last 430.52) - open/close 60000 (time 1773688416.24 total 132.81 last 430.40) - open/close 64403 (time 1773688426.24 total 142.81 last 440.23) total: 64768 open/close in 143.62 seconds: 450.98 ops/second - /unlink 7055 (time 1773688438.38 total 10.00 last 705.40) - /unlink 10000 (time 1773688442.85 total 14.47 last 658.97) - /unlink 16882 (time 1773688452.85 total 24.47 last 688.20) - /unlink 20000 (time 1773688457.36 total 28.98 last 690.95) - /unlink 26685 (time 1773688467.36 total 38.98 last 668.48) - /unlink 30000 (time 1773688471.94 total 43.56 last 723.62) - /unlink 37093 (time 1773688481.94 total 53.57 last 709.09) - /unlink 40000 (time 1773688486.16 total 57.78 last 689.87) - /unlink 47020 (time 1773688496.16 total 67.78 last 701.94) - /unlink 50000 (time 1773688500.63 total 72.25 last 666.60) - /unlink 56411 (time 1773688510.63 total 82.25 last 641.09) - /unlink 60000 (time 1773688515.72 total 87.34 last 705.43) total: 64768 /unlink in 94.61 seconds: 684.59 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg121-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg121-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg121-server stop mds service on oleg121-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg121-server unloading modules via unload_modules_local on: 'oleg121-server' oleg121-server: oleg121-server.virtnet: executing unload_modules_local oleg121-server: modules unloaded. pdsh@oleg121-client: oleg121-client: ssh exited with exit code 2 pdsh@oleg121-client: oleg121-server: ssh exited with exit code 2 pdsh@oleg121-client: oleg121-client: ssh exited with exit code 2 pdsh@oleg121-client: oleg121-server: ssh exited with exit code 2