== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 19:05:38 (1763510738) Stopping clients: oleg419-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg419-client.virtnet /mnt/lustre2 (opts:-f) oleg419-server: oleg419-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg419-server' oleg419-server: oleg419-server.virtnet: executing load_modules_local oleg419-server: Loading modules from /home/green/git/lustre-release/lustre oleg419-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg419-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg419-server: detected 4 online CPUs by sysfs oleg419-server: MODOPTS_LIBCFS= oleg419-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg419-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg419-server: oleg419-server.virtnet: executing set_default_debug -1 all pdsh@oleg419-client: oleg419-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg419-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg419-server: oleg419-server.virtnet: executing set_default_debug -1 all pdsh@oleg419-client: oleg419-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg419-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg419-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg419-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg419-server: oleg419-server.virtnet: executing set_default_debug -1 all pdsh@oleg419-client: oleg419-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg419-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg419-client.virtnet: -o user_xattr,flock 192.168.204.119@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 65808 368 65440 1% /mnt/lustre[OST:0] filesystem_summary: 65969 529 65440 1% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 796 (time 1763510850.93 total 10.01 last 79.49) - open/close 1511 (time 1763510860.94 total 20.03 last 71.38) - open/close 2196 (time 1763510870.95 total 30.03 last 68.48) - open/close 2843 (time 1763510880.96 total 40.04 last 64.64) - open/close 3606 (time 1763510890.96 total 50.05 last 76.26) - open/close 4424 (time 1763510900.98 total 60.07 last 81.67) - open/close 5186 (time 1763510910.98 total 70.07 last 76.19) - open/close 6004 (time 1763510920.99 total 80.07 last 81.74) - open/close 6871 (time 1763510930.99 total 90.08 last 86.68) - open/close 7643 (time 1763510940.99 total 100.08 last 77.17) - open/close 8378 (time 1763510951.00 total 110.09 last 73.44) - open/close 9086 (time 1763510961.00 total 120.09 last 70.79) - open/close 9944 (time 1763510971.00 total 130.09 last 85.80) - open/close 10781 (time 1763510981.00 total 140.09 last 83.70) - open/close 11650 (time 1763510991.01 total 150.09 last 86.86) - open/close 12422 (time 1763511001.01 total 160.10 last 77.18) - open/close 13216 (time 1763511011.01 total 170.10 last 79.39) - open/close 14090 (time 1763511021.01 total 180.10 last 87.39) - open/close 14976 (time 1763511031.01 total 190.10 last 88.57) - open/close 15854 (time 1763511041.02 total 200.10 last 87.78) - open/close 16592 (time 1763511051.02 total 210.11 last 73.76) - open/close 17246 (time 1763511061.03 total 220.12 last 65.32) - open/close 17914 (time 1763511071.04 total 230.13 last 66.74) - open/close 18618 (time 1763511081.05 total 240.13 last 70.38) - open/close 19433 (time 1763511091.05 total 250.14 last 81.46) - open/close 20000 (time 1763511098.44 total 257.53 last 76.71) - open/close 20734 (time 1763511108.45 total 267.54 last 73.33) - open/close 21390 (time 1763511118.47 total 277.56 last 65.48) - open/close 22155 (time 1763511128.47 total 287.56 last 76.50) - open/close 22962 (time 1763511138.48 total 297.56 last 80.66) - open/close 23725 (time 1763511148.48 total 307.57 last 76.25) - open/close 24504 (time 1763511158.50 total 317.59 last 77.75) - open/close 25257 (time 1763511168.51 total 327.59 last 75.25) - open/close 26051 (time 1763511178.52 total 337.61 last 79.29) - open/close 26822 (time 1763511188.52 total 347.61 last 77.09) - open/close 27650 (time 1763511198.53 total 357.62 last 82.72) - open/close 28496 (time 1763511208.54 total 367.63 last 84.55) - open/close 29303 (time 1763511218.55 total 377.63 last 80.64) - open/close 30000 (time 1763511227.64 total 386.73 last 76.66) - open/close 30728 (time 1763511237.65 total 396.73 last 72.74) - open/close 31504 (time 1763511247.66 total 406.74 last 77.52) - open/close 32297 (time 1763511257.69 total 416.78 last 79.01) - open/close 33032 (time 1763511267.70 total 426.78 last 73.49) - open/close 33881 (time 1763511277.71 total 436.79 last 84.80) - open/close 34601 (time 1763511287.71 total 446.80 last 71.97) - open/close 35278 (time 1763511297.72 total 456.81 last 67.62) - open/close 36058 (time 1763511307.74 total 466.83 last 77.89) - open/close 36747 (time 1763511317.76 total 476.85 last 68.73) - open/close 37506 (time 1763511327.77 total 486.85 last 75.89) - open/close 38282 (time 1763511337.77 total 496.86 last 77.57) - open/close 39093 (time 1763511347.78 total 506.86 last 81.05) - open/close 39924 (time 1763511357.78 total 516.87 last 83.07) - open/close 40753 (time 1763511367.79 total 526.88 last 82.81) - open/close 41460 (time 1763511377.80 total 536.89 last 70.61) - open/close 42220 (time 1763511387.80 total 546.89 last 75.99) - open/close 42996 (time 1763511397.81 total 556.90 last 77.54) - open/close 43782 (time 1763511407.81 total 566.90 last 78.59) - open/close 44549 (time 1763511417.83 total 576.92 last 76.57) - open/close 45323 (time 1763511427.83 total 586.92 last 77.38) - open/close 46074 (time 1763511437.85 total 596.94 last 74.94) - open/close 46699 (time 1763511447.87 total 606.95 last 62.41) - open/close 47355 (time 1763511457.88 total 616.96 last 65.54) - open/close 47979 (time 1763511467.88 total 626.97 last 62.35) - open/close 48657 (time 1763511477.89 total 636.98 last 67.75) - open/close 49260 (time 1763511487.92 total 647.01 last 60.13) - open/close 49970 (time 1763511497.93 total 657.01 last 70.96) - open/close 50800 (time 1763511507.93 total 667.02 last 82.94) - open/close 51535 (time 1763511517.95 total 677.03 last 73.40) - open/close 52227 (time 1763511527.96 total 687.04 last 69.14) - open/close 53006 (time 1763511537.96 total 697.05 last 77.87) - open/close 53753 (time 1763511547.97 total 707.06 last 74.59) - open/close 54378 (time 1763511557.98 total 717.07 last 62.47) - open/close 55166 (time 1763511567.99 total 727.07 last 78.76) - open/close 55907 (time 1763511577.99 total 737.08 last 74.04) - open/close 56673 (time 1763511588.00 total 747.09 last 76.54) - open/close 57415 (time 1763511598.01 total 757.10 last 74.15) - open/close 58229 (time 1763511608.01 total 767.10 last 81.39) - open/close 59083 (time 1763511618.02 total 777.11 last 85.28) - open/close 59913 (time 1763511628.04 total 787.13 last 82.86) - open/close 60716 (time 1763511638.05 total 797.14 last 80.20) - open/close 61448 (time 1763511648.06 total 807.15 last 73.14) - open/close 61987 (time 1763511658.08 total 817.17 last 53.80) - open/close 62638 (time 1763511668.08 total 827.17 last 65.07) - open/close 63291 (time 1763511678.09 total 837.18 last 65.24) - open/close 64055 (time 1763511688.10 total 847.19 last 76.36) total: 64768 open/close in 855.90 seconds: 75.67 ops/second - /unlink 783 (time 1763511711.36 total 10.00 last 78.27) - /unlink 1470 (time 1763511721.37 total 20.01 last 68.68) - /unlink 2227 (time 1763511731.38 total 30.02 last 75.62) - /unlink 2970 (time 1763511741.38 total 40.02 last 74.27) - /unlink 3629 (time 1763511751.39 total 50.03 last 65.87) - /unlink 4277 (time 1763511761.40 total 60.04 last 64.72) - /unlink 4878 (time 1763511771.41 total 70.05 last 60.04) - /unlink 5527 (time 1763511781.43 total 80.07 last 64.78) - /unlink 6041 (time 1763511791.43 total 90.07 last 51.37) - /unlink 6742 (time 1763511801.44 total 100.08 last 70.06) - /unlink 7451 (time 1763511811.44 total 110.08 last 70.89) - /unlink 8126 (time 1763511821.45 total 120.09 last 67.42) - /unlink 8852 (time 1763511831.46 total 130.10 last 72.56) - /unlink 9652 (time 1763511841.46 total 140.10 last 79.94) - /unlink 10000 (time 1763511846.34 total 144.98 last 71.31) - /unlink 10760 (time 1763511856.35 total 154.99 last 75.95) - /unlink 11506 (time 1763511866.35 total 164.99 last 74.57) - /unlink 12228 (time 1763511876.36 total 175.00 last 72.16) - /unlink 12903 (time 1763511886.36 total 185.00 last 67.48) - /unlink 13615 (time 1763511896.37 total 195.01 last 71.14) - /unlink 14319 (time 1763511906.37 total 205.01 last 70.39) - /unlink 15023 (time 1763511916.38 total 215.02 last 70.37) - /unlink 15757 (time 1763511926.39 total 225.03 last 73.29) - /unlink 16463 (time 1763511936.40 total 235.04 last 70.55) - /unlink 17194 (time 1763511946.41 total 245.04 last 73.06) - /unlink 17981 (time 1763511956.41 total 255.05 last 78.68) - /unlink 18752 (time 1763511966.42 total 265.06 last 76.98) - /unlink 19488 (time 1763511976.44 total 275.07 last 73.51) - /unlink 20000 (time 1763511983.16 total 281.79 last 76.20) - /unlink 20772 (time 1763511993.17 total 291.81 last 77.06) - /unlink 21583 (time 1763512003.20 total 301.83 last 80.91) - /unlink 22322 (time 1763512013.20 total 311.84 last 73.89) - /unlink 22924 (time 1763512023.21 total 321.85 last 60.13) - /unlink 23511 (time 1763512033.22 total 331.86 last 58.65) - /unlink 24249 (time 1763512043.22 total 341.86 last 73.76) - /unlink 25040 (time 1763512053.23 total 351.87 last 79.05) - /unlink 25735 (time 1763512063.24 total 361.87 last 69.46) - /unlink 26469 (time 1763512073.27 total 371.91 last 73.12) - /unlink 27221 (time 1763512083.30 total 381.94 last 75.02) - /unlink 28020 (time 1763512093.33 total 391.96 last 79.67) - /unlink 28824 (time 1763512103.33 total 401.97 last 80.36) - /unlink 29572 (time 1763512113.37 total 412.01 last 74.53) - /unlink 30000 (time 1763512119.39 total 418.03 last 71.12) - /unlink 30775 (time 1763512129.40 total 428.04 last 77.40) - /unlink 31561 (time 1763512139.40 total 438.04 last 78.59) - /unlink 32322 (time 1763512149.40 total 448.04 last 76.07) - /unlink 33030 (time 1763512159.41 total 458.05 last 70.77) - /unlink 33733 (time 1763512169.42 total 468.06 last 70.22) - /unlink 34308 (time 1763512179.43 total 478.07 last 57.44) - /unlink 35020 (time 1763512189.44 total 488.07 last 71.17) - /unlink 35752 (time 1763512199.44 total 498.08 last 73.18) - /unlink 36515 (time 1763512209.45 total 508.08 last 76.23) - /unlink 37272 (time 1763512219.45 total 518.09 last 75.68) - /unlink 38008 (time 1763512229.47 total 528.10 last 73.47) - /unlink 38782 (time 1763512239.47 total 538.11 last 77.40) - /unlink 39532 (time 1763512249.47 total 548.11 last 74.96) - /unlink 40000 (time 1763512255.10 total 553.74 last 83.13) - /unlink 40724 (time 1763512265.11 total 563.75 last 72.36) - /unlink 41464 (time 1763512275.11 total 573.75 last 73.98) - /unlink 42266 (time 1763512285.13 total 583.77 last 80.05) - /unlink 43049 (time 1763512295.15 total 593.78 last 78.17) - /unlink 43842 (time 1763512305.16 total 603.80 last 79.20) - /unlink 44632 (time 1763512315.16 total 613.80 last 78.98) - /unlink 45490 (time 1763512325.16 total 623.80 last 85.77) - /unlink 46377 (time 1763512335.18 total 633.81 last 88.60) - /unlink 47204 (time 1763512345.18 total 643.82 last 82.66) - /unlink 48038 (time 1763512355.19 total 653.83 last 83.34) - /unlink 48849 (time 1763512365.19 total 663.83 last 81.07) - /unlink 49653 (time 1763512375.20 total 673.84 last 80.32) - /unlink 50000 (time 1763512379.42 total 678.05 last 82.36) - /unlink 50746 (time 1763512389.42 total 688.06 last 74.55) - /unlink 51494 (time 1763512399.44 total 698.08 last 74.64) - /unlink 52201 (time 1763512409.45 total 708.09 last 70.67) - /unlink 53047 (time 1763512419.45 total 718.09 last 84.56) - /unlink 53867 (time 1763512429.46 total 728.10 last 81.93) - /unlink 54716 (time 1763512439.47 total 738.11 last 84.84) - /unlink 55604 (time 1763512449.47 total 748.11 last 88.76) - /unlink 56455 (time 1763512459.48 total 758.11 last 85.09) - /unlink 57296 (time 1763512469.48 total 768.12 last 84.08) - /unlink 58073 (time 1763512479.48 total 778.12 last 77.65) - /unlink 58871 (time 1763512489.48 total 788.12 last 79.79) - /unlink 59597 (time 1763512499.50 total 798.14 last 72.51) - /unlink 60000 (time 1763512504.92 total 803.56 last 74.35) - /unlink 60852 (time 1763512514.92 total 813.56 last 85.16) - /unlink 61727 (time 1763512524.93 total 823.57 last 87.38) - /unlink 62369 (time 1763512534.94 total 833.57 last 64.19) - /unlink 63088 (time 1763512544.94 total 843.58 last 71.85) - /unlink 63910 (time 1763512554.95 total 853.59 last 82.14) - /unlink 64711 (time 1763512564.96 total 863.60 last 80.03) total: 64768 /unlink in 864.39 seconds: 74.93 ops/second Waiting for MDT destroys to complete oleg419-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg419-client: oleg419-server: ssh exited with exit code 1 - open/close 837 (time 1763512586.74 total 10.00 last 83.67) - open/close 1596 (time 1763512596.75 total 20.01 last 75.85) - open/close 2380 (time 1763512606.76 total 30.02 last 78.33) - open/close 3202 (time 1763512616.77 total 40.02 last 82.15) - open/close 3987 (time 1763512626.77 total 50.03 last 78.46) - open/close 4811 (time 1763512636.77 total 60.03 last 82.39) - open/close 5700 (time 1763512646.77 total 70.03 last 88.88) - open/close 6623 (time 1763512656.78 total 80.04 last 92.26) - open/close 7458 (time 1763512666.79 total 90.05 last 83.43) - open/close 8231 (time 1763512676.81 total 100.07 last 77.09) - open/close 8995 (time 1763512686.82 total 110.08 last 76.35) - open/close 9828 (time 1763512696.83 total 120.09 last 83.25) - open/close 10000 (time 1763512698.98 total 122.24 last 79.80) - open/close 10758 (time 1763512709.01 total 132.27 last 75.61) - open/close 11521 (time 1763512719.01 total 142.27 last 76.29) - open/close 12269 (time 1763512729.01 total 152.27 last 74.78) - open/close 13080 (time 1763512739.01 total 162.27 last 81.09) - open/close 13936 (time 1763512749.02 total 172.28 last 85.51) - open/close 14785 (time 1763512759.03 total 182.29 last 84.82) - open/close 15559 (time 1763512769.05 total 192.31 last 77.25) - open/close 16335 (time 1763512779.06 total 202.32 last 77.54) - open/close 17117 (time 1763512789.06 total 212.32 last 78.18) - open/close 17905 (time 1763512799.08 total 222.34 last 78.65) - open/close 18726 (time 1763512809.09 total 232.35 last 82.06) - open/close 19545 (time 1763512819.10 total 242.36 last 81.77) - open/close 20000 (time 1763512824.85 total 248.11 last 79.19) - open/close 20805 (time 1763512834.85 total 258.11 last 80.46) - open/close 21563 (time 1763512844.86 total 268.12 last 75.76) - open/close 22363 (time 1763512854.87 total 278.12 last 79.96) - open/close 23172 (time 1763512864.87 total 288.13 last 80.84) - open/close 23975 (time 1763512874.88 total 298.14 last 80.24) - open/close 24782 (time 1763512884.88 total 308.14 last 80.66) - open/close 25551 (time 1763512894.89 total 318.15 last 76.85) - open/close 26279 (time 1763512904.90 total 328.16 last 72.76) - open/close 27119 (time 1763512914.91 total 338.17 last 83.90) - open/close 27894 (time 1763512924.91 total 348.17 last 77.46) - open/close 28603 (time 1763512934.94 total 358.19 last 70.76) - open/close 29377 (time 1763512944.94 total 368.20 last 77.36) - open/close 30000 (time 1763512953.05 total 376.31 last 76.87) - open/close 30743 (time 1763512963.06 total 386.32 last 74.21) - open/close 31481 (time 1763512973.07 total 396.33 last 73.69) - open/close 32233 (time 1763512983.08 total 406.34 last 75.16) - open/close 33031 (time 1763512993.08 total 416.34 last 79.78) - open/close 33861 (time 1763513003.09 total 426.35 last 82.92) - open/close 34714 (time 1763513013.10 total 436.36 last 85.24) - open/close 35503 (time 1763513023.11 total 446.36 last 78.83) - open/close 36370 (time 1763513033.11 total 456.37 last 86.69) - open/close 37182 (time 1763513043.12 total 466.38 last 81.12) - open/close 37863 (time 1763513053.12 total 476.38 last 68.09) - open/close 38518 (time 1763513063.12 total 486.38 last 65.49) - open/close 39255 (time 1763513073.12 total 496.38 last 73.67) - open/close 39976 (time 1763513083.13 total 506.39 last 72.07) - open/close 40654 (time 1763513093.13 total 516.39 last 67.77) - open/close 41378 (time 1763513103.14 total 526.40 last 72.34) - open/close 42123 (time 1763513113.15 total 536.40 last 74.46) - open/close 42873 (time 1763513123.15 total 546.41 last 74.97) - open/close 43610 (time 1763513133.16 total 556.42 last 73.65) - open/close 44311 (time 1763513143.17 total 566.43 last 70.02) - open/close 45042 (time 1763513153.17 total 576.43 last 73.07) - open/close 45830 (time 1763513163.17 total 586.43 last 78.77) - open/close 46684 (time 1763513173.19 total 596.45 last 85.28) - open/close 47498 (time 1763513183.19 total 606.45 last 81.39) - open/close 48293 (time 1763513193.19 total 616.45 last 79.50) - open/close 49122 (time 1763513203.20 total 626.46 last 82.85) - open/close 49996 (time 1763513213.20 total 636.46 last 87.36) - open/close 50814 (time 1763513223.21 total 646.47 last 81.75) - open/close 51641 (time 1763513233.21 total 656.47 last 82.69) - open/close 52456 (time 1763513243.22 total 666.48 last 81.43) - open/close 53245 (time 1763513253.22 total 676.48 last 78.84) - open/close 54013 (time 1763513263.23 total 686.49 last 76.77) - open/close 54698 (time 1763513273.23 total 696.49 last 68.49) - open/close 55476 (time 1763513283.23 total 706.49 last 77.75) - open/close 56317 (time 1763513293.24 total 716.50 last 84.06) - open/close 57178 (time 1763513303.24 total 726.50 last 86.08) - open/close 58049 (time 1763513313.25 total 736.51 last 87.07) - open/close 58958 (time 1763513323.25 total 746.51 last 90.86) - open/close 59795 (time 1763513333.25 total 756.51 last 83.66) - open/close 60000 (time 1763513336.18 total 759.44 last 70.19) - open/close 60841 (time 1763513346.18 total 769.44 last 84.03) - open/close 61582 (time 1763513356.18 total 779.44 last 74.10) - open/close 62359 (time 1763513366.19 total 789.45 last 77.64) - open/close 63148 (time 1763513376.20 total 799.46 last 78.85) - open/close 64056 (time 1763513386.21 total 809.47 last 90.73) total: 64768 open/close in 817.64 seconds: 79.21 ops/second - /unlink 911 (time 1763513407.37 total 10.01 last 90.98) - /unlink 1723 (time 1763513417.38 total 20.02 last 81.15) - /unlink 2515 (time 1763513427.38 total 30.02 last 79.19) - /unlink 3301 (time 1763513437.39 total 40.03 last 78.54) - /unlink 4082 (time 1763513447.40 total 50.04 last 78.01) - /unlink 4960 (time 1763513457.40 total 60.04 last 87.79) - /unlink 5734 (time 1763513467.41 total 70.05 last 77.33) - /unlink 6554 (time 1763513477.41 total 80.05 last 81.97) - /unlink 7376 (time 1763513487.42 total 90.06 last 82.12) - /unlink 8180 (time 1763513497.43 total 100.07 last 80.37) - /unlink 9047 (time 1763513507.44 total 110.08 last 86.60) - /unlink 9857 (time 1763513517.44 total 120.08 last 80.96) - /unlink 10730 (time 1763513527.45 total 130.09 last 87.27) - /unlink 11471 (time 1763513537.45 total 140.10 last 74.05) - /unlink 12207 (time 1763513547.46 total 150.10 last 73.54) - /unlink 13053 (time 1763513557.46 total 160.10 last 84.59) - /unlink 13876 (time 1763513567.46 total 170.10 last 82.30) - /unlink 14684 (time 1763513577.48 total 180.12 last 80.69) - /unlink 15464 (time 1763513587.49 total 190.13 last 77.90) - /unlink 16211 (time 1763513597.49 total 200.13 last 74.67) - /unlink 17014 (time 1763513607.49 total 210.14 last 80.28) - /unlink 17775 (time 1763513617.50 total 220.15 last 76.02) - /unlink 18600 (time 1763513627.51 total 230.15 last 82.48) - /unlink 19407 (time 1763513637.51 total 240.16 last 80.64) - /unlink 20000 (time 1763513645.05 total 247.69 last 78.70) - /unlink 20812 (time 1763513655.05 total 257.69 last 81.19) - /unlink 21595 (time 1763513665.05 total 267.70 last 78.27) - /unlink 22357 (time 1763513675.06 total 277.70 last 76.19) - /unlink 23125 (time 1763513685.06 total 287.70 last 76.77) - /unlink 23911 (time 1763513695.06 total 297.70 last 78.58) - /unlink 24638 (time 1763513705.07 total 307.71 last 72.66) - /unlink 25417 (time 1763513715.07 total 317.71 last 77.87) - /unlink 26187 (time 1763513725.08 total 327.73 last 76.90) - /unlink 26938 (time 1763513735.08 total 337.73 last 75.10) - /unlink 27745 (time 1763513745.09 total 347.73 last 80.67) - /unlink 28558 (time 1763513755.09 total 357.73 last 81.30) - /unlink 29361 (time 1763513765.10 total 367.74 last 80.20) - /unlink 30000 (time 1763513772.72 total 375.36 last 83.90) - /unlink 30780 (time 1763513782.72 total 385.37 last 77.94) - /unlink 31579 (time 1763513792.73 total 395.37 last 79.87) - /unlink 32409 (time 1763513802.74 total 405.38 last 82.94) - /unlink 33215 (time 1763513812.75 total 415.39 last 80.51) - /unlink 33924 (time 1763513822.76 total 425.40 last 70.83) - /unlink 34649 (time 1763513832.76 total 435.41 last 72.44) - /unlink 35441 (time 1763513842.77 total 445.41 last 79.16) - /unlink 36255 (time 1763513852.77 total 455.41 last 81.38) - /unlink 37071 (time 1763513862.78 total 465.42 last 81.57) - /unlink 37830 (time 1763513872.78 total 475.42 last 75.89) - /unlink 38599 (time 1763513882.78 total 485.42 last 76.89) - /unlink 39395 (time 1763513892.78 total 495.42 last 79.60) - /unlink 40000 (time 1763513900.61 total 503.25 last 77.23) - /unlink 40822 (time 1763513910.62 total 513.26 last 82.12) - /unlink 41613 (time 1763513920.62 total 523.27 last 79.08) - /unlink 42401 (time 1763513930.63 total 533.27 last 78.77) - /unlink 43204 (time 1763513940.64 total 543.28 last 80.24) - /unlink 44087 (time 1763513950.64 total 553.28 last 88.26) - /unlink 44901 (time 1763513960.64 total 563.28 last 81.40) - /unlink 45643 (time 1763513970.64 total 573.29 last 74.18) - /unlink 46394 (time 1763513980.65 total 583.29 last 75.06) - /unlink 47232 (time 1763513990.66 total 593.30 last 83.70) - /unlink 48012 (time 1763514000.67 total 603.31 last 77.92) - /unlink 48796 (time 1763514010.68 total 613.32 last 78.35) - /unlink 49551 (time 1763514020.69 total 623.33 last 75.41) - /unlink 50000 (time 1763514026.88 total 629.52 last 72.54) - /unlink 50739 (time 1763514036.89 total 639.53 last 73.85) - /unlink 51537 (time 1763514046.89 total 649.54 last 79.74) - /unlink 52302 (time 1763514056.90 total 659.54 last 76.48) - /unlink 53089 (time 1763514066.91 total 669.55 last 78.61) - /unlink 53896 (time 1763514076.91 total 679.55 last 80.68) - /unlink 54680 (time 1763514086.91 total 689.56 last 78.37) - /unlink 55449 (time 1763514096.92 total 699.57 last 76.82) - /unlink 56248 (time 1763514106.94 total 709.58 last 79.78) - /unlink 57008 (time 1763514116.94 total 719.58 last 76.00) - /unlink 57818 (time 1763514126.95 total 729.59 last 80.92) - /unlink 58575 (time 1763514136.97 total 739.61 last 75.58) - /unlink 59323 (time 1763514146.97 total 749.61 last 74.79) - /unlink 60000 (time 1763514156.67 total 759.31 last 69.78) - /unlink 60761 (time 1763514166.67 total 769.32 last 76.06) - /unlink 61500 (time 1763514176.67 total 779.32 last 73.90) - /unlink 62281 (time 1763514186.68 total 789.32 last 78.09) - /unlink 62985 (time 1763514196.69 total 799.33 last 70.33) - /unlink 63757 (time 1763514206.69 total 809.33 last 77.16) - /unlink 64520 (time 1763514216.70 total 819.34 last 76.25) total: 64768 /unlink in 822.49 seconds: 78.75 ops/second Waiting for MDT destroys to complete oleg419-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg419-client: oleg419-server: ssh exited with exit code 1 - open/close 758 (time 1763514248.06 total 10.01 last 75.70) - open/close 1489 (time 1763514258.07 total 20.02 last 73.05) - open/close 2210 (time 1763514268.08 total 30.03 last 72.05) - open/close 3013 (time 1763514278.08 total 40.03 last 80.28) - open/close 3734 (time 1763514288.09 total 50.04 last 72.03) - open/close 4526 (time 1763514298.09 total 60.04 last 79.18) - open/close 5287 (time 1763514308.10 total 70.05 last 76.07) - open/close 5968 (time 1763514318.11 total 80.05 last 68.04) - open/close 6630 (time 1763514328.11 total 90.06 last 66.15) - open/close 7385 (time 1763514338.11 total 100.06 last 75.49) - open/close 8232 (time 1763514348.12 total 110.07 last 84.66) - open/close 9033 (time 1763514358.13 total 120.08 last 80.03) - open/close 9778 (time 1763514368.14 total 130.09 last 74.39) - open/close 10000 (time 1763514371.88 total 133.83 last 59.33) - open/close 10760 (time 1763514381.89 total 143.84 last 75.92) - open/close 11536 (time 1763514391.90 total 153.85 last 77.53) - open/close 12296 (time 1763514401.91 total 163.86 last 75.95) - open/close 13106 (time 1763514411.91 total 173.86 last 80.95) - open/close 13846 (time 1763514421.92 total 183.87 last 73.99) - open/close 14675 (time 1763514431.92 total 193.87 last 82.86) - open/close 15522 (time 1763514441.93 total 203.88 last 84.66) - open/close 16330 (time 1763514451.93 total 213.88 last 80.77) - open/close 17117 (time 1763514461.94 total 223.89 last 78.64) - open/close 17960 (time 1763514471.94 total 233.89 last 84.24) - open/close 18745 (time 1763514481.95 total 243.90 last 78.48) - open/close 19573 (time 1763514491.95 total 253.90 last 82.75) - open/close 20000 (time 1763514497.22 total 259.17 last 81.11) - open/close 20795 (time 1763514507.23 total 269.18 last 79.44) - open/close 21590 (time 1763514517.24 total 279.19 last 79.39) - open/close 22337 (time 1763514527.25 total 289.20 last 74.63) - open/close 23139 (time 1763514537.26 total 299.21 last 80.13) - open/close 23898 (time 1763514547.26 total 309.21 last 75.86) - open/close 24642 (time 1763514557.27 total 319.21 last 74.38) - open/close 25498 (time 1763514567.27 total 329.22 last 85.53) - open/close 26334 (time 1763514577.28 total 339.23 last 83.56) - open/close 27140 (time 1763514587.29 total 349.24 last 80.48) - open/close 27988 (time 1763514597.30 total 359.25 last 84.72) - open/close 28814 (time 1763514607.31 total 369.26 last 82.54) - open/close 29553 (time 1763514617.33 total 379.28 last 73.75) - open/close 30000 (time 1763514624.24 total 386.19 last 64.71) - open/close 30760 (time 1763514634.25 total 396.20 last 75.91) - open/close 31426 (time 1763514644.26 total 406.21 last 66.53) - open/close 32107 (time 1763514654.28 total 416.23 last 67.99) - open/close 32812 (time 1763514664.28 total 426.23 last 70.49) - open/close 33526 (time 1763514674.28 total 436.23 last 71.36) - open/close 34296 (time 1763514684.29 total 446.24 last 76.93) - open/close 35040 (time 1763514694.31 total 456.26 last 74.28) - open/close 35776 (time 1763514704.32 total 466.27 last 73.49) - open/close 36554 (time 1763514714.32 total 476.27 last 77.79) - open/close 37387 (time 1763514724.33 total 486.28 last 83.28) - open/close 38210 (time 1763514734.34 total 496.29 last 82.21) - open/close 38928 (time 1763514744.37 total 506.32 last 71.59) - open/close 39701 (time 1763514754.38 total 516.33 last 77.19) - open/close 40000 (time 1763514758.72 total 520.67 last 68.87) - open/close 40719 (time 1763514768.73 total 530.68 last 71.88) - open/close 41400 (time 1763514778.74 total 540.69 last 68.04) - open/close 42090 (time 1763514788.75 total 550.70 last 68.89) - open/close 42838 (time 1763514798.77 total 560.72 last 74.68) - open/close 43604 (time 1763514808.77 total 570.72 last 76.57) - open/close 44414 (time 1763514818.78 total 580.73 last 80.93) - open/close 45241 (time 1763514828.78 total 590.73 last 82.67) - open/close 46036 (time 1763514838.79 total 600.74 last 79.46) - open/close 46754 (time 1763514848.80 total 610.75 last 71.72) - open/close 47444 (time 1763514858.80 total 620.75 last 68.98) - open/close 48200 (time 1763514868.81 total 630.76 last 75.55) - open/close 49048 (time 1763514878.81 total 640.76 last 84.76) - open/close 49877 (time 1763514888.82 total 650.77 last 82.85) - open/close 50636 (time 1763514898.82 total 660.77 last 75.87) - open/close 51415 (time 1763514908.84 total 670.79 last 77.78) - open/close 52249 (time 1763514918.85 total 680.80 last 83.27) - open/close 53043 (time 1763514928.86 total 690.81 last 79.35) - open/close 53887 (time 1763514938.87 total 700.82 last 84.31) - open/close 54757 (time 1763514948.87 total 710.82 last 86.96) - open/close 55760 (time 1763514958.88 total 720.83 last 100.20) - open/close 56596 (time 1763514968.89 total 730.84 last 83.54) - open/close 57438 (time 1763514978.90 total 740.85 last 84.13) - open/close 58245 (time 1763514988.90 total 750.85 last 80.69) - open/close 58994 (time 1763514998.91 total 760.86 last 74.84) - open/close 59807 (time 1763515008.91 total 770.86 last 81.26) - open/close 60000 (time 1763515011.12 total 773.07 last 87.53) - open/close 60808 (time 1763515021.13 total 783.08 last 80.73) - open/close 61679 (time 1763515031.13 total 793.08 last 87.04) - open/close 62530 (time 1763515041.14 total 803.09 last 85.03) - open/close 63397 (time 1763515051.14 total 813.09 last 86.67) - open/close 64222 (time 1763515061.15 total 823.10 last 82.46) total: 64768 open/close in 829.72 seconds: 78.06 ops/second - /unlink 799 (time 1763515081.41 total 10.01 last 79.83) - /unlink 1581 (time 1763515091.42 total 20.02 last 78.14) - /unlink 2388 (time 1763515101.43 total 30.03 last 80.61) - /unlink 3233 (time 1763515111.43 total 40.03 last 84.44) - /unlink 4045 (time 1763515121.44 total 50.04 last 81.13) - /unlink 4863 (time 1763515131.44 total 60.04 last 81.79) - /unlink 5789 (time 1763515141.44 total 70.04 last 92.59) - /unlink 6702 (time 1763515151.45 total 80.05 last 91.28) - /unlink 7637 (time 1763515161.45 total 90.05 last 93.44) - /unlink 8454 (time 1763515171.46 total 100.06 last 81.65) - /unlink 9261 (time 1763515181.46 total 110.06 last 80.68) - /unlink 10000 (time 1763515190.05 total 118.65 last 86.09) - /unlink 10828 (time 1763515200.05 total 128.65 last 82.80) - /unlink 11596 (time 1763515210.06 total 138.66 last 76.71) - /unlink 12376 (time 1763515220.06 total 148.66 last 77.98) - /unlink 13206 (time 1763515230.07 total 158.67 last 82.94) - /unlink 14045 (time 1763515240.08 total 168.68 last 83.80) - /unlink 14920 (time 1763515250.09 total 178.69 last 87.46) - /unlink 15790 (time 1763515260.09 total 188.69 last 86.95) - /unlink 16776 (time 1763515270.09 total 198.69 last 98.60) - /unlink 17653 (time 1763515280.10 total 208.70 last 87.59) - /unlink 18540 (time 1763515290.11 total 218.71 last 88.63) - /unlink 19503 (time 1763515300.12 total 228.72 last 96.26) - /unlink 20000 (time 1763515305.60 total 234.20 last 90.69) - /unlink 20916 (time 1763515315.60 total 244.20 last 91.57) - /unlink 21670 (time 1763515325.60 total 254.20 last 75.38) - /unlink 22499 (time 1763515335.61 total 264.21 last 82.84) - /unlink 23318 (time 1763515345.61 total 274.21 last 81.88) - /unlink 24093 (time 1763515355.63 total 284.23 last 77.39) - /unlink 24891 (time 1763515365.63 total 294.23 last 79.77) - /unlink 25690 (time 1763515375.63 total 304.23 last 79.86) - /unlink 26545 (time 1763515385.64 total 314.24 last 85.44) - /unlink 27402 (time 1763515395.65 total 324.25 last 85.64) - /unlink 28238 (time 1763515405.65 total 334.25 last 83.59) - /unlink 29073 (time 1763515415.66 total 344.26 last 83.40) - /unlink 29895 (time 1763515425.66 total 354.26 last 82.19) - /unlink 30708 (time 1763515435.66 total 364.26 last 81.29) - /unlink 31536 (time 1763515445.67 total 374.27 last 82.71) - /unlink 32519 (time 1763515455.68 total 384.28 last 98.28) - /unlink 33530 (time 1763515465.68 total 394.28 last 101.10) - /unlink 34453 (time 1763515475.68 total 404.28 last 92.25) - /unlink 35345 (time 1763515485.68 total 414.28 last 89.18) - /unlink 36299 (time 1763515495.69 total 424.29 last 95.33) - /unlink 37211 (time 1763515505.70 total 434.30 last 91.15) - /unlink 38014 (time 1763515515.70 total 444.30 last 80.29) - /unlink 38772 (time 1763515525.71 total 454.31 last 75.71) - /unlink 39583 (time 1763515535.71 total 464.31 last 81.08) - /unlink 40000 (time 1763515540.29 total 468.89 last 91.20) - /unlink 40813 (time 1763515550.29 total 478.89 last 81.23) - /unlink 41716 (time 1763515560.29 total 488.89 last 90.30) - /unlink 42581 (time 1763515570.30 total 498.90 last 86.50) - /unlink 43469 (time 1763515580.31 total 508.91 last 88.71) - /unlink 44369 (time 1763515590.31 total 518.91 last 89.96) - /unlink 45236 (time 1763515600.31 total 528.91 last 86.70) - /unlink 46264 (time 1763515610.32 total 538.92 last 102.73) - /unlink 47137 (time 1763515620.32 total 548.92 last 87.29) - /unlink 48003 (time 1763515630.33 total 558.93 last 86.53) - /unlink 49000 (time 1763515640.33 total 568.93 last 99.65) - /unlink 49925 (time 1763515650.34 total 578.94 last 92.45) - /unlink 50822 (time 1763515660.35 total 588.95 last 89.62) - /unlink 51731 (time 1763515670.35 total 598.95 last 90.84) - /unlink 52799 (time 1763515680.36 total 608.96 last 106.76) - /unlink 53929 (time 1763515690.36 total 618.96 last 112.94) - /unlink 54829 (time 1763515700.37 total 628.97 last 89.96) - /unlink 55883 (time 1763515710.37 total 638.97 last 105.37) - /unlink 56896 (time 1763515720.37 total 648.97 last 101.28) - /unlink 57907 (time 1763515730.38 total 658.98 last 100.99) - /unlink 58996 (time 1763515740.38 total 668.98 last 108.88) - /unlink 60000 (time 1763515749.88 total 678.48 last 105.74) - /unlink 61083 (time 1763515759.88 total 688.48 last 108.25) - /unlink 62332 (time 1763515769.89 total 698.49 last 124.82) - /unlink 63559 (time 1763515779.89 total 708.49 last 122.67) - /unlink 64684 (time 1763515789.90 total 718.50 last 112.43) total: 64768 /unlink in 719.36 seconds: 90.04 ops/second Waiting for MDT destroys to complete oleg419-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg419-client: oleg419-server: ssh exited with exit code 1 - open/close 1145 (time 1763515817.01 total 10.00 last 114.46) - open/close 2335 (time 1763515827.02 total 20.02 last 118.80) - open/close 3327 (time 1763515837.02 total 30.02 last 99.20) - open/close 4389 (time 1763515847.04 total 40.03 last 106.08) - open/close 5373 (time 1763515857.04 total 50.04 last 98.36) - open/close 6437 (time 1763515867.05 total 60.04 last 106.34) - open/close 7597 (time 1763515877.05 total 70.05 last 115.91) - open/close 8667 (time 1763515887.06 total 80.06 last 106.91) - open/close 9843 (time 1763515897.07 total 90.07 last 117.49) - open/close 10918 (time 1763515907.08 total 100.07 last 107.44) - open/close 12010 (time 1763515917.08 total 110.07 last 109.19) - open/close 13047 (time 1763515927.08 total 120.07 last 103.68) - open/close 14166 (time 1763515937.08 total 130.08 last 111.89) - open/close 15361 (time 1763515947.08 total 140.08 last 119.45) - open/close 16405 (time 1763515957.09 total 150.08 last 104.38) - open/close 17475 (time 1763515967.09 total 160.09 last 106.96) - open/close 18550 (time 1763515977.10 total 170.10 last 107.39) - open/close 19736 (time 1763515987.10 total 180.10 last 118.57) - open/close 21332 (time 1763515997.11 total 190.10 last 159.52) - open/close 22700 (time 1763516007.11 total 200.11 last 136.73) - open/close 23948 (time 1763516017.11 total 210.11 last 124.79) - open/close 25529 (time 1763516027.14 total 220.13 last 157.74) - open/close 26934 (time 1763516037.14 total 230.14 last 140.39) - open/close 28558 (time 1763516047.15 total 240.14 last 162.33) - open/close 30000 (time 1763516055.54 total 248.54 last 171.81) - open/close 31799 (time 1763516065.54 total 258.54 last 179.86) - open/close 33590 (time 1763516075.55 total 268.55 last 178.94) - open/close 35863 (time 1763516085.55 total 278.55 last 227.25) - open/close 37953 (time 1763516095.56 total 288.55 last 208.98) - open/close 40000 (time 1763516105.34 total 298.34 last 209.15) - open/close 41570 (time 1763516115.35 total 308.34 last 156.94) - open/close 43397 (time 1763516125.35 total 318.35 last 182.64) - open/close 45471 (time 1763516135.35 total 328.35 last 207.33) - open/close 47214 (time 1763516145.36 total 338.35 last 174.23) - open/close 48868 (time 1763516155.36 total 348.36 last 165.36) - open/close 50000 (time 1763516161.02 total 354.02 last 199.97) - open/close 52293 (time 1763516171.02 total 364.02 last 229.22) - open/close 54431 (time 1763516181.03 total 374.02 last 213.75) - open/close 56561 (time 1763516191.03 total 384.02 last 212.95) - open/close 58675 (time 1763516201.03 total 394.03 last 211.37) - open/close 60000 (time 1763516206.12 total 399.12 last 260.14) - open/close 62035 (time 1763516216.13 total 409.12 last 203.46) - open/close 63735 (time 1763516226.13 total 419.12 last 169.97) total: 64768 open/close in 426.18 seconds: 151.97 ops/second - /unlink 2835 (time 1763516245.10 total 10.00 last 283.48) - /unlink 6482 (time 1763516255.10 total 20.00 last 364.66) - /unlink 10000 (time 1763516265.00 total 29.90 last 355.34) - /unlink 13267 (time 1763516275.00 total 39.90 last 326.63) - /unlink 17174 (time 1763516285.00 total 49.91 last 390.64) - /unlink 20000 (time 1763516294.01 total 58.91 last 313.82) - /unlink 22931 (time 1763516304.01 total 68.91 last 293.07) - /unlink 25882 (time 1763516314.01 total 78.91 last 295.09) - /unlink 28674 (time 1763516324.01 total 88.91 last 279.19) - /unlink 30000 (time 1763516327.88 total 92.79 last 342.37) - /unlink 34012 (time 1763516337.89 total 102.79 last 401.14) - /unlink 37737 (time 1763516347.89 total 112.79 last 372.42) - /unlink 40000 (time 1763516354.58 total 119.48 last 337.99) - /unlink 43865 (time 1763516364.58 total 129.49 last 386.45) - /unlink 49612 (time 1763516374.58 total 139.49 last 574.69) - /unlink 55355 (time 1763516384.59 total 149.49 last 574.22) - /unlink 60000 (time 1763516391.76 total 156.66 last 647.77) total: 64768 /unlink in 164.19 seconds: 394.48 ops/second Waiting for MDT destroys to complete oleg419-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg419-client: oleg419-server: ssh exited with exit code 1 - open/close 1882 (time 1763516420.25 total 10.01 last 188.08) - open/close 4375 (time 1763516430.25 total 20.01 last 249.26) - open/close 6538 (time 1763516440.25 total 30.01 last 216.26) - open/close 9067 (time 1763516450.25 total 40.01 last 252.89) - open/close 10000 (time 1763516453.71 total 43.47 last 269.96) - open/close 12060 (time 1763516463.71 total 53.47 last 205.98) - open/close 14276 (time 1763516473.71 total 63.47 last 221.50) - open/close 16444 (time 1763516483.72 total 73.47 last 216.73) - open/close 19283 (time 1763516493.72 total 83.48 last 283.81) - open/close 20000 (time 1763516496.27 total 86.02 last 281.44) - open/close 22038 (time 1763516506.27 total 96.03 last 203.76) - open/close 23561 (time 1763516516.27 total 106.03 last 152.25) - open/close 25412 (time 1763516526.28 total 116.03 last 185.04) - open/close 27587 (time 1763516536.28 total 126.03 last 217.49) - open/close 29919 (time 1763516546.28 total 136.04 last 233.15) - open/close 31988 (time 1763516556.28 total 146.04 last 206.78) - open/close 33530 (time 1763516566.29 total 156.04 last 154.17) - open/close 35887 (time 1763516576.29 total 166.04 last 235.67) - open/close 38230 (time 1763516586.29 total 176.05 last 234.19) - open/close 40000 (time 1763516593.98 total 183.73 last 230.36) - open/close 42242 (time 1763516603.98 total 193.74 last 224.16) - open/close 44710 (time 1763516613.98 total 203.74 last 246.76) - open/close 46956 (time 1763516623.98 total 213.74 last 224.59) - open/close 49066 (time 1763516633.98 total 223.74 last 210.97) - open/close 50000 (time 1763516638.84 total 228.60 last 192.11) - open/close 52108 (time 1763516648.85 total 238.60 last 210.74) - open/close 54052 (time 1763516658.85 total 248.60 last 194.37) - open/close 55749 (time 1763516668.85 total 258.61 last 169.65) - open/close 58592 (time 1763516678.85 total 268.61 last 284.22) - open/close 60000 (time 1763516684.49 total 274.24 last 249.91) - open/close 62628 (time 1763516694.49 total 284.25 last 262.74) total: 64768 open/close in 291.81 seconds: 221.95 ops/second - /unlink 5828 (time 1763516713.76 total 10.00 last 582.80) - /unlink 10000 (time 1763516720.68 total 16.91 last 603.45) - /unlink 16145 (time 1763516730.68 total 26.91 last 614.45) - /unlink 20000 (time 1763516737.38 total 33.61 last 575.59) - /unlink 26373 (time 1763516747.38 total 43.61 last 637.20) - /unlink 30000 (time 1763516753.87 total 50.11 last 558.62) - /unlink 36853 (time 1763516763.87 total 60.11 last 685.24) - /unlink 40000 (time 1763516769.17 total 65.41 last 593.63) - /unlink 46206 (time 1763516779.17 total 75.41 last 620.50) - /unlink 50000 (time 1763516785.82 total 82.05 last 571.00) - /unlink 54654 (time 1763516795.82 total 92.05 last 465.38) - /unlink 59330 (time 1763516805.82 total 102.06 last 467.50) total: 64768 /unlink in 111.16 seconds: 582.65 ops/second Waiting for MDT destroys to complete oleg419-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg419-client: oleg419-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg419-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg419-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg419-server stop mds service on oleg419-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg419-server stop mds service on oleg419-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg419-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg419-server' oleg419-server: oleg419-server.virtnet: executing unload_modules_local oleg419-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg419-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg419-client: oleg419-client: ssh exited with exit code 2 pdsh@oleg419-client: oleg419-server: ssh exited with exit code 2 pdsh@oleg419-client: oleg419-client: ssh exited with exit code 2 pdsh@oleg419-client: oleg419-server: ssh exited with exit code 2