== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 02:30:37 (1771399837) Stopping clients: oleg302-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg302-client.virtnet /mnt/lustre2 (opts:-f) oleg302-server: oleg302-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg302-server' oleg302-server: oleg302-server.virtnet: executing load_modules_local oleg302-server: Loading modules from /home/green/git/lustre-release/lustre oleg302-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg302-server: detected 4 online CPUs by sysfs oleg302-server: MODOPTS_LIBCFS= oleg302-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg302-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg302-server: oleg302-server.virtnet: executing set_default_debug -1 all pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg302-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg302-server: oleg302-server.virtnet: executing set_default_debug -1 all pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg302-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg302-server: oleg302-server.virtnet: executing set_default_debug -1 all pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg302-client.virtnet: -o user_xattr,flock 192.168.203.102@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 65808 368 65440 1% /mnt/lustre[OST:0] filesystem_summary: 65969 529 65440 1% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 745 (time 1771399992.29 total 10.01 last 74.43) - open/close 1424 (time 1771400002.30 total 20.01 last 67.89) - open/close 2143 (time 1771400012.30 total 30.01 last 71.89) - open/close 2977 (time 1771400022.30 total 40.02 last 83.36) - open/close 3742 (time 1771400032.30 total 50.02 last 76.49) - open/close 4738 (time 1771400042.31 total 60.02 last 99.58) - open/close 5604 (time 1771400052.31 total 70.03 last 86.56) - open/close 6475 (time 1771400062.32 total 80.03 last 87.03) - open/close 7238 (time 1771400072.34 total 90.05 last 76.15) - open/close 7796 (time 1771400082.36 total 100.07 last 55.69) - open/close 8532 (time 1771400092.36 total 110.08 last 73.58) - open/close 9371 (time 1771400102.36 total 120.08 last 83.87) - open/close 10000 (time 1771400109.78 total 127.49 last 84.86) - open/close 10555 (time 1771400119.78 total 137.49 last 55.48) - open/close 11183 (time 1771400129.78 total 147.50 last 62.79) - open/close 11960 (time 1771400139.79 total 157.50 last 77.65) - open/close 12822 (time 1771400149.79 total 167.50 last 86.19) - open/close 13754 (time 1771400159.79 total 177.51 last 93.14) - open/close 14788 (time 1771400169.80 total 187.51 last 103.36) - open/close 15790 (time 1771400179.80 total 197.52 last 100.18) - open/close 16805 (time 1771400189.80 total 207.52 last 101.48) - open/close 17947 (time 1771400199.81 total 217.53 last 114.08) - open/close 18974 (time 1771400209.82 total 227.54 last 102.62) - open/close 19980 (time 1771400219.82 total 237.54 last 100.60) - open/close 20984 (time 1771400229.82 total 247.54 last 100.38) - open/close 21980 (time 1771400239.83 total 257.55 last 99.50) - open/close 22811 (time 1771400249.84 total 267.56 last 83.03) - open/close 23561 (time 1771400259.84 total 277.56 last 74.97) - open/close 24347 (time 1771400269.87 total 287.58 last 78.43) - open/close 25369 (time 1771400279.87 total 297.58 last 102.17) - open/close 26536 (time 1771400289.87 total 307.59 last 116.63) - open/close 27665 (time 1771400299.89 total 317.61 last 112.72) - open/close 28533 (time 1771400309.90 total 327.61 last 86.73) - open/close 29473 (time 1771400319.91 total 337.63 last 93.90) - open/close 30000 (time 1771400325.79 total 343.51 last 89.59) - open/close 30956 (time 1771400335.80 total 353.52 last 95.51) - open/close 31912 (time 1771400345.81 total 363.53 last 95.52) - open/close 32846 (time 1771400355.83 total 373.54 last 93.25) - open/close 33834 (time 1771400365.84 total 383.56 last 98.63) - open/close 34692 (time 1771400375.85 total 393.57 last 85.74) - open/close 35589 (time 1771400385.85 total 403.57 last 89.67) - open/close 36501 (time 1771400395.86 total 413.58 last 91.14) - open/close 37417 (time 1771400405.87 total 423.58 last 91.54) - open/close 38331 (time 1771400415.87 total 433.59 last 91.36) - open/close 39139 (time 1771400425.88 total 443.59 last 80.75) - open/close 40000 (time 1771400435.43 total 453.14 last 90.15) - open/close 40687 (time 1771400445.44 total 463.15 last 68.65) - open/close 41553 (time 1771400455.45 total 473.16 last 86.49) - open/close 42433 (time 1771400465.45 total 483.17 last 87.94) - open/close 43363 (time 1771400475.46 total 493.17 last 92.96) - open/close 44424 (time 1771400485.46 total 503.18 last 106.04) - open/close 45433 (time 1771400495.48 total 513.20 last 100.73) - open/close 46337 (time 1771400505.48 total 523.20 last 90.38) - open/close 47260 (time 1771400515.51 total 533.23 last 92.03) - open/close 48283 (time 1771400525.57 total 543.28 last 101.74) - open/close 49111 (time 1771400535.58 total 553.29 last 82.74) - open/close 49981 (time 1771400545.59 total 563.31 last 86.87) - open/close 50857 (time 1771400555.60 total 573.32 last 87.52) - open/close 51803 (time 1771400565.61 total 583.32 last 94.55) - open/close 52706 (time 1771400575.62 total 593.33 last 90.20) - open/close 53588 (time 1771400585.62 total 603.34 last 88.13) - open/close 54563 (time 1771400595.62 total 613.34 last 97.49) - open/close 55659 (time 1771400605.64 total 623.35 last 109.47) - open/close 56708 (time 1771400615.64 total 633.36 last 104.85) - open/close 57669 (time 1771400625.64 total 643.36 last 96.07) - open/close 58473 (time 1771400635.65 total 653.37 last 80.35) - open/close 59432 (time 1771400645.66 total 663.37 last 95.84) - open/close 60000 (time 1771400652.69 total 670.40 last 80.81) - open/close 60892 (time 1771400662.69 total 680.41 last 89.13) - open/close 61626 (time 1771400672.69 total 690.41 last 73.39) - open/close 62497 (time 1771400682.70 total 700.42 last 87.04) - open/close 63361 (time 1771400692.71 total 710.42 last 86.36) - open/close 64240 (time 1771400702.71 total 720.43 last 87.82) total: 64768 open/close in 725.29 seconds: 89.30 ops/second - /unlink 826 (time 1771400722.45 total 10.01 last 82.55) - /unlink 1793 (time 1771400732.46 total 20.01 last 96.65) - /unlink 2625 (time 1771400742.46 total 30.02 last 83.17) - /unlink 3472 (time 1771400752.46 total 40.02 last 84.66) - /unlink 4398 (time 1771400762.47 total 50.02 last 92.57) - /unlink 5345 (time 1771400772.48 total 60.03 last 94.60) - /unlink 6205 (time 1771400782.50 total 70.06 last 85.82) - /unlink 7061 (time 1771400792.51 total 80.06 last 85.53) - /unlink 7836 (time 1771400802.51 total 90.07 last 77.48) - /unlink 8522 (time 1771400812.51 total 100.07 last 68.60) - /unlink 9208 (time 1771400822.53 total 110.08 last 68.50) - /unlink 9997 (time 1771400832.54 total 120.10 last 78.79) - /unlink 10685 (time 1771400842.55 total 130.11 last 68.71) - /unlink 11492 (time 1771400852.56 total 140.11 last 80.67) - /unlink 12292 (time 1771400862.56 total 150.11 last 79.99) - /unlink 12998 (time 1771400872.56 total 160.12 last 70.56) - /unlink 13868 (time 1771400882.56 total 170.12 last 86.99) - /unlink 14616 (time 1771400892.57 total 180.12 last 74.77) - /unlink 15531 (time 1771400902.57 total 190.13 last 91.46) - /unlink 16430 (time 1771400912.58 total 200.13 last 89.86) - /unlink 17341 (time 1771400922.59 total 210.14 last 91.02) - /unlink 18296 (time 1771400932.60 total 220.16 last 95.34) - /unlink 19137 (time 1771400942.61 total 230.17 last 84.03) - /unlink 19942 (time 1771400952.62 total 240.18 last 80.43) - /unlink 20774 (time 1771400962.62 total 250.18 last 83.16) - /unlink 21739 (time 1771400972.63 total 260.19 last 96.45) - /unlink 22571 (time 1771400982.63 total 270.19 last 83.16) - /unlink 23490 (time 1771400992.64 total 280.20 last 91.83) - /unlink 24265 (time 1771401002.65 total 290.21 last 77.39) - /unlink 25018 (time 1771401012.67 total 300.22 last 75.22) - /unlink 25805 (time 1771401022.68 total 310.23 last 78.60) - /unlink 26754 (time 1771401032.69 total 320.25 last 94.79) - /unlink 27574 (time 1771401042.69 total 330.25 last 81.97) - /unlink 28396 (time 1771401052.70 total 340.26 last 82.15) - /unlink 29309 (time 1771401062.70 total 350.26 last 91.26) - /unlink 30000 (time 1771401069.90 total 357.45 last 96.05) - /unlink 30913 (time 1771401079.91 total 367.47 last 91.18) - /unlink 31614 (time 1771401089.92 total 377.48 last 70.03) - /unlink 32456 (time 1771401099.92 total 387.48 last 84.16) - /unlink 33269 (time 1771401109.92 total 397.48 last 81.30) - /unlink 34041 (time 1771401119.93 total 407.49 last 77.12) - /unlink 34712 (time 1771401129.94 total 417.49 last 67.08) - /unlink 35651 (time 1771401139.95 total 427.50 last 93.82) - /unlink 36543 (time 1771401149.95 total 437.50 last 89.19) - /unlink 37479 (time 1771401159.95 total 447.51 last 93.57) - /unlink 38388 (time 1771401169.97 total 457.53 last 90.70) - /unlink 39173 (time 1771401179.99 total 467.55 last 78.35) - /unlink 39941 (time 1771401190.03 total 477.59 last 76.49) - /unlink 40804 (time 1771401200.04 total 487.60 last 86.23) - /unlink 41658 (time 1771401210.10 total 497.66 last 84.89) - /unlink 42448 (time 1771401220.11 total 507.67 last 78.92) - /unlink 43103 (time 1771401230.12 total 517.68 last 65.44) - /unlink 43843 (time 1771401240.13 total 527.69 last 73.92) - /unlink 44807 (time 1771401250.14 total 537.69 last 96.36) - /unlink 45638 (time 1771401260.15 total 547.71 last 82.99) - /unlink 46443 (time 1771401270.16 total 557.71 last 80.45) - /unlink 47367 (time 1771401280.16 total 567.72 last 92.32) - /unlink 48134 (time 1771401290.18 total 577.73 last 76.60) - /unlink 49054 (time 1771401300.18 total 587.74 last 91.95) - /unlink 49807 (time 1771401310.21 total 597.77 last 75.10) - /unlink 50000 (time 1771401312.30 total 599.86 last 92.20) - /unlink 50749 (time 1771401322.32 total 609.88 last 74.76) - /unlink 51538 (time 1771401332.34 total 619.90 last 78.73) - /unlink 52584 (time 1771401342.34 total 629.90 last 104.59) - /unlink 53547 (time 1771401352.35 total 639.90 last 96.26) - /unlink 54439 (time 1771401362.35 total 649.90 last 89.19) - /unlink 55316 (time 1771401372.36 total 659.91 last 87.64) - /unlink 56322 (time 1771401382.37 total 669.93 last 100.46) - /unlink 57298 (time 1771401392.37 total 679.93 last 97.57) - /unlink 58337 (time 1771401402.37 total 689.93 last 103.89) - /unlink 59269 (time 1771401412.38 total 699.93 last 93.18) - /unlink 60000 (time 1771401419.82 total 707.38 last 98.18) - /unlink 60935 (time 1771401429.82 total 717.38 last 93.48) - /unlink 62011 (time 1771401439.82 total 727.38 last 107.57) - /unlink 62904 (time 1771401449.83 total 737.38 last 89.28) - /unlink 63821 (time 1771401459.83 total 747.38 last 91.70) - /unlink 64749 (time 1771401469.83 total 757.39 last 92.75) total: 64768 /unlink in 757.56 seconds: 85.50 ops/second Waiting for MDT destroys to complete oleg302-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 - open/close 910 (time 1771401497.39 total 10.01 last 90.95) - open/close 1883 (time 1771401507.39 total 20.01 last 97.25) - open/close 2824 (time 1771401517.39 total 30.01 last 94.08) - open/close 3787 (time 1771401527.40 total 40.02 last 96.19) - open/close 4804 (time 1771401537.42 total 50.04 last 101.53) - open/close 5841 (time 1771401547.43 total 60.05 last 103.64) - open/close 6886 (time 1771401557.43 total 70.05 last 104.48) - open/close 7974 (time 1771401567.43 total 80.05 last 108.74) - open/close 9035 (time 1771401577.44 total 90.06 last 106.04) - open/close 10000 (time 1771401587.16 total 99.78 last 99.27) - open/close 11003 (time 1771401597.17 total 109.79 last 100.25) - open/close 12031 (time 1771401607.17 total 119.79 last 102.75) - open/close 13125 (time 1771401617.17 total 129.79 last 109.38) - open/close 14168 (time 1771401627.17 total 139.80 last 104.27) - open/close 15248 (time 1771401637.18 total 149.80 last 108.00) - open/close 16346 (time 1771401647.18 total 159.80 last 109.75) - open/close 17279 (time 1771401657.18 total 169.80 last 93.27) - open/close 18107 (time 1771401667.20 total 179.82 last 82.68) - open/close 19130 (time 1771401677.20 total 189.82 last 102.28) - open/close 20000 (time 1771401685.52 total 198.14 last 104.50) - open/close 20977 (time 1771401695.53 total 208.15 last 97.68) - open/close 22050 (time 1771401705.53 total 218.15 last 107.22) - open/close 23083 (time 1771401715.54 total 228.16 last 103.27) - open/close 24165 (time 1771401725.54 total 238.16 last 108.17) - open/close 25200 (time 1771401735.54 total 248.16 last 103.46) - open/close 26281 (time 1771401745.55 total 258.17 last 108.00) - open/close 27345 (time 1771401755.56 total 268.18 last 106.32) - open/close 28477 (time 1771401765.57 total 278.19 last 113.10) - open/close 29576 (time 1771401775.57 total 288.19 last 109.86) - open/close 30000 (time 1771401779.29 total 291.91 last 114.24) - open/close 31122 (time 1771401789.30 total 301.92 last 112.04) - open/close 32184 (time 1771401799.30 total 311.92 last 106.18) - open/close 33247 (time 1771401809.31 total 321.93 last 106.21) - open/close 34301 (time 1771401819.31 total 331.93 last 105.40) - open/close 35495 (time 1771401829.31 total 341.93 last 119.36) - open/close 36598 (time 1771401839.32 total 351.94 last 110.25) - open/close 37677 (time 1771401849.33 total 361.95 last 107.77) - open/close 38708 (time 1771401859.34 total 371.96 last 103.01) - open/close 39751 (time 1771401869.34 total 381.96 last 104.28) - open/close 40000 (time 1771401871.51 total 384.13 last 114.79) - open/close 41009 (time 1771401881.51 total 394.13 last 100.88) - open/close 42002 (time 1771401891.51 total 404.13 last 99.30) - open/close 43045 (time 1771401901.52 total 414.14 last 104.25) - open/close 44164 (time 1771401911.52 total 424.14 last 111.88) - open/close 45367 (time 1771401921.52 total 434.14 last 120.28) - open/close 46462 (time 1771401931.52 total 444.15 last 109.44) - open/close 47490 (time 1771401941.53 total 454.15 last 102.72) - open/close 48466 (time 1771401951.55 total 464.17 last 97.47) - open/close 49407 (time 1771401961.56 total 474.18 last 93.98) - open/close 50000 (time 1771401967.38 total 480.00 last 101.81) - open/close 51017 (time 1771401977.38 total 490.00 last 101.68) - open/close 52102 (time 1771401987.39 total 500.01 last 108.48) - open/close 53154 (time 1771401997.40 total 510.02 last 105.09) - open/close 54165 (time 1771402007.40 total 520.02 last 101.07) - open/close 55289 (time 1771402017.41 total 530.03 last 112.31) - open/close 56396 (time 1771402027.41 total 540.04 last 110.62) - open/close 57468 (time 1771402037.43 total 550.05 last 107.05) - open/close 58559 (time 1771402047.44 total 560.06 last 109.00) - open/close 59638 (time 1771402057.44 total 570.06 last 107.89) - open/close 60000 (time 1771402060.76 total 573.38 last 108.90) - open/close 61111 (time 1771402070.77 total 583.39 last 111.05) - open/close 62285 (time 1771402080.78 total 593.40 last 117.28) - open/close 63367 (time 1771402090.78 total 603.40 last 108.15) - open/close 64511 (time 1771402100.79 total 613.41 last 114.33) total: 64768 open/close in 615.57 seconds: 105.22 ops/second - /unlink 1024 (time 1771402116.40 total 10.00 last 102.36) - /unlink 2015 (time 1771402126.40 total 20.01 last 99.03) - /unlink 3082 (time 1771402136.41 total 30.02 last 106.61) - /unlink 4099 (time 1771402146.42 total 40.02 last 101.64) - /unlink 5127 (time 1771402156.42 total 50.03 last 102.73) - /unlink 6168 (time 1771402166.43 total 60.04 last 104.02) - /unlink 7105 (time 1771402176.44 total 70.04 last 93.65) - /unlink 8127 (time 1771402186.44 total 80.05 last 102.14) - /unlink 9207 (time 1771402196.44 total 90.05 last 107.99) - /unlink 10000 (time 1771402204.23 total 97.84 last 101.79) - /unlink 10933 (time 1771402214.24 total 107.85 last 93.23) - /unlink 11939 (time 1771402224.25 total 117.85 last 100.54) - /unlink 12898 (time 1771402234.25 total 127.86 last 95.85) - /unlink 13893 (time 1771402244.26 total 137.86 last 99.47) - /unlink 14969 (time 1771402254.26 total 147.87 last 107.54) - /unlink 15990 (time 1771402264.27 total 157.88 last 102.02) - /unlink 16985 (time 1771402274.27 total 167.88 last 99.45) - /unlink 18115 (time 1771402284.28 total 177.88 last 112.96) - /unlink 19274 (time 1771402294.28 total 187.89 last 115.90) - /unlink 20000 (time 1771402301.20 total 194.81 last 104.84) - /unlink 20998 (time 1771402311.21 total 204.81 last 99.76) - /unlink 22082 (time 1771402321.21 total 214.82 last 108.37) - /unlink 23296 (time 1771402331.22 total 224.82 last 121.33) - /unlink 24379 (time 1771402341.22 total 234.83 last 108.26) - /unlink 25504 (time 1771402351.23 total 244.84 last 112.40) - /unlink 26700 (time 1771402361.23 total 254.84 last 119.57) - /unlink 27849 (time 1771402371.23 total 264.84 last 114.87) - /unlink 29006 (time 1771402381.25 total 274.86 last 115.53) - /unlink 30000 (time 1771402391.01 total 284.62 last 101.78) - /unlink 31006 (time 1771402401.02 total 294.62 last 100.58) - /unlink 32065 (time 1771402411.02 total 304.63 last 105.86) - /unlink 33199 (time 1771402421.02 total 314.63 last 113.38) - /unlink 34410 (time 1771402431.03 total 324.64 last 121.00) - /unlink 35551 (time 1771402441.03 total 334.64 last 114.04) - /unlink 36644 (time 1771402451.04 total 344.65 last 109.23) - /unlink 37827 (time 1771402461.07 total 354.68 last 117.96) - /unlink 38997 (time 1771402471.07 total 364.68 last 116.95) - /unlink 40000 (time 1771402478.89 total 372.50 last 128.27) - /unlink 41301 (time 1771402488.89 total 382.50 last 130.08) - /unlink 42542 (time 1771402498.90 total 392.51 last 124.04) - /unlink 43682 (time 1771402508.90 total 402.51 last 113.93) - /unlink 44774 (time 1771402518.91 total 412.52 last 109.17) - /unlink 45990 (time 1771402528.91 total 422.52 last 121.58) - /unlink 47286 (time 1771402538.91 total 432.52 last 129.57) - /unlink 49104 (time 1771402548.92 total 442.52 last 181.71) - /unlink 50000 (time 1771402553.34 total 446.94 last 202.73) - /unlink 52133 (time 1771402563.34 total 456.94 last 213.28) - /unlink 54473 (time 1771402573.34 total 466.94 last 234.00) - /unlink 56626 (time 1771402583.34 total 476.95 last 215.24) - /unlink 58898 (time 1771402593.34 total 486.95 last 227.19) - /unlink 60000 (time 1771402598.65 total 492.26 last 207.61) - /unlink 62271 (time 1771402608.65 total 502.26 last 227.01) total: 64768 /unlink in 511.97 seconds: 126.51 ops/second Waiting for MDT destroys to complete oleg302-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 - open/close 1412 (time 1771402637.48 total 10.00 last 141.15) - open/close 2760 (time 1771402647.48 total 20.00 last 134.78) - open/close 4093 (time 1771402657.49 total 30.01 last 133.24) - open/close 5331 (time 1771402667.50 total 40.02 last 123.69) - open/close 6602 (time 1771402677.50 total 50.02 last 127.02) - open/close 7942 (time 1771402687.50 total 60.03 last 133.98) - open/close 9209 (time 1771402697.51 total 70.03 last 126.62) - open/close 10000 (time 1771402704.02 total 76.54 last 121.49) - open/close 11218 (time 1771402714.03 total 86.55 last 121.74) - open/close 12528 (time 1771402724.03 total 96.55 last 130.92) - open/close 13847 (time 1771402734.03 total 106.56 last 131.87) - open/close 15235 (time 1771402744.04 total 116.56 last 138.76) - open/close 16778 (time 1771402754.04 total 126.56 last 154.30) - open/close 18197 (time 1771402764.04 total 136.56 last 141.82) - open/close 19486 (time 1771402774.04 total 146.57 last 128.88) - open/close 20000 (time 1771402778.25 total 150.78 last 122.07) - open/close 21207 (time 1771402788.26 total 160.78 last 120.69) - open/close 22501 (time 1771402798.26 total 170.78 last 129.35) - open/close 23848 (time 1771402808.26 total 180.78 last 134.67) - open/close 25179 (time 1771402818.26 total 190.79 last 133.06) - open/close 26441 (time 1771402828.27 total 200.79 last 126.15) - open/close 27909 (time 1771402838.27 total 210.79 last 146.79) - open/close 29442 (time 1771402848.27 total 220.79 last 153.24) - open/close 30000 (time 1771402851.98 total 224.51 last 150.37) - open/close 31349 (time 1771402861.99 total 234.51 last 134.81) - open/close 32723 (time 1771402872.00 total 244.52 last 137.27) - open/close 34169 (time 1771402882.01 total 254.53 last 144.51) - open/close 35681 (time 1771402892.01 total 264.53 last 151.18) - open/close 37241 (time 1771402902.01 total 274.53 last 155.95) - open/close 39023 (time 1771402912.01 total 284.53 last 178.16) - open/close 40000 (time 1771402917.41 total 289.93 last 181.13) - open/close 41373 (time 1771402927.41 total 299.93 last 137.22) - open/close 42797 (time 1771402937.43 total 309.95 last 142.18) - open/close 44217 (time 1771402947.43 total 319.95 last 142.00) - open/close 45517 (time 1771402957.43 total 329.95 last 129.94) - open/close 46933 (time 1771402967.44 total 339.96 last 141.54) - open/close 48511 (time 1771402977.44 total 349.96 last 157.75) - open/close 49883 (time 1771402987.44 total 359.96 last 137.17) - open/close 51498 (time 1771402997.44 total 369.97 last 161.48) - open/close 52967 (time 1771403007.45 total 379.97 last 146.79) - open/close 54340 (time 1771403017.45 total 389.98 last 137.24) - open/close 56387 (time 1771403027.46 total 399.98 last 204.66) - open/close 58208 (time 1771403037.46 total 409.98 last 182.05) - open/close 60000 (time 1771403046.17 total 418.70 last 205.65) - open/close 61905 (time 1771403056.17 total 428.70 last 190.48) - open/close 63925 (time 1771403066.18 total 438.70 last 201.98) total: 64768 open/close in 442.95 seconds: 146.22 ops/second - /unlink 3506 (time 1771403082.30 total 10.00 last 350.55) - /unlink 7741 (time 1771403092.30 total 20.00 last 423.43) - /unlink 10000 (time 1771403098.30 total 26.00 last 376.64) - /unlink 13811 (time 1771403108.30 total 36.00 last 381.06) - /unlink 18212 (time 1771403118.30 total 46.00 last 440.05) - /unlink 20000 (time 1771403123.21 total 50.91 last 364.32) - /unlink 23164 (time 1771403133.21 total 60.91 last 316.39) - /unlink 26195 (time 1771403143.21 total 70.91 last 303.01) - /unlink 29870 (time 1771403153.21 total 80.92 last 367.46) - /unlink 33267 (time 1771403163.22 total 90.92 last 339.61) - /unlink 36547 (time 1771403173.22 total 100.92 last 327.93) - /unlink 40000 (time 1771403182.56 total 110.26 last 369.69) - /unlink 43224 (time 1771403192.56 total 120.26 last 322.39) - /unlink 46513 (time 1771403202.56 total 130.26 last 328.87) - /unlink 50000 (time 1771403212.00 total 139.71 last 369.19) - /unlink 53675 (time 1771403222.01 total 149.71 last 367.45) - /unlink 57201 (time 1771403232.01 total 159.71 last 352.44) - /unlink 60000 (time 1771403240.85 total 168.55 last 316.78) - /unlink 64025 (time 1771403250.85 total 178.55 last 402.48) total: 64768 /unlink in 180.81 seconds: 358.22 ops/second Waiting for MDT destroys to complete oleg302-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 - open/close 2059 (time 1771403275.80 total 10.00 last 205.84) - open/close 3817 (time 1771403285.80 total 20.01 last 175.76) - open/close 5788 (time 1771403295.82 total 30.02 last 196.85) - open/close 7656 (time 1771403305.82 total 40.02 last 186.73) - open/close 10000 (time 1771403315.06 total 49.27 last 253.57) - open/close 11988 (time 1771403325.07 total 59.27 last 198.67) - open/close 14484 (time 1771403335.07 total 69.27 last 249.59) - open/close 16317 (time 1771403345.07 total 79.28 last 183.25) - open/close 18017 (time 1771403355.08 total 89.28 last 169.92) - open/close 19822 (time 1771403365.08 total 99.28 last 180.47) - open/close 21584 (time 1771403375.08 total 109.29 last 176.10) - open/close 23164 (time 1771403385.09 total 119.29 last 157.97) - open/close 24868 (time 1771403395.09 total 129.29 last 170.38) - open/close 26761 (time 1771403405.09 total 139.29 last 189.28) - open/close 29310 (time 1771403415.09 total 149.29 last 254.82) - open/close 30000 (time 1771403418.44 total 152.64 last 206.26) - open/close 32230 (time 1771403428.44 total 162.64 last 222.93) - open/close 34069 (time 1771403438.44 total 172.64 last 183.88) - open/close 35816 (time 1771403448.44 total 182.65 last 174.65) - open/close 37868 (time 1771403458.45 total 192.65 last 205.07) - open/close 39972 (time 1771403468.46 total 202.66 last 210.30) - open/close 42246 (time 1771403478.46 total 212.66 last 227.37) - open/close 45335 (time 1771403488.46 total 222.66 last 308.84) - open/close 48086 (time 1771403498.46 total 232.66 last 275.06) - open/close 50000 (time 1771403505.25 total 239.45 last 282.01) - open/close 52483 (time 1771403515.25 total 249.46 last 248.16) - open/close 54887 (time 1771403525.25 total 259.46 last 240.37) - open/close 57382 (time 1771403535.25 total 269.46 last 249.49) - open/close 60000 (time 1771403545.01 total 279.21 last 268.31) - open/close 62607 (time 1771403555.01 total 289.22 last 260.66) total: 64768 open/close in 296.97 seconds: 218.09 ops/second - /unlink 5098 (time 1771403574.28 total 10.00 last 509.80) - /unlink 9912 (time 1771403584.28 total 20.00 last 481.35) - /unlink 14333 (time 1771403594.28 total 30.00 last 442.07) - /unlink 18807 (time 1771403604.28 total 40.00 last 447.40) - /unlink 20000 (time 1771403606.29 total 42.01 last 593.47) - /unlink 25172 (time 1771403616.29 total 52.02 last 516.99) - /unlink 30000 (time 1771403625.77 total 61.49 last 509.64) - /unlink 34492 (time 1771403635.77 total 71.49 last 449.17) - /unlink 38383 (time 1771403645.77 total 81.49 last 389.08) - /unlink 40000 (time 1771403649.48 total 85.20 last 435.98) - /unlink 45374 (time 1771403659.48 total 95.20 last 537.34) - /unlink 50000 (time 1771403669.03 total 104.75 last 484.32) - /unlink 55205 (time 1771403679.03 total 114.75 last 520.46) - /unlink 60000 (time 1771403685.84 total 121.56 last 704.59) total: 64768 /unlink in 130.37 seconds: 496.80 ops/second Waiting for MDT destroys to complete oleg302-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 - open/close 2720 (time 1771403713.00 total 10.00 last 271.98) - open/close 6043 (time 1771403723.00 total 20.00 last 332.28) - open/close 10000 (time 1771403732.62 total 29.63 last 411.01) - open/close 14207 (time 1771403742.63 total 39.63 last 420.67) - open/close 17989 (time 1771403752.63 total 49.63 last 378.16) - open/close 20000 (time 1771403758.15 total 55.15 last 364.08) - open/close 23457 (time 1771403768.15 total 65.16 last 345.63) - open/close 26498 (time 1771403778.15 total 75.16 last 304.04) - open/close 29028 (time 1771403788.16 total 85.16 last 252.89) - open/close 30000 (time 1771403792.02 total 89.02 last 251.93) - open/close 33068 (time 1771403802.02 total 99.02 last 306.68) - open/close 36634 (time 1771403812.02 total 109.03 last 356.51) - open/close 40000 (time 1771403821.13 total 118.14 last 369.43) - open/close 43243 (time 1771403831.14 total 128.14 last 324.25) - open/close 46708 (time 1771403841.14 total 138.14 last 346.47) - open/close 50000 (time 1771403850.96 total 147.96 last 335.25) - open/close 52826 (time 1771403860.96 total 157.96 last 282.56) - open/close 55421 (time 1771403870.96 total 167.96 last 259.44) - open/close 58301 (time 1771403880.96 total 177.97 last 287.93) - open/close 60000 (time 1771403886.32 total 183.32 last 317.03) - open/close 62944 (time 1771403896.32 total 193.33 last 294.37) total: 64768 open/close in 199.13 seconds: 325.26 ops/second - /unlink 3929 (time 1771403913.61 total 10.00 last 392.87) - /unlink 8194 (time 1771403923.61 total 20.00 last 426.44) - /unlink 10000 (time 1771403928.88 total 25.27 last 342.72) - /unlink 15497 (time 1771403938.88 total 35.27 last 549.67) - /unlink 20000 (time 1771403946.90 total 43.29 last 561.80) - /unlink 24824 (time 1771403956.90 total 53.29 last 482.22) - /unlink 30000 (time 1771403965.74 total 62.13 last 585.38) - /unlink 37461 (time 1771403975.74 total 72.13 last 746.02) - /unlink 40000 (time 1771403979.05 total 75.44 last 768.39) - /unlink 47457 (time 1771403989.05 total 85.44 last 745.69) - /unlink 50000 (time 1771403992.52 total 88.91 last 731.72) - /unlink 55964 (time 1771404002.52 total 98.91 last 596.39) - /unlink 60000 (time 1771404009.41 total 105.80 last 585.86) total: 64768 /unlink in 115.68 seconds: 559.87 ops/second Waiting for MDT destroys to complete oleg302-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg302-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg302-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg302-server stop mds service on oleg302-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg302-server stop mds service on oleg302-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg302-server unloading modules via unload_modules_local on: 'oleg302-server' oleg302-server: oleg302-server.virtnet: executing unload_modules_local oleg302-server: modules unloaded. pdsh@oleg302-client: oleg302-client: ssh exited with exit code 2 pdsh@oleg302-client: oleg302-server: ssh exited with exit code 2 pdsh@oleg302-client: oleg302-client: ssh exited with exit code 2 pdsh@oleg302-client: oleg302-server: ssh exited with exit code 2