-----============= acceptance-small: conf-sanity ============----- Sun Nov 16 18:18:25 EST 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg333-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball Stopping clients: oleg333-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg333-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg333-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg333-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg333-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg333-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg333-server oleg333-server: oleg333-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg333-server' oleg333-server: oleg333-server.virtnet: executing load_modules_local oleg333-server: Loading modules from /home/green/git/lustre-release/lustre oleg333-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg333-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg333-server: detected 4 online CPUs by sysfs oleg333-server: MODOPTS_LIBCFS= oleg333-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg333-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg333-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg333-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg333-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg333-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg333-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg333-server: oleg333-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg333-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg333-server: oleg333-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg333-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg333-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg333-server stop mds service on oleg333-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg333-server stop mds service on oleg333-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg333-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 18:21:37 (1763335297) Stopping clients: oleg333-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg333-client.virtnet /mnt/lustre2 (opts:-f) oleg333-server: oleg333-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg333-server' oleg333-server: oleg333-server.virtnet: executing load_modules_local oleg333-server: Loading modules from /home/green/git/lustre-release/lustre oleg333-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg333-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg333-server: detected 4 online CPUs by sysfs oleg333-server: MODOPTS_LIBCFS= oleg333-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg333-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg333-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg333-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg333-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg333-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg333-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg333-client.virtnet: -o user_xattr,flock 192.168.203.133@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 65808 368 65440 1% /mnt/lustre[OST:0] filesystem_summary: 65969 529 65440 1% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 742 (time 1763335412.77 total 10.00 last 74.19) - open/close 1304 (time 1763335422.79 total 20.01 last 56.13) - open/close 1977 (time 1763335432.80 total 30.03 last 67.19) - open/close 2730 (time 1763335442.81 total 40.03 last 75.29) - open/close 3427 (time 1763335452.82 total 50.04 last 69.62) - open/close 4127 (time 1763335462.83 total 60.05 last 69.94) - open/close 4882 (time 1763335472.83 total 70.06 last 75.47) - open/close 5662 (time 1763335482.84 total 80.07 last 77.91) - open/close 6491 (time 1763335492.85 total 90.07 last 82.85) - open/close 7228 (time 1763335502.86 total 100.08 last 73.64) - open/close 7954 (time 1763335512.86 total 110.08 last 72.59) - open/close 8660 (time 1763335522.88 total 120.11 last 70.43) - open/close 9436 (time 1763335532.88 total 130.11 last 77.59) - open/close 10000 (time 1763335541.52 total 138.74 last 65.32) - open/close 10666 (time 1763335551.52 total 148.75 last 66.57) - open/close 11387 (time 1763335561.53 total 158.76 last 72.05) - open/close 12055 (time 1763335571.54 total 168.77 last 66.72) - open/close 12813 (time 1763335581.55 total 178.77 last 75.77) - open/close 13600 (time 1763335591.55 total 188.78 last 78.65) - open/close 14340 (time 1763335601.56 total 198.79 last 73.95) - open/close 15125 (time 1763335611.56 total 208.79 last 78.47) - open/close 15915 (time 1763335621.57 total 218.80 last 78.93) - open/close 16644 (time 1763335631.60 total 228.82 last 72.71) - open/close 17355 (time 1763335641.60 total 238.83 last 71.06) - open/close 18189 (time 1763335651.61 total 248.84 last 83.32) - open/close 18925 (time 1763335661.63 total 258.85 last 73.50) - open/close 19749 (time 1763335671.63 total 268.86 last 82.37) - open/close 20000 (time 1763335674.78 total 272.01 last 79.66) - open/close 20894 (time 1763335684.79 total 282.01 last 89.35) - open/close 21706 (time 1763335694.80 total 292.02 last 81.13) - open/close 22425 (time 1763335704.80 total 302.02 last 71.88) - open/close 23246 (time 1763335714.81 total 312.04 last 82.00) - open/close 24080 (time 1763335724.81 total 322.04 last 83.40) - open/close 24970 (time 1763335734.81 total 332.04 last 88.98) - open/close 25831 (time 1763335744.82 total 342.05 last 86.02) - open/close 26683 (time 1763335754.83 total 352.05 last 85.14) - open/close 27581 (time 1763335764.83 total 362.06 last 89.78) - open/close 28503 (time 1763335774.84 total 372.06 last 92.15) - open/close 29350 (time 1763335784.85 total 382.07 last 84.59) - open/close 30000 (time 1763335792.66 total 389.88 last 83.22) - open/close 30873 (time 1763335802.66 total 399.89 last 87.25) - open/close 31683 (time 1763335812.68 total 409.91 last 80.88) - open/close 32494 (time 1763335822.70 total 419.92 last 80.96) - open/close 33346 (time 1763335832.70 total 429.93 last 85.15) - open/close 34244 (time 1763335842.71 total 439.94 last 89.71) - open/close 35234 (time 1763335852.72 total 449.94 last 98.95) - open/close 36100 (time 1763335862.72 total 459.95 last 86.57) - open/close 37022 (time 1763335872.73 total 469.96 last 92.10) - open/close 37886 (time 1763335882.74 total 479.96 last 86.34) - open/close 38751 (time 1763335892.74 total 489.97 last 86.47) - open/close 39566 (time 1763335902.75 total 499.98 last 81.40) - open/close 40000 (time 1763335908.38 total 505.61 last 77.15) - open/close 40794 (time 1763335918.38 total 515.61 last 79.37) - open/close 41641 (time 1763335928.39 total 525.61 last 84.66) - open/close 42389 (time 1763335938.40 total 535.62 last 74.74) - open/close 43006 (time 1763335948.41 total 545.63 last 61.63) - open/close 43729 (time 1763335958.42 total 555.64 last 72.22) - open/close 44484 (time 1763335968.42 total 565.65 last 75.48) - open/close 45341 (time 1763335978.42 total 575.65 last 85.68) - open/close 46227 (time 1763335988.43 total 585.66 last 88.50) - open/close 47062 (time 1763335998.44 total 595.66 last 83.46) - open/close 47891 (time 1763336008.44 total 605.67 last 82.86) - open/close 48662 (time 1763336018.46 total 615.69 last 76.97) - open/close 49404 (time 1763336028.47 total 625.70 last 74.10) - open/close 50000 (time 1763336035.25 total 632.48 last 87.94) - open/close 50823 (time 1763336045.26 total 642.49 last 82.23) - open/close 51730 (time 1763336055.27 total 652.50 last 90.59) - open/close 52706 (time 1763336065.28 total 662.50 last 97.55) - open/close 53597 (time 1763336075.29 total 672.51 last 89.01) - open/close 54467 (time 1763336085.30 total 682.53 last 86.86) - open/close 55277 (time 1763336095.30 total 692.53 last 80.98) - open/close 56165 (time 1763336105.32 total 702.54 last 88.69) - open/close 57019 (time 1763336115.32 total 712.54 last 85.40) - open/close 57908 (time 1763336125.33 total 722.55 last 88.82) - open/close 58834 (time 1763336135.34 total 732.57 last 92.47) - open/close 59745 (time 1763336145.35 total 742.58 last 90.99) - open/close 60000 (time 1763336148.39 total 745.61 last 84.07) - open/close 60870 (time 1763336158.40 total 755.62 last 86.89) - open/close 61758 (time 1763336168.41 total 765.63 last 88.72) - open/close 62624 (time 1763336178.41 total 775.64 last 86.57) - open/close 63438 (time 1763336188.42 total 785.64 last 81.37) - open/close 64263 (time 1763336198.42 total 795.64 last 82.49) total: 64768 open/close in 802.14 seconds: 80.74 ops/second - /unlink 776 (time 1763336218.12 total 10.01 last 77.54) - /unlink 1474 (time 1763336228.14 total 20.03 last 69.66) - /unlink 2243 (time 1763336238.14 total 30.03 last 76.89) - /unlink 3019 (time 1763336248.15 total 40.04 last 77.52) - /unlink 3855 (time 1763336258.16 total 50.05 last 83.51) - /unlink 4714 (time 1763336268.17 total 60.06 last 85.85) - /unlink 5500 (time 1763336278.17 total 70.06 last 78.58) - /unlink 6296 (time 1763336288.18 total 80.06 last 79.56) - /unlink 7034 (time 1763336298.20 total 90.08 last 73.67) - /unlink 7754 (time 1763336308.20 total 100.08 last 71.99) - /unlink 8533 (time 1763336318.20 total 110.08 last 77.89) - /unlink 9290 (time 1763336328.21 total 120.10 last 75.59) - /unlink 10000 (time 1763336337.53 total 129.41 last 76.24) - /unlink 10793 (time 1763336347.53 total 139.41 last 79.29) - /unlink 11537 (time 1763336357.54 total 149.42 last 74.31) - /unlink 12281 (time 1763336367.55 total 159.43 last 74.35) - /unlink 13081 (time 1763336377.55 total 169.44 last 79.95) - /unlink 13847 (time 1763336387.56 total 179.45 last 76.53) - /unlink 14625 (time 1763336397.57 total 189.45 last 77.72) - /unlink 15386 (time 1763336407.58 total 199.47 last 76.01) - /unlink 16145 (time 1763336417.58 total 209.47 last 75.88) - /unlink 17004 (time 1763336427.59 total 219.48 last 85.80) - /unlink 18079 (time 1763336437.60 total 229.49 last 107.41) - /unlink 19115 (time 1763336447.61 total 239.49 last 103.55) - /unlink 20000 (time 1763336456.89 total 248.78 last 95.34) - /unlink 20914 (time 1763336466.89 total 258.78 last 91.40) - /unlink 21701 (time 1763336476.90 total 268.78 last 78.65) - /unlink 22440 (time 1763336486.91 total 278.79 last 73.82) - /unlink 23246 (time 1763336496.91 total 288.80 last 80.56) - /unlink 24175 (time 1763336506.92 total 298.80 last 92.86) - /unlink 25055 (time 1763336516.94 total 308.82 last 87.84) - /unlink 25817 (time 1763336526.94 total 318.83 last 76.16) - /unlink 26699 (time 1763336536.95 total 328.83 last 88.14) - /unlink 27697 (time 1763336546.95 total 338.84 last 99.74) - /unlink 28516 (time 1763336556.95 total 348.84 last 81.90) - /unlink 29335 (time 1763336566.97 total 358.85 last 81.81) - /unlink 30000 (time 1763336574.96 total 366.85 last 83.16) - /unlink 30752 (time 1763336584.96 total 376.85 last 75.20) - /unlink 31538 (time 1763336594.97 total 386.86 last 78.53) - /unlink 32161 (time 1763336604.98 total 396.87 last 62.24) - /unlink 32828 (time 1763336614.99 total 406.87 last 66.65) - /unlink 33593 (time 1763336624.99 total 416.87 last 76.49) - /unlink 34329 (time 1763336635.01 total 426.89 last 73.47) - /unlink 35130 (time 1763336645.01 total 436.89 last 80.10) - /unlink 35916 (time 1763336655.01 total 446.90 last 78.55) - /unlink 36695 (time 1763336665.03 total 456.91 last 77.79) - /unlink 37523 (time 1763336675.03 total 466.92 last 82.74) - /unlink 38366 (time 1763336685.04 total 476.92 last 84.25) - /unlink 39034 (time 1763336695.04 total 486.93 last 66.77) - /unlink 39850 (time 1763336705.05 total 496.93 last 81.58) - /unlink 40664 (time 1763336715.05 total 506.94 last 81.34) - /unlink 41492 (time 1763336725.05 total 516.94 last 82.79) - /unlink 42296 (time 1763336735.07 total 526.95 last 80.28) - /unlink 43047 (time 1763336745.07 total 536.96 last 75.08) - /unlink 43829 (time 1763336755.08 total 546.96 last 78.16) - /unlink 44621 (time 1763336765.08 total 556.97 last 79.16) - /unlink 45385 (time 1763336775.09 total 566.97 last 76.38) - /unlink 46177 (time 1763336785.10 total 576.98 last 79.10) - /unlink 46964 (time 1763336795.11 total 586.99 last 78.65) - /unlink 47749 (time 1763336805.11 total 597.00 last 78.46) - /unlink 48516 (time 1763336815.12 total 607.00 last 76.64) - /unlink 49310 (time 1763336825.12 total 617.01 last 79.37) - /unlink 50000 (time 1763336833.92 total 625.81 last 78.40) - /unlink 50813 (time 1763336843.93 total 635.81 last 81.29) - /unlink 51590 (time 1763336853.93 total 645.81 last 77.70) - /unlink 52366 (time 1763336863.93 total 655.82 last 77.54) - /unlink 53101 (time 1763336873.94 total 665.83 last 73.42) - /unlink 53846 (time 1763336883.95 total 675.84 last 74.43) - /unlink 54604 (time 1763336893.97 total 685.86 last 75.65) - /unlink 55310 (time 1763336903.98 total 695.86 last 70.55) - /unlink 56057 (time 1763336913.99 total 705.87 last 74.66) - /unlink 56844 (time 1763336923.99 total 715.87 last 78.70) - /unlink 57613 (time 1763336934.00 total 725.88 last 76.81) - /unlink 58265 (time 1763336944.00 total 735.89 last 65.16) - /unlink 59013 (time 1763336954.01 total 745.89 last 74.79) - /unlink 59794 (time 1763336964.02 total 755.90 last 78.02) - /unlink 60000 (time 1763336966.76 total 758.64 last 75.18) - /unlink 60808 (time 1763336976.76 total 768.65 last 80.74) - /unlink 61570 (time 1763336986.76 total 778.65 last 76.19) - /unlink 62321 (time 1763336996.77 total 788.65 last 75.07) - /unlink 63133 (time 1763337006.78 total 798.66 last 81.13) - /unlink 63884 (time 1763337016.78 total 808.66 last 75.10) - /unlink 64626 (time 1763337026.79 total 818.67 last 74.12) total: 64768 /unlink in 820.53 seconds: 78.93 ops/second Waiting for MDT destroys to complete oleg333-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 - open/close 607 (time 1763337056.98 total 10.02 last 60.59) - open/close 1344 (time 1763337066.99 total 20.02 last 73.67) - open/close 2104 (time 1763337076.99 total 30.02 last 75.98) - open/close 2890 (time 1763337087.00 total 40.03 last 78.54) - open/close 3647 (time 1763337097.01 total 50.04 last 75.64) - open/close 4369 (time 1763337107.02 total 60.05 last 72.11) - open/close 5125 (time 1763337117.02 total 70.05 last 75.60) - open/close 5957 (time 1763337127.03 total 80.06 last 83.13) - open/close 6715 (time 1763337137.04 total 90.07 last 75.73) - open/close 7483 (time 1763337147.05 total 100.09 last 76.69) - open/close 8328 (time 1763337157.05 total 110.09 last 84.50) - open/close 9120 (time 1763337167.06 total 120.10 last 79.11) - open/close 9906 (time 1763337177.08 total 130.11 last 78.50) - open/close 10648 (time 1763337187.10 total 140.13 last 74.04) - open/close 11468 (time 1763337197.10 total 150.14 last 81.94) - open/close 12212 (time 1763337207.12 total 160.15 last 74.32) - open/close 12987 (time 1763337217.12 total 170.15 last 77.48) - open/close 13787 (time 1763337227.12 total 180.15 last 79.99) - open/close 14467 (time 1763337237.12 total 190.16 last 67.99) - open/close 15306 (time 1763337247.13 total 200.16 last 83.87) - open/close 16065 (time 1763337257.13 total 210.16 last 75.89) - open/close 16852 (time 1763337267.13 total 220.16 last 78.68) - open/close 17687 (time 1763337277.13 total 230.17 last 83.49) - open/close 18569 (time 1763337287.14 total 240.17 last 88.15) - open/close 19432 (time 1763337297.14 total 250.18 last 86.26) - open/close 20000 (time 1763337303.73 total 256.76 last 86.25) - open/close 20844 (time 1763337313.73 total 266.77 last 84.36) - open/close 21637 (time 1763337323.74 total 276.77 last 79.24) - open/close 22389 (time 1763337333.75 total 286.78 last 75.13) - open/close 23176 (time 1763337343.76 total 296.79 last 78.63) - open/close 23967 (time 1763337353.77 total 306.80 last 79.03) - open/close 24745 (time 1763337363.77 total 316.81 last 77.76) - open/close 25481 (time 1763337373.79 total 326.82 last 73.47) - open/close 26305 (time 1763337383.79 total 336.83 last 82.36) - open/close 27101 (time 1763337393.81 total 346.85 last 79.45) - open/close 27907 (time 1763337403.82 total 356.86 last 80.54) - open/close 28735 (time 1763337413.82 total 366.86 last 82.79) - open/close 29505 (time 1763337423.82 total 376.86 last 76.99) - open/close 30000 (time 1763337431.24 total 384.27 last 66.77) - open/close 30735 (time 1763337441.25 total 394.28 last 73.40) - open/close 31458 (time 1763337451.25 total 404.29 last 72.29) - open/close 32210 (time 1763337461.27 total 414.30 last 75.08) - open/close 33038 (time 1763337471.28 total 424.31 last 82.70) - open/close 33841 (time 1763337481.28 total 434.32 last 80.25) - open/close 34668 (time 1763337491.29 total 444.33 last 82.64) - open/close 35476 (time 1763337501.30 total 454.33 last 80.74) - open/close 36266 (time 1763337511.30 total 464.34 last 78.98) - open/close 37070 (time 1763337521.30 total 474.34 last 80.40) - open/close 37776 (time 1763337531.31 total 484.34 last 70.56) - open/close 38429 (time 1763337541.32 total 494.36 last 65.22) - open/close 39202 (time 1763337551.33 total 504.36 last 77.25) - open/close 39941 (time 1763337561.33 total 514.37 last 73.87) - open/close 40777 (time 1763337571.33 total 524.37 last 83.56) - open/close 41646 (time 1763337581.35 total 534.38 last 86.79) - open/close 42496 (time 1763337591.35 total 544.39 last 84.95) - open/close 43341 (time 1763337601.37 total 554.40 last 84.40) - open/close 44186 (time 1763337611.37 total 564.40 last 84.48) - open/close 45021 (time 1763337621.38 total 574.41 last 83.43) - open/close 45846 (time 1763337631.38 total 584.42 last 82.47) - open/close 46669 (time 1763337641.39 total 594.42 last 82.25) - open/close 47490 (time 1763337651.40 total 604.44 last 81.97) - open/close 48187 (time 1763337661.40 total 614.44 last 69.69) - open/close 48917 (time 1763337671.41 total 624.45 last 72.94) - open/close 49689 (time 1763337681.41 total 634.45 last 77.19) - open/close 50000 (time 1763337685.58 total 638.61 last 74.69) - open/close 50795 (time 1763337695.59 total 648.62 last 79.43) - open/close 51537 (time 1763337705.59 total 658.63 last 74.13) - open/close 52286 (time 1763337715.61 total 668.65 last 74.77) - open/close 53054 (time 1763337725.61 total 678.65 last 76.79) - open/close 53832 (time 1763337735.62 total 688.66 last 77.74) - open/close 54589 (time 1763337745.64 total 698.67 last 75.56) - open/close 55305 (time 1763337755.65 total 708.68 last 71.54) - open/close 56022 (time 1763337765.65 total 718.68 last 71.69) - open/close 56779 (time 1763337775.66 total 728.69 last 75.65) - open/close 57560 (time 1763337785.66 total 738.70 last 78.05) - open/close 58338 (time 1763337795.67 total 748.71 last 77.71) - open/close 59097 (time 1763337805.68 total 758.72 last 75.82) - open/close 59859 (time 1763337815.69 total 768.72 last 76.16) - open/close 60627 (time 1763337825.69 total 778.73 last 76.79) - open/close 61479 (time 1763337835.70 total 788.73 last 85.13) - open/close 62243 (time 1763337845.70 total 798.74 last 76.38) - open/close 63033 (time 1763337855.71 total 808.75 last 78.91) - open/close 63792 (time 1763337865.72 total 818.75 last 75.87) - open/close 64528 (time 1763337875.72 total 828.76 last 73.54) total: 64768 open/close in 832.33 seconds: 77.81 ops/second - /unlink 781 (time 1763337893.16 total 10.00 last 78.07) - /unlink 1508 (time 1763337903.16 total 20.01 last 72.69) - /unlink 2270 (time 1763337913.18 total 30.02 last 76.08) - /unlink 2941 (time 1763337923.18 total 40.02 last 67.08) - /unlink 3603 (time 1763337933.24 total 50.09 last 65.78) - /unlink 4298 (time 1763337943.25 total 60.10 last 69.45) - /unlink 4999 (time 1763337953.25 total 70.10 last 70.09) - /unlink 5774 (time 1763337963.26 total 80.11 last 77.42) - /unlink 6514 (time 1763337973.26 total 90.11 last 73.99) - /unlink 7292 (time 1763337983.27 total 100.11 last 77.77) - /unlink 8030 (time 1763337993.27 total 110.12 last 73.76) - /unlink 8746 (time 1763338003.28 total 120.12 last 71.55) - /unlink 9537 (time 1763338013.29 total 130.14 last 79.02) - /unlink 10000 (time 1763338020.02 total 136.87 last 68.78) - /unlink 10728 (time 1763338030.03 total 146.87 last 72.75) - /unlink 11482 (time 1763338040.04 total 156.88 last 75.32) - /unlink 12219 (time 1763338050.05 total 166.89 last 73.62) - /unlink 12950 (time 1763338060.06 total 176.91 last 72.99) - /unlink 13626 (time 1763338070.07 total 186.91 last 67.59) - /unlink 14294 (time 1763338080.08 total 196.92 last 66.71) - /unlink 15028 (time 1763338090.09 total 206.93 last 73.33) - /unlink 15718 (time 1763338100.10 total 216.95 last 68.92) - /unlink 16371 (time 1763338110.11 total 226.95 last 65.25) - /unlink 17032 (time 1763338120.11 total 236.95 last 66.09) - /unlink 17696 (time 1763338130.12 total 246.96 last 66.35) - /unlink 18362 (time 1763338140.12 total 256.96 last 66.59) - /unlink 19015 (time 1763338150.13 total 266.97 last 65.24) - /unlink 19673 (time 1763338160.13 total 276.98 last 65.77) - /unlink 20000 (time 1763338164.43 total 281.28 last 76.08) - /unlink 20760 (time 1763338174.43 total 291.28 last 75.98) - /unlink 21446 (time 1763338184.44 total 301.29 last 68.56) - /unlink 22147 (time 1763338194.45 total 311.29 last 70.03) - /unlink 22840 (time 1763338204.45 total 321.30 last 69.30) - /unlink 23523 (time 1763338214.46 total 331.30 last 68.26) - /unlink 24235 (time 1763338224.47 total 341.32 last 71.10) - /unlink 24913 (time 1763338234.48 total 351.33 last 67.74) - /unlink 25606 (time 1763338244.50 total 361.34 last 69.16) - /unlink 26336 (time 1763338254.50 total 371.35 last 72.98) - /unlink 27006 (time 1763338264.51 total 381.36 last 66.95) - /unlink 27722 (time 1763338274.51 total 391.36 last 71.60) - /unlink 28387 (time 1763338284.52 total 401.37 last 66.44) - /unlink 29066 (time 1763338294.53 total 411.38 last 67.83) - /unlink 29794 (time 1763338304.53 total 421.38 last 72.79) - /unlink 30000 (time 1763338307.03 total 423.88 last 82.44) - /unlink 30736 (time 1763338317.04 total 433.88 last 73.58) - /unlink 31442 (time 1763338327.04 total 443.88 last 70.59) - /unlink 32106 (time 1763338337.04 total 453.88 last 66.39) - /unlink 32808 (time 1763338347.04 total 463.88 last 70.20) - /unlink 33533 (time 1763338357.05 total 473.89 last 72.44) - /unlink 34315 (time 1763338367.05 total 483.89 last 78.19) - /unlink 35032 (time 1763338377.06 total 493.91 last 71.61) - /unlink 35793 (time 1763338387.08 total 503.92 last 75.99) - /unlink 36523 (time 1763338397.09 total 513.94 last 72.89) - /unlink 37241 (time 1763338407.10 total 523.94 last 71.77) - /unlink 37974 (time 1763338417.10 total 533.95 last 73.26) - /unlink 38605 (time 1763338427.12 total 543.96 last 63.00) - /unlink 39296 (time 1763338437.12 total 553.96 last 69.10) - /unlink 40000 (time 1763338446.71 total 563.56 last 73.38) - /unlink 40658 (time 1763338456.72 total 573.57 last 65.72) - /unlink 41330 (time 1763338466.73 total 583.57 last 67.17) - /unlink 42002 (time 1763338476.73 total 593.58 last 67.16) - /unlink 42710 (time 1763338486.74 total 603.59 last 70.73) - /unlink 43402 (time 1763338496.75 total 613.59 last 69.16) - /unlink 44128 (time 1763338506.77 total 623.62 last 72.44) - /unlink 44764 (time 1763338516.79 total 633.64 last 63.47) - /unlink 45515 (time 1763338526.80 total 643.64 last 75.05) - /unlink 46292 (time 1763338536.81 total 653.65 last 77.64) - /unlink 46989 (time 1763338546.84 total 663.69 last 69.45) - /unlink 47729 (time 1763338556.85 total 673.69 last 73.95) - /unlink 48457 (time 1763338566.85 total 683.70 last 72.79) - /unlink 49223 (time 1763338576.86 total 693.70 last 76.54) - /unlink 49914 (time 1763338586.86 total 703.71 last 69.08) - /unlink 50624 (time 1763338596.90 total 713.75 last 70.73) - /unlink 51333 (time 1763338606.93 total 723.77 last 70.72) - /unlink 52013 (time 1763338616.94 total 733.79 last 67.90) - /unlink 52691 (time 1763338626.95 total 743.80 last 67.73) - /unlink 53395 (time 1763338636.96 total 753.80 last 70.37) - /unlink 54096 (time 1763338646.96 total 763.80 last 70.08) - /unlink 54763 (time 1763338656.96 total 773.81 last 66.66) - /unlink 55483 (time 1763338666.98 total 783.82 last 71.91) - /unlink 56159 (time 1763338676.98 total 793.83 last 67.54) - /unlink 56892 (time 1763338687.00 total 803.84 last 73.21) - /unlink 57735 (time 1763338697.00 total 813.84 last 84.29) - /unlink 58450 (time 1763338707.01 total 823.85 last 71.44) - /unlink 59226 (time 1763338717.01 total 833.86 last 77.54) - /unlink 59995 (time 1763338727.03 total 843.87 last 76.81) - /unlink 60723 (time 1763338737.05 total 853.89 last 72.63) - /unlink 61467 (time 1763338747.05 total 863.90 last 74.36) - /unlink 62193 (time 1763338757.06 total 873.91 last 72.54) - /unlink 62949 (time 1763338767.08 total 883.92 last 75.50) - /unlink 63733 (time 1763338777.09 total 893.94 last 78.27) - /unlink 64571 (time 1763338787.10 total 903.94 last 83.74) total: 64768 /unlink in 906.84 seconds: 71.42 ops/second Waiting for MDT destroys to complete oleg333-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 - open/close 706 (time 1763338816.09 total 10.00 last 70.57) - open/close 1487 (time 1763338826.10 total 20.01 last 78.01) - open/close 2289 (time 1763338836.11 total 30.02 last 80.13) - open/close 3084 (time 1763338846.13 total 40.05 last 79.32) - open/close 3864 (time 1763338856.13 total 50.05 last 77.98) - open/close 4604 (time 1763338866.13 total 60.05 last 73.98) - open/close 5397 (time 1763338876.14 total 70.06 last 79.26) - open/close 6194 (time 1763338886.15 total 80.07 last 79.63) - open/close 7004 (time 1763338896.16 total 90.08 last 80.90) - open/close 7836 (time 1763338906.17 total 100.09 last 83.12) - open/close 8569 (time 1763338916.17 total 110.09 last 73.29) - open/close 9377 (time 1763338926.18 total 120.09 last 80.75) - open/close 10000 (time 1763338933.57 total 127.48 last 84.33) - open/close 10812 (time 1763338943.57 total 137.49 last 81.13) - open/close 11624 (time 1763338953.58 total 147.49 last 81.18) - open/close 12453 (time 1763338963.58 total 157.50 last 82.84) - open/close 13303 (time 1763338973.59 total 167.50 last 84.98) - open/close 14153 (time 1763338983.59 total 177.51 last 84.97) - open/close 14966 (time 1763338993.59 total 187.51 last 81.27) - open/close 15815 (time 1763339003.60 total 197.51 last 84.86) - open/close 16624 (time 1763339013.61 total 207.53 last 80.79) - open/close 17410 (time 1763339023.61 total 217.53 last 78.59) - open/close 18170 (time 1763339033.62 total 227.54 last 75.94) - open/close 18912 (time 1763339043.63 total 237.54 last 74.15) - open/close 19744 (time 1763339053.64 total 247.56 last 83.11) - open/close 20000 (time 1763339057.12 total 251.04 last 73.57) - open/close 20729 (time 1763339067.13 total 261.04 last 72.85) - open/close 21425 (time 1763339077.13 total 271.05 last 69.56) - open/close 22217 (time 1763339087.14 total 281.05 last 79.18) - open/close 22979 (time 1763339097.14 total 291.06 last 76.17) - open/close 23802 (time 1763339107.14 total 301.06 last 82.27) - open/close 24624 (time 1763339117.14 total 311.06 last 82.19) - open/close 25443 (time 1763339127.15 total 321.07 last 81.82) - open/close 26263 (time 1763339137.15 total 331.07 last 82.00) - open/close 27081 (time 1763339147.16 total 341.08 last 81.74) - open/close 27912 (time 1763339157.17 total 351.08 last 83.03) - open/close 28676 (time 1763339167.19 total 361.10 last 76.25) - open/close 29420 (time 1763339177.19 total 371.11 last 74.38) - open/close 30000 (time 1763339184.78 total 378.69 last 76.46) - open/close 30759 (time 1763339194.79 total 388.71 last 75.77) - open/close 31459 (time 1763339204.80 total 398.72 last 69.95) - open/close 32312 (time 1763339214.80 total 408.72 last 85.30) - open/close 33022 (time 1763339224.81 total 418.73 last 70.94) - open/close 33780 (time 1763339234.82 total 428.73 last 75.73) - open/close 34554 (time 1763339244.82 total 438.74 last 77.39) - open/close 35363 (time 1763339254.83 total 448.74 last 80.83) - open/close 36196 (time 1763339264.83 total 458.75 last 83.29) - open/close 36848 (time 1763339274.85 total 468.76 last 65.08) - open/close 37563 (time 1763339284.85 total 478.77 last 71.48) - open/close 38301 (time 1763339294.85 total 488.77 last 73.77) - open/close 39045 (time 1763339304.86 total 498.77 last 74.38) - open/close 39866 (time 1763339314.86 total 508.78 last 82.06) - open/close 40698 (time 1763339324.87 total 518.79 last 83.13) - open/close 41442 (time 1763339334.88 total 528.79 last 74.36) - open/close 42124 (time 1763339344.88 total 538.79 last 68.20) - open/close 42874 (time 1763339354.88 total 548.80 last 74.98) - open/close 43699 (time 1763339364.88 total 558.80 last 82.46) - open/close 44523 (time 1763339374.89 total 568.80 last 82.39) - open/close 45359 (time 1763339384.90 total 578.82 last 83.48) - open/close 46180 (time 1763339394.91 total 588.83 last 81.99) - open/close 47012 (time 1763339404.92 total 598.83 last 83.19) - open/close 47855 (time 1763339414.92 total 608.84 last 84.26) - open/close 48690 (time 1763339424.93 total 618.85 last 83.41) - open/close 49474 (time 1763339434.94 total 628.86 last 78.33) - open/close 50000 (time 1763339441.11 total 635.03 last 85.18) - open/close 50807 (time 1763339451.12 total 645.03 last 80.69) - open/close 51568 (time 1763339461.12 total 655.04 last 76.07) - open/close 52334 (time 1763339471.13 total 665.04 last 76.56) - open/close 53135 (time 1763339481.13 total 675.04 last 80.10) - open/close 53984 (time 1763339491.13 total 685.05 last 84.86) - open/close 54826 (time 1763339501.14 total 695.05 last 84.16) - open/close 55619 (time 1763339511.14 total 705.06 last 79.25) - open/close 56390 (time 1763339521.14 total 715.06 last 77.09) - open/close 57254 (time 1763339531.15 total 725.07 last 86.35) - open/close 58071 (time 1763339541.16 total 735.07 last 81.64) - open/close 58888 (time 1763339551.16 total 745.07 last 81.69) - open/close 59652 (time 1763339561.16 total 755.08 last 76.39) - open/close 60000 (time 1763339565.84 total 759.76 last 74.31) - open/close 60772 (time 1763339575.84 total 769.76 last 77.19) - open/close 61548 (time 1763339585.85 total 779.76 last 77.59) - open/close 62336 (time 1763339595.85 total 789.77 last 78.76) - open/close 63135 (time 1763339605.86 total 799.77 last 79.84) - open/close 63966 (time 1763339615.87 total 809.79 last 82.99) - open/close 64584 (time 1763339625.88 total 819.80 last 61.72) total: 64768 open/close in 822.72 seconds: 78.72 ops/second - /unlink 753 (time 1763339642.89 total 10.01 last 75.24) - /unlink 1496 (time 1763339652.90 total 20.02 last 74.24) - /unlink 2284 (time 1763339662.90 total 30.02 last 78.76) - /unlink 3096 (time 1763339672.91 total 40.03 last 81.16) - /unlink 3905 (time 1763339682.91 total 50.03 last 80.89) - /unlink 4696 (time 1763339692.91 total 60.03 last 79.09) - /unlink 5537 (time 1763339702.92 total 70.04 last 84.03) - /unlink 6375 (time 1763339712.93 total 80.05 last 83.69) - /unlink 7159 (time 1763339722.93 total 90.05 last 78.39) - /unlink 7925 (time 1763339732.93 total 100.05 last 76.60) - /unlink 8761 (time 1763339742.94 total 110.06 last 83.53) - /unlink 9560 (time 1763339752.94 total 120.06 last 79.90) - /unlink 10000 (time 1763339758.08 total 125.20 last 85.64) - /unlink 10782 (time 1763339768.09 total 135.21 last 78.12) - /unlink 11597 (time 1763339778.09 total 145.21 last 81.49) - /unlink 12349 (time 1763339788.11 total 155.23 last 75.08) - /unlink 13120 (time 1763339798.11 total 165.23 last 77.08) - /unlink 13917 (time 1763339808.11 total 175.23 last 79.69) - /unlink 14683 (time 1763339818.12 total 185.24 last 76.53) - /unlink 15496 (time 1763339828.13 total 195.25 last 81.24) - /unlink 16370 (time 1763339838.13 total 205.25 last 87.37) - /unlink 17193 (time 1763339848.14 total 215.26 last 82.25) - /unlink 17985 (time 1763339858.15 total 225.27 last 79.12) - /unlink 18783 (time 1763339868.16 total 235.27 last 79.73) - /unlink 19522 (time 1763339878.16 total 245.28 last 73.83) - /unlink 20000 (time 1763339885.00 total 252.12 last 69.94) - /unlink 20687 (time 1763339895.01 total 262.13 last 68.62) - /unlink 21510 (time 1763339905.01 total 272.13 last 82.29) - /unlink 22342 (time 1763339915.01 total 282.13 last 83.17) - /unlink 23125 (time 1763339925.02 total 292.13 last 78.29) - /unlink 23892 (time 1763339935.03 total 302.15 last 76.58) - /unlink 24721 (time 1763339945.03 total 312.15 last 82.90) - /unlink 25505 (time 1763339955.04 total 322.16 last 78.35) - /unlink 26289 (time 1763339965.04 total 332.16 last 78.39) - /unlink 27079 (time 1763339975.05 total 342.17 last 78.91) - /unlink 27864 (time 1763339985.05 total 352.17 last 78.49) - /unlink 28598 (time 1763339995.06 total 362.18 last 73.30) - /unlink 29377 (time 1763340005.07 total 372.18 last 77.88) - /unlink 30000 (time 1763340012.61 total 379.73 last 82.60) - /unlink 30826 (time 1763340022.62 total 389.73 last 82.54) - /unlink 31660 (time 1763340032.62 total 399.74 last 83.36) - /unlink 32413 (time 1763340042.63 total 409.75 last 75.24) - /unlink 33211 (time 1763340052.63 total 419.75 last 79.79) - /unlink 33976 (time 1763340062.64 total 429.76 last 76.43) - /unlink 34719 (time 1763340072.65 total 439.77 last 74.23) - /unlink 35502 (time 1763340082.66 total 449.77 last 78.24) - /unlink 36207 (time 1763340092.66 total 459.78 last 70.46) - /unlink 36980 (time 1763340102.66 total 469.78 last 77.29) - /unlink 37777 (time 1763340112.67 total 479.79 last 79.65) - /unlink 38522 (time 1763340122.68 total 489.80 last 74.42) - /unlink 39285 (time 1763340132.69 total 499.81 last 76.24) - /unlink 39966 (time 1763340142.69 total 509.81 last 68.05) - /unlink 40717 (time 1763340152.70 total 519.82 last 75.08) - /unlink 41455 (time 1763340162.70 total 529.82 last 73.78) - /unlink 42258 (time 1763340172.70 total 539.82 last 80.26) - /unlink 43013 (time 1763340182.72 total 549.84 last 75.40) - /unlink 43791 (time 1763340192.73 total 559.85 last 77.72) - /unlink 44615 (time 1763340202.73 total 569.85 last 82.39) - /unlink 45425 (time 1763340212.75 total 579.87 last 80.83) - /unlink 46179 (time 1763340222.76 total 589.88 last 75.31) - /unlink 46877 (time 1763340232.78 total 599.90 last 69.69) - /unlink 47566 (time 1763340242.79 total 609.91 last 68.80) - /unlink 48181 (time 1763340252.79 total 619.91 last 61.49) - /unlink 48877 (time 1763340262.80 total 629.91 last 69.59) - /unlink 49599 (time 1763340272.80 total 639.92 last 72.18) - /unlink 50000 (time 1763340277.95 total 645.07 last 77.85) - /unlink 50799 (time 1763340287.96 total 655.08 last 79.79) - /unlink 51618 (time 1763340297.96 total 665.08 last 81.90) - /unlink 52383 (time 1763340307.97 total 675.09 last 76.46) - /unlink 53173 (time 1763340317.97 total 685.09 last 78.99) - /unlink 53919 (time 1763340327.97 total 695.09 last 74.59) - /unlink 54715 (time 1763340337.97 total 705.09 last 79.60) - /unlink 55480 (time 1763340347.97 total 715.09 last 76.48) - /unlink 56251 (time 1763340357.98 total 725.10 last 77.05) - /unlink 57032 (time 1763340367.99 total 735.11 last 78.01) - /unlink 57836 (time 1763340377.99 total 745.11 last 80.38) - /unlink 58631 (time 1763340388.00 total 755.12 last 79.47) - /unlink 59458 (time 1763340398.01 total 765.12 last 82.65) - /unlink 60000 (time 1763340404.86 total 771.98 last 79.07) - /unlink 60807 (time 1763340414.87 total 781.99 last 80.61) - /unlink 61576 (time 1763340424.89 total 792.01 last 76.73) - /unlink 62385 (time 1763340434.91 total 802.02 last 80.80) - /unlink 63131 (time 1763340444.91 total 812.03 last 74.57) - /unlink 63946 (time 1763340454.92 total 822.03 last 81.46) - /unlink 64695 (time 1763340464.92 total 832.04 last 74.89) total: 64768 /unlink in 832.87 seconds: 77.77 ops/second Waiting for MDT destroys to complete oleg333-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 - open/close 726 (time 1763340489.83 total 10.00 last 72.57) - open/close 1444 (time 1763340499.83 total 20.01 last 71.77) - open/close 2164 (time 1763340509.84 total 30.02 last 71.92) - open/close 3028 (time 1763340519.85 total 40.02 last 86.38) - open/close 3782 (time 1763340529.85 total 50.03 last 75.34) - open/close 4575 (time 1763340539.86 total 60.03 last 79.28) - open/close 5358 (time 1763340549.86 total 70.04 last 78.26) - open/close 6193 (time 1763340559.87 total 80.04 last 83.47) - open/close 6964 (time 1763340569.88 total 90.05 last 77.03) - open/close 7807 (time 1763340579.88 total 100.06 last 84.22) - open/close 8726 (time 1763340589.89 total 110.06 last 91.87) - open/close 9516 (time 1763340599.89 total 120.07 last 78.98) - open/close 10000 (time 1763340605.43 total 125.60 last 87.39) - open/close 10839 (time 1763340615.44 total 135.61 last 83.82) - open/close 11717 (time 1763340625.44 total 145.62 last 87.76) - open/close 12550 (time 1763340635.45 total 155.62 last 83.28) - open/close 13409 (time 1763340645.45 total 165.63 last 85.83) - open/close 14209 (time 1763340655.46 total 175.64 last 79.92) - open/close 14968 (time 1763340665.47 total 185.65 last 75.85) - open/close 15736 (time 1763340675.49 total 195.66 last 76.69) - open/close 16534 (time 1763340685.50 total 205.68 last 79.67) - open/close 17361 (time 1763340695.51 total 215.68 last 82.64) - open/close 18265 (time 1763340705.51 total 225.69 last 90.35) - open/close 19077 (time 1763340715.53 total 235.70 last 81.11) - open/close 19947 (time 1763340725.55 total 245.73 last 86.76) - open/close 20803 (time 1763340735.58 total 255.76 last 85.35) - open/close 21671 (time 1763340745.62 total 265.80 last 86.45) - open/close 22465 (time 1763340755.64 total 275.82 last 79.24) - open/close 23266 (time 1763340765.67 total 285.84 last 79.89) - open/close 24042 (time 1763340775.68 total 295.85 last 77.52) - open/close 24824 (time 1763340785.68 total 305.85 last 78.19) - open/close 25570 (time 1763340795.68 total 315.86 last 74.58) - open/close 26412 (time 1763340805.69 total 325.86 last 84.17) - open/close 27233 (time 1763340815.69 total 335.87 last 82.04) - open/close 28110 (time 1763340825.70 total 345.87 last 87.64) - open/close 28944 (time 1763340835.70 total 355.88 last 83.39) - open/close 29787 (time 1763340845.72 total 365.90 last 84.14) - open/close 30000 (time 1763340848.25 total 368.42 last 84.29) - open/close 30812 (time 1763340858.26 total 378.43 last 81.11) - open/close 31583 (time 1763340868.26 total 388.44 last 77.06) - open/close 32295 (time 1763340878.27 total 398.44 last 71.18) - open/close 33141 (time 1763340888.27 total 408.44 last 84.60) - open/close 34014 (time 1763340898.27 total 418.44 last 87.28) - open/close 34925 (time 1763340908.27 total 428.45 last 91.06) - open/close 35801 (time 1763340918.28 total 438.46 last 87.52) - open/close 36615 (time 1763340928.29 total 448.47 last 81.33) - open/close 37457 (time 1763340938.30 total 458.47 last 84.13) - open/close 38322 (time 1763340948.30 total 468.48 last 86.46) - open/close 39122 (time 1763340958.31 total 478.49 last 79.94) - open/close 39909 (time 1763340968.32 total 488.50 last 78.62) - open/close 40684 (time 1763340978.35 total 498.53 last 77.25) - open/close 41425 (time 1763340988.36 total 508.53 last 74.05) - open/close 42204 (time 1763340998.37 total 518.54 last 77.84) - open/close 43092 (time 1763341008.37 total 528.54 last 88.79) - open/close 43869 (time 1763341018.37 total 538.54 last 77.70) - open/close 44590 (time 1763341028.38 total 548.55 last 72.03) - open/close 45377 (time 1763341038.39 total 558.56 last 78.61) - open/close 46218 (time 1763341048.39 total 568.57 last 84.05) - open/close 47032 (time 1763341058.40 total 578.58 last 81.33) - open/close 47866 (time 1763341068.41 total 588.58 last 83.38) - open/close 48773 (time 1763341078.42 total 598.60 last 90.54) - open/close 49587 (time 1763341088.43 total 608.61 last 81.32) - open/close 50000 (time 1763341093.41 total 613.58 last 83.00) - open/close 50871 (time 1763341103.41 total 623.59 last 87.05) - open/close 51742 (time 1763341113.44 total 633.61 last 86.91) - open/close 52567 (time 1763341123.44 total 643.62 last 82.46) - open/close 53390 (time 1763341133.45 total 653.62 last 82.25) - open/close 54220 (time 1763341143.45 total 663.63 last 82.97) - open/close 55030 (time 1763341153.45 total 673.63 last 80.98) - open/close 55839 (time 1763341163.46 total 683.64 last 80.83) - open/close 56663 (time 1763341173.47 total 693.64 last 82.34) - open/close 57475 (time 1763341183.47 total 703.65 last 81.19) - open/close 58309 (time 1763341193.47 total 713.65 last 83.38) - open/close 59166 (time 1763341203.48 total 723.66 last 85.62) - open/close 59983 (time 1763341213.49 total 733.66 last 81.64) - open/close 60841 (time 1763341223.50 total 743.67 last 85.74) - open/close 61673 (time 1763341233.50 total 753.67 last 83.19) - open/close 62520 (time 1763341243.50 total 763.67 last 84.68) - open/close 63306 (time 1763341253.51 total 773.68 last 78.54) - open/close 64097 (time 1763341263.51 total 783.68 last 79.09) total: 64768 open/close in 791.96 seconds: 81.78 ops/second - /unlink 759 (time 1763341285.04 total 10.01 last 75.86) - /unlink 1554 (time 1763341295.05 total 20.01 last 79.46) - /unlink 2414 (time 1763341305.05 total 30.01 last 85.99) - /unlink 3207 (time 1763341315.05 total 40.02 last 79.25) - /unlink 4022 (time 1763341325.06 total 50.03 last 81.41) - /unlink 4808 (time 1763341335.07 total 60.03 last 78.55) - /unlink 5598 (time 1763341345.08 total 70.05 last 78.91) - /unlink 6413 (time 1763341355.09 total 80.06 last 81.41) - /unlink 7193 (time 1763341365.10 total 90.06 last 77.95) - /unlink 7999 (time 1763341375.11 total 100.07 last 80.55) - /unlink 8802 (time 1763341385.11 total 110.07 last 80.29) - /unlink 9609 (time 1763341395.12 total 120.08 last 80.60) - /unlink 10000 (time 1763341400.38 total 125.34 last 74.37) - /unlink 10656 (time 1763341410.38 total 135.34 last 65.57) - /unlink 11377 (time 1763341420.38 total 145.35 last 72.09) - /unlink 12110 (time 1763341430.38 total 155.35 last 73.29) - /unlink 12874 (time 1763341440.39 total 165.35 last 76.35) - /unlink 13756 (time 1763341450.40 total 175.36 last 88.12) - /unlink 14580 (time 1763341460.41 total 185.37 last 82.35) - /unlink 15376 (time 1763341470.41 total 195.38 last 79.53) - /unlink 16127 (time 1763341480.42 total 205.38 last 75.06) - /unlink 16982 (time 1763341490.43 total 215.39 last 85.45) - /unlink 17812 (time 1763341500.43 total 225.39 last 83.00) - /unlink 18681 (time 1763341510.44 total 235.40 last 86.82) - /unlink 19558 (time 1763341520.44 total 245.40 last 87.67) - /unlink 20000 (time 1763341525.84 total 250.81 last 81.82) - /unlink 20836 (time 1763341535.86 total 260.82 last 83.49) - /unlink 21670 (time 1763341545.86 total 270.83 last 83.34) - /unlink 22326 (time 1763341555.88 total 280.84 last 65.50) - /unlink 23147 (time 1763341565.88 total 290.84 last 82.08) - /unlink 23989 (time 1763341575.88 total 300.85 last 84.18) - /unlink 24875 (time 1763341585.89 total 310.86 last 88.51) - /unlink 25773 (time 1763341595.91 total 320.88 last 89.62) - /unlink 26629 (time 1763341605.92 total 330.88 last 85.57) - /unlink 27485 (time 1763341615.93 total 340.89 last 85.52) - /unlink 28328 (time 1763341625.93 total 350.90 last 84.23) - /unlink 29248 (time 1763341635.95 total 360.91 last 91.89) - /unlink 30000 (time 1763341643.80 total 368.76 last 95.77) - /unlink 30917 (time 1763341653.80 total 378.77 last 91.64) - /unlink 31869 (time 1763341663.81 total 388.77 last 95.19) - /unlink 32780 (time 1763341673.81 total 398.77 last 91.07) - /unlink 33623 (time 1763341683.82 total 408.78 last 84.23) - /unlink 34547 (time 1763341693.82 total 418.78 last 92.37) - /unlink 35492 (time 1763341703.83 total 428.79 last 94.45) - /unlink 36404 (time 1763341713.83 total 438.79 last 91.16) - /unlink 37207 (time 1763341723.83 total 448.80 last 80.27) - /unlink 38045 (time 1763341733.84 total 458.80 last 83.78) - /unlink 39004 (time 1763341743.84 total 468.80 last 95.86) - /unlink 39946 (time 1763341753.84 total 478.80 last 94.19) - /unlink 40804 (time 1763341763.84 total 488.81 last 85.79) - /unlink 41729 (time 1763341773.85 total 498.81 last 92.42) - /unlink 42602 (time 1763341783.86 total 508.82 last 87.24) - /unlink 43477 (time 1763341793.87 total 518.83 last 87.43) - /unlink 44444 (time 1763341803.87 total 528.83 last 96.64) - /unlink 45313 (time 1763341813.88 total 538.84 last 86.86) - /unlink 46246 (time 1763341823.88 total 548.84 last 93.27) - /unlink 47140 (time 1763341833.89 total 558.85 last 89.33) - /unlink 48050 (time 1763341843.89 total 568.86 last 90.94) - /unlink 48954 (time 1763341853.91 total 578.87 last 90.30) - /unlink 49720 (time 1763341863.92 total 588.88 last 76.51) - /unlink 50000 (time 1763341866.82 total 591.79 last 96.32) - /unlink 50725 (time 1763341876.83 total 601.79 last 72.47) - /unlink 51467 (time 1763341886.84 total 611.80 last 74.14) - /unlink 52314 (time 1763341896.84 total 621.80 last 84.70) - /unlink 53217 (time 1763341906.84 total 631.81 last 90.24) - /unlink 54132 (time 1763341916.85 total 641.81 last 91.43) - /unlink 54970 (time 1763341926.87 total 651.83 last 83.68) - /unlink 55866 (time 1763341936.88 total 661.84 last 89.48) - /unlink 56800 (time 1763341946.88 total 671.85 last 93.37) - /unlink 57655 (time 1763341956.88 total 681.85 last 85.49) - /unlink 58484 (time 1763341966.89 total 691.85 last 82.84) - /unlink 59316 (time 1763341976.90 total 701.86 last 83.14) - /unlink 60000 (time 1763341984.34 total 709.30 last 91.94) - /unlink 61050 (time 1763341994.35 total 719.31 last 104.92) - /unlink 62020 (time 1763342004.35 total 729.31 last 96.99) - /unlink 63153 (time 1763342014.36 total 739.32 last 113.18) - /unlink 64155 (time 1763342024.36 total 749.32 last 100.18) total: 64768 /unlink in 755.31 seconds: 85.75 ops/second Waiting for MDT destroys to complete oleg333-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1