-----============= acceptance-small: conf-sanity ============----- Wed Dec 3 14:44:33 EST 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg353-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball Stopping clients: oleg353-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg353-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg353-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg353-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg353-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg353-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg353-server oleg353-server: oleg353-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg353-server' oleg353-server: oleg353-server.virtnet: executing load_modules_local oleg353-server: Loading modules from /home/green/git/lustre-release/lustre oleg353-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg353-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg353-server: detected 4 online CPUs by sysfs oleg353-server: MODOPTS_LIBCFS= oleg353-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg353-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg353-server: oleg353-server.virtnet: executing set_default_debug -1 all pdsh@oleg353-client: oleg353-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg353-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg353-server: oleg353-server.virtnet: executing set_default_debug -1 all pdsh@oleg353-client: oleg353-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg353-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg353-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg353-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg353-server: oleg353-server.virtnet: executing set_default_debug -1 all pdsh@oleg353-client: oleg353-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg353-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg353-server: oleg353-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg353-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg353-server: oleg353-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg353-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg353-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg353-server stop mds service on oleg353-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg353-server stop mds service on oleg353-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg353-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 14:47:16 (1764791236) Stopping clients: oleg353-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg353-client.virtnet /mnt/lustre2 (opts:-f) oleg353-server: oleg353-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg353-server' oleg353-server: oleg353-server.virtnet: executing load_modules_local oleg353-server: Loading modules from /home/green/git/lustre-release/lustre oleg353-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg353-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg353-server: detected 4 online CPUs by sysfs oleg353-server: MODOPTS_LIBCFS= oleg353-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg353-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg353-server: oleg353-server.virtnet: executing set_default_debug -1 all pdsh@oleg353-client: oleg353-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg353-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg353-server: oleg353-server.virtnet: executing set_default_debug -1 all pdsh@oleg353-client: oleg353-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg353-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg353-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg353-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg353-server: oleg353-server.virtnet: executing set_default_debug -1 all pdsh@oleg353-client: oleg353-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg353-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg353-client.virtnet: -o user_xattr,flock 192.168.203.153@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 65808 368 65440 1% /mnt/lustre[OST:0] filesystem_summary: 65969 529 65440 1% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 1171 (time 1764791320.28 total 10.01 last 116.93) - open/close 1952 (time 1764791330.28 total 20.02 last 78.05) - open/close 2482 (time 1764791340.33 total 30.06 last 52.78) - open/close 2975 (time 1764791350.33 total 40.07 last 49.28) - open/close 3453 (time 1764791360.35 total 50.08 last 47.73) - open/close 4213 (time 1764791370.35 total 60.09 last 75.98) - open/close 5045 (time 1764791380.36 total 70.10 last 83.12) - open/close 5942 (time 1764791390.36 total 80.10 last 89.65) - open/close 6852 (time 1764791400.37 total 90.11 last 90.96) - open/close 7883 (time 1764791410.37 total 100.11 last 103.05) - open/close 9074 (time 1764791420.38 total 110.12 last 119.01) - open/close 10000 (time 1764791426.19 total 115.93 last 159.32) - open/close 11119 (time 1764791436.20 total 125.93 last 111.87) - open/close 12184 (time 1764791446.20 total 135.94 last 106.46) - open/close 13635 (time 1764791456.21 total 145.94 last 145.02) - open/close 15120 (time 1764791466.21 total 155.95 last 148.45) - open/close 16698 (time 1764791476.21 total 165.95 last 157.79) - open/close 19346 (time 1764791486.21 total 175.95 last 264.78) - open/close 20000 (time 1764791489.50 total 179.24 last 198.85) - open/close 21641 (time 1764791499.50 total 189.24 last 164.09) - open/close 23067 (time 1764791509.50 total 199.24 last 142.53) - open/close 24783 (time 1764791519.51 total 209.24 last 171.57) - open/close 26992 (time 1764791529.51 total 219.25 last 220.77) - open/close 29589 (time 1764791539.51 total 229.25 last 259.67) - open/close 32922 (time 1764791549.51 total 239.25 last 333.26) - open/close 36748 (time 1764791559.52 total 249.25 last 382.55) - open/close 40000 (time 1764791567.25 total 256.99 last 420.55) - open/close 42085 (time 1764791577.26 total 267.00 last 208.29) - open/close 43114 (time 1764791587.26 total 277.00 last 102.84) - open/close 44155 (time 1764791597.27 total 287.00 last 104.09) - open/close 45023 (time 1764791607.28 total 297.01 last 86.72) - open/close 46045 (time 1764791617.28 total 307.01 last 102.18) - open/close 47025 (time 1764791627.28 total 317.02 last 97.99) - open/close 47791 (time 1764791637.29 total 327.03 last 76.51) - open/close 48780 (time 1764791647.29 total 337.03 last 98.88) - open/close 49847 (time 1764791657.30 total 347.03 last 106.65) - open/close 51099 (time 1764791667.30 total 357.04 last 125.19) - open/close 52259 (time 1764791677.31 total 367.05 last 115.85) - open/close 52955 (time 1764791687.33 total 377.06 last 69.50) - open/close 53649 (time 1764791697.33 total 387.06 last 69.40) - open/close 54381 (time 1764791707.34 total 397.08 last 73.09) - open/close 55067 (time 1764791717.35 total 407.09 last 68.55) - open/close 55758 (time 1764791727.35 total 417.09 last 69.07) - open/close 56632 (time 1764791737.36 total 427.10 last 87.31) - open/close 57456 (time 1764791747.37 total 437.10 last 82.38) - open/close 58216 (time 1764791757.37 total 447.11 last 75.97) - open/close 58784 (time 1764791767.38 total 457.12 last 56.72) - open/close 59311 (time 1764791777.41 total 467.14 last 52.59) - open/close 59807 (time 1764791787.41 total 477.15 last 49.57) - open/close 60000 (time 1764791789.87 total 479.61 last 78.49) - open/close 60718 (time 1764791799.88 total 489.61 last 71.76) - open/close 61346 (time 1764791809.88 total 499.62 last 62.76) - open/close 62120 (time 1764791819.89 total 509.63 last 77.33) - open/close 62885 (time 1764791829.89 total 519.63 last 76.50) - open/close 63483 (time 1764791839.89 total 529.63 last 59.78) - open/close 64158 (time 1764791849.90 total 539.64 last 67.46) total: 64768 open/close in 548.30 seconds: 118.13 ops/second - /unlink 1354 (time 1764791873.01 total 10.01 last 135.31) - /unlink 2661 (time 1764791883.02 total 20.01 last 130.65) - /unlink 3941 (time 1764791893.02 total 30.02 last 127.93) - /unlink 5335 (time 1764791903.04 total 40.03 last 139.22) - /unlink 6726 (time 1764791913.04 total 50.03 last 139.05) - /unlink 7956 (time 1764791923.04 total 60.04 last 122.94) - /unlink 9289 (time 1764791933.05 total 70.04 last 133.24) - /unlink 10000 (time 1764791938.60 total 75.59 last 128.09) - /unlink 11327 (time 1764791948.60 total 85.59 last 132.69) - /unlink 12705 (time 1764791958.60 total 95.60 last 137.76) - /unlink 14161 (time 1764791968.60 total 105.60 last 145.58) - /unlink 15527 (time 1764791978.61 total 115.60 last 136.53) - /unlink 16666 (time 1764791988.61 total 125.60 last 113.90) - /unlink 17911 (time 1764791998.61 total 135.60 last 124.48) - /unlink 18895 (time 1764792008.62 total 145.61 last 98.37) - /unlink 19784 (time 1764792018.62 total 155.61 last 88.88) - /unlink 20000 (time 1764792021.23 total 158.22 last 82.70) - /unlink 20837 (time 1764792031.23 total 168.22 last 83.68) - /unlink 21713 (time 1764792041.24 total 178.24 last 87.50) - /unlink 22501 (time 1764792051.25 total 188.24 last 78.78) - /unlink 23715 (time 1764792061.25 total 198.25 last 121.31) - /unlink 24800 (time 1764792071.26 total 208.26 last 108.39) - /unlink 25998 (time 1764792081.28 total 218.27 last 119.62) - /unlink 27207 (time 1764792091.28 total 228.28 last 120.83) - /unlink 28373 (time 1764792101.29 total 238.28 last 116.57) - /unlink 29876 (time 1764792111.29 total 248.28 last 150.21) - /unlink 31301 (time 1764792121.29 total 258.29 last 142.47) - /unlink 32460 (time 1764792131.29 total 268.29 last 115.89) - /unlink 33632 (time 1764792141.30 total 278.29 last 117.16) - /unlink 35001 (time 1764792151.30 total 288.29 last 136.89) - /unlink 36180 (time 1764792161.31 total 298.30 last 117.79) - /unlink 36888 (time 1764792171.31 total 308.31 last 70.77) - /unlink 37696 (time 1764792181.32 total 318.31 last 80.75) - /unlink 38461 (time 1764792191.33 total 328.32 last 76.41) - /unlink 39206 (time 1764792201.34 total 338.34 last 74.40) - /unlink 39987 (time 1764792211.35 total 348.35 last 78.01) - /unlink 40775 (time 1764792221.36 total 358.35 last 78.79) - /unlink 41597 (time 1764792231.36 total 368.35 last 82.17) - /unlink 42363 (time 1764792241.37 total 378.36 last 76.54) - /unlink 43169 (time 1764792251.37 total 388.36 last 80.59) - /unlink 43915 (time 1764792261.38 total 398.37 last 74.54) - /unlink 44705 (time 1764792271.38 total 408.37 last 78.98) - /unlink 45474 (time 1764792281.38 total 418.38 last 76.87) - /unlink 46254 (time 1764792291.39 total 428.38 last 77.97) - /unlink 47022 (time 1764792301.39 total 438.38 last 76.79) - /unlink 47762 (time 1764792311.39 total 448.38 last 74.00) - /unlink 48361 (time 1764792321.42 total 458.41 last 59.74) - /unlink 48845 (time 1764792331.42 total 468.41 last 48.37) - /unlink 49417 (time 1764792341.44 total 478.43 last 57.10) - /unlink 49992 (time 1764792351.44 total 488.44 last 57.47) - /unlink 50692 (time 1764792361.45 total 498.44 last 69.96) - /unlink 51304 (time 1764792371.46 total 508.45 last 61.15) - /unlink 51800 (time 1764792381.48 total 518.47 last 49.51) - /unlink 52250 (time 1764792391.49 total 528.48 last 44.93) - /unlink 52786 (time 1764792401.50 total 538.49 last 53.57) - /unlink 53394 (time 1764792411.50 total 548.49 last 60.79) - /unlink 54134 (time 1764792421.51 total 558.50 last 73.93) - /unlink 54916 (time 1764792431.52 total 568.51 last 78.11) - /unlink 55664 (time 1764792441.53 total 578.52 last 74.75) - /unlink 56388 (time 1764792451.53 total 588.52 last 72.38) - /unlink 57070 (time 1764792461.54 total 598.53 last 68.12) - /unlink 57815 (time 1764792471.54 total 608.54 last 74.48) - /unlink 58545 (time 1764792481.55 total 618.54 last 72.99) - /unlink 59356 (time 1764792491.55 total 628.54 last 81.07) - /unlink 60000 (time 1764792499.90 total 636.89 last 77.15) - /unlink 60755 (time 1764792509.91 total 646.90 last 75.38) - /unlink 61490 (time 1764792519.93 total 656.92 last 73.40) - /unlink 62299 (time 1764792529.93 total 666.93 last 80.83) - /unlink 63121 (time 1764792539.94 total 676.93 last 82.19) - /unlink 63912 (time 1764792549.94 total 686.93 last 79.05) - /unlink 64714 (time 1764792559.96 total 696.95 last 80.08) total: 64768 /unlink in 697.59 seconds: 92.84 ops/second Waiting for MDT destroys to complete oleg353-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg353-client: oleg353-server: ssh exited with exit code 1 - open/close 813 (time 1764792587.09 total 10.00 last 81.26) - open/close 1641 (time 1764792597.09 total 20.01 last 82.78) - open/close 2492 (time 1764792607.10 total 30.02 last 85.00) - open/close 3346 (time 1764792617.12 total 40.04 last 85.26) - open/close 4130 (time 1764792627.13 total 50.05 last 78.28) - open/close 4932 (time 1764792637.15 total 60.06 last 80.08) - open/close 5619 (time 1764792647.17 total 70.08 last 68.57) - open/close 6149 (time 1764792657.17 total 80.09 last 52.96) - open/close 6889 (time 1764792667.18 total 90.10 last 73.94) - open/close 7518 (time 1764792677.18 total 100.10 last 62.89) - open/close 8234 (time 1764792687.19 total 110.10 last 71.57) - open/close 8963 (time 1764792697.20 total 120.12 last 72.78) - open/close 9776 (time 1764792707.22 total 130.14 last 81.14) - open/close 10000 (time 1764792710.25 total 133.17 last 73.99) - open/close 10752 (time 1764792720.25 total 143.17 last 75.16) - open/close 11490 (time 1764792730.26 total 153.18 last 73.76) - open/close 12126 (time 1764792740.26 total 163.18 last 63.59) - open/close 12856 (time 1764792750.27 total 173.19 last 72.96) - open/close 13487 (time 1764792760.29 total 183.21 last 62.96) - open/close 14092 (time 1764792770.30 total 193.22 last 60.43) - open/close 14763 (time 1764792780.31 total 203.23 last 67.04) - open/close 15565 (time 1764792790.32 total 213.24 last 80.08) - open/close 16393 (time 1764792800.33 total 223.25 last 82.75) - open/close 17264 (time 1764792810.34 total 233.26 last 87.00) - open/close 18129 (time 1764792820.36 total 243.28 last 86.36) - open/close 18969 (time 1764792830.36 total 253.28 last 83.95) - open/close 19794 (time 1764792840.36 total 263.28 last 82.50) - open/close 20000 (time 1764792843.01 total 265.93 last 77.77) - open/close 20852 (time 1764792853.05 total 275.96 last 84.93) - open/close 21655 (time 1764792863.08 total 286.00 last 80.00) - open/close 22490 (time 1764792873.08 total 296.00 last 83.49) - open/close 23320 (time 1764792883.11 total 306.03 last 82.75) - open/close 24132 (time 1764792893.12 total 316.04 last 81.14) - open/close 24965 (time 1764792903.16 total 326.07 last 83.02) - open/close 25761 (time 1764792913.18 total 336.10 last 79.38) - open/close 26502 (time 1764792923.21 total 346.12 last 73.93) - open/close 27291 (time 1764792933.21 total 356.13 last 78.85) - open/close 27994 (time 1764792943.26 total 366.18 last 69.96) - open/close 28720 (time 1764792953.29 total 376.20 last 72.42) - open/close 29420 (time 1764792963.29 total 386.21 last 69.97) - open/close 30000 (time 1764792971.75 total 394.67 last 68.56) - open/close 30583 (time 1764792981.75 total 404.67 last 58.28) - open/close 31365 (time 1764792991.75 total 414.67 last 78.20) - open/close 32075 (time 1764793001.76 total 424.68 last 70.94) - open/close 32656 (time 1764793011.78 total 434.70 last 58.01) - open/close 33309 (time 1764793021.78 total 444.70 last 65.29) - open/close 33980 (time 1764793031.79 total 454.71 last 67.00) - open/close 34605 (time 1764793041.80 total 464.72 last 62.44) - open/close 35341 (time 1764793051.81 total 474.72 last 73.58) - open/close 36062 (time 1764793061.82 total 484.73 last 72.03) - open/close 36837 (time 1764793071.82 total 494.74 last 77.48) - open/close 37527 (time 1764793081.83 total 504.75 last 68.90) - open/close 38291 (time 1764793091.84 total 514.76 last 76.35) - open/close 38961 (time 1764793101.85 total 524.76 last 66.96) - open/close 39612 (time 1764793111.85 total 534.77 last 65.05) - open/close 40000 (time 1764793118.96 total 541.88 last 54.56) - open/close 40499 (time 1764793128.98 total 551.90 last 49.82) - open/close 41049 (time 1764793138.98 total 561.90 last 54.99) - open/close 41511 (time 1764793149.03 total 571.95 last 45.99) - open/close 42014 (time 1764793159.05 total 581.96 last 50.22) - open/close 42391 (time 1764793169.06 total 591.98 last 37.64) - open/close 42867 (time 1764793179.06 total 601.98 last 47.59) - open/close 43263 (time 1764793189.08 total 611.99 last 39.55) - open/close 43683 (time 1764793199.09 total 622.01 last 41.93) - open/close 44042 (time 1764793209.14 total 632.05 last 35.74) - open/close 44296 (time 1764793219.17 total 642.09 last 25.31) - open/close 44593 (time 1764793229.17 total 652.09 last 29.70) - open/close 45050 (time 1764793239.18 total 662.10 last 45.64) - open/close 45593 (time 1764793249.22 total 672.14 last 54.11) - open/close 46147 (time 1764793259.22 total 682.14 last 55.38) - open/close 46959 (time 1764793269.22 total 692.14 last 81.20) - open/close 47933 (time 1764793279.23 total 702.14 last 97.36) - open/close 49037 (time 1764793289.23 total 712.15 last 110.37) - open/close 50000 (time 1764793297.21 total 720.12 last 120.72) - open/close 51151 (time 1764793307.21 total 730.13 last 115.08) - open/close 52120 (time 1764793317.22 total 740.13 last 96.84) - open/close 53076 (time 1764793327.22 total 750.14 last 95.55) - open/close 54074 (time 1764793337.22 total 760.14 last 99.79) - open/close 55061 (time 1764793347.23 total 770.14 last 98.65) - open/close 56155 (time 1764793357.23 total 780.14 last 109.40) - open/close 57313 (time 1764793367.23 total 790.15 last 115.75) - open/close 58476 (time 1764793377.23 total 800.15 last 116.30) - open/close 59909 (time 1764793387.24 total 810.15 last 143.21) - open/close 60919 (time 1764793397.24 total 820.16 last 100.97) - open/close 61774 (time 1764793407.25 total 830.17 last 85.42) - open/close 62687 (time 1764793417.25 total 840.17 last 91.28) - open/close 63612 (time 1764793427.25 total 850.17 last 92.48) - open/close 64532 (time 1764793437.25 total 860.17 last 91.99) total: 64768 open/close in 862.65 seconds: 75.08 ops/second - /unlink 932 (time 1764793452.04 total 10.00 last 93.18) - /unlink 1761 (time 1764793462.05 total 20.01 last 82.86) - /unlink 2597 (time 1764793472.06 total 30.02 last 83.48) - /unlink 3511 (time 1764793482.07 total 40.02 last 91.38) - /unlink 4336 (time 1764793492.08 total 50.03 last 82.41) - /unlink 5180 (time 1764793502.08 total 60.04 last 84.34) - /unlink 6077 (time 1764793512.09 total 70.05 last 89.64) - /unlink 6977 (time 1764793522.10 total 80.06 last 89.93) - /unlink 7985 (time 1764793532.10 total 90.06 last 100.74) - /unlink 8836 (time 1764793542.11 total 100.07 last 85.07) - /unlink 9842 (time 1764793552.11 total 110.07 last 100.53) - /unlink 10745 (time 1764793562.11 total 120.07 last 90.29) - /unlink 11822 (time 1764793572.12 total 130.07 last 107.68) - /unlink 12965 (time 1764793582.12 total 140.08 last 114.28) - /unlink 14061 (time 1764793592.12 total 150.08 last 109.57) - /unlink 15203 (time 1764793602.13 total 160.08 last 114.14) - /unlink 16162 (time 1764793612.13 total 170.09 last 95.84) - /unlink 17048 (time 1764793622.14 total 180.10 last 88.55) - /unlink 17998 (time 1764793632.14 total 190.10 last 94.96) - /unlink 19025 (time 1764793642.15 total 200.10 last 102.67) - /unlink 19901 (time 1764793652.15 total 210.11 last 87.54) - /unlink 20767 (time 1764793662.16 total 220.12 last 86.53) - /unlink 21700 (time 1764793672.16 total 230.12 last 93.26) - /unlink 22625 (time 1764793682.17 total 240.13 last 92.45) - /unlink 23536 (time 1764793692.18 total 250.14 last 90.98) - /unlink 24741 (time 1764793702.18 total 260.14 last 120.48) - /unlink 25808 (time 1764793712.19 total 270.14 last 106.68) - /unlink 26828 (time 1764793722.19 total 280.15 last 101.95) - /unlink 27735 (time 1764793732.19 total 290.15 last 90.70) - /unlink 28878 (time 1764793742.19 total 300.15 last 114.28) - /unlink 30000 (time 1764793751.93 total 309.88 last 115.27) - /unlink 31019 (time 1764793761.93 total 319.89 last 101.83) - /unlink 32496 (time 1764793771.94 total 329.90 last 147.61) - /unlink 33731 (time 1764793781.95 total 339.91 last 123.40) - /unlink 34744 (time 1764793791.95 total 349.91 last 101.29) - /unlink 35845 (time 1764793801.96 total 359.91 last 110.03) - /unlink 36972 (time 1764793811.96 total 369.92 last 112.62) - /unlink 38140 (time 1764793821.97 total 379.92 last 116.76) - /unlink 39261 (time 1764793831.97 total 389.92 last 112.08) - /unlink 40000 (time 1764793837.81 total 395.77 last 126.38) - /unlink 41370 (time 1764793847.82 total 405.78 last 136.92) - /unlink 42737 (time 1764793857.82 total 415.78 last 136.67) - /unlink 43929 (time 1764793867.82 total 425.78 last 119.18) - /unlink 45147 (time 1764793877.83 total 435.79 last 121.67) - /unlink 46199 (time 1764793887.84 total 445.80 last 105.16) - /unlink 47356 (time 1764793897.84 total 455.80 last 115.66) - /unlink 48619 (time 1764793907.84 total 465.80 last 126.27) - /unlink 49936 (time 1764793917.85 total 475.81 last 131.62) - /unlink 51265 (time 1764793927.85 total 485.81 last 132.89) - /unlink 52660 (time 1764793937.85 total 495.81 last 139.46) - /unlink 54373 (time 1764793947.86 total 505.82 last 171.20) - /unlink 55693 (time 1764793957.86 total 515.82 last 131.97) - /unlink 56940 (time 1764793967.86 total 525.82 last 124.69) - /unlink 58268 (time 1764793977.87 total 535.83 last 132.71) - /unlink 59622 (time 1764793987.88 total 545.83 last 135.30) - /unlink 60000 (time 1764793990.61 total 548.57 last 138.18) - /unlink 61869 (time 1764794000.61 total 558.57 last 186.84) - /unlink 64513 (time 1764794010.62 total 568.57 last 264.37) total: 64768 /unlink in 569.43 seconds: 113.74 ops/second Waiting for MDT destroys to complete oleg353-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg353-client: oleg353-server: ssh exited with exit code 1 - open/close 1772 (time 1764794032.03 total 10.00 last 177.12) - open/close 3223 (time 1764794042.03 total 20.01 last 145.09) - open/close 4788 (time 1764794052.03 total 30.01 last 156.47) - open/close 6319 (time 1764794062.04 total 40.01 last 153.04) - open/close 7874 (time 1764794072.04 total 50.01 last 155.49) - open/close 9633 (time 1764794082.07 total 60.04 last 175.33) - open/close 10000 (time 1764794084.56 total 62.54 last 147.26) - open/close 11727 (time 1764794094.57 total 72.54 last 172.65) - open/close 13370 (time 1764794104.57 total 82.54 last 164.30) - open/close 14795 (time 1764794114.57 total 92.54 last 142.44) - open/close 15860 (time 1764794124.58 total 102.55 last 106.44) - open/close 16765 (time 1764794134.58 total 112.56 last 90.46) - open/close 17536 (time 1764794144.59 total 122.57 last 77.01) - open/close 18389 (time 1764794154.61 total 132.58 last 85.20) - open/close 19429 (time 1764794164.61 total 142.58 last 103.97) - open/close 20000 (time 1764794169.38 total 147.35 last 119.67) - open/close 21216 (time 1764794179.38 total 157.36 last 121.55) - open/close 22554 (time 1764794189.39 total 167.36 last 133.77) - open/close 23845 (time 1764794199.39 total 177.36 last 129.04) - open/close 25177 (time 1764794209.39 total 187.37 last 133.14) - open/close 26501 (time 1764794219.40 total 197.37 last 132.34) - open/close 27988 (time 1764794229.40 total 207.38 last 148.64) - open/close 29487 (time 1764794239.41 total 217.38 last 149.87) - open/close 30000 (time 1764794242.76 total 220.73 last 152.97) - open/close 31588 (time 1764794252.76 total 230.74 last 158.72) - open/close 33150 (time 1764794262.77 total 240.74 last 156.18) - open/close 34259 (time 1764794272.77 total 250.74 last 110.88) - open/close 35294 (time 1764794282.78 total 260.76 last 103.34) - open/close 36324 (time 1764794292.79 total 270.76 last 102.97) - open/close 37717 (time 1764794302.79 total 280.77 last 139.21) - open/close 39667 (time 1764794312.79 total 290.77 last 194.97) - open/close 40000 (time 1764794314.99 total 292.97 last 151.43) - open/close 41772 (time 1764794325.00 total 302.97 last 177.16) - open/close 43553 (time 1764794335.00 total 312.97 last 178.08) - open/close 45591 (time 1764794345.00 total 322.97 last 203.79) - open/close 48135 (time 1764794355.00 total 332.97 last 254.30) - open/close 50000 (time 1764794364.65 total 342.62 last 193.26) - open/close 52703 (time 1764794374.65 total 352.63 last 270.25) - open/close 55112 (time 1764794384.65 total 362.63 last 240.87) - open/close 57662 (time 1764794394.66 total 372.63 last 254.95) - open/close 59855 (time 1764794404.66 total 382.64 last 219.14) - open/close 62110 (time 1764794414.66 total 392.64 last 225.47) total: 64768 open/close in 401.50 seconds: 161.32 ops/second - /unlink 4940 (time 1764794435.13 total 10.00 last 493.90) - /unlink 9824 (time 1764794445.13 total 20.00 last 488.34) - /unlink 13846 (time 1764794455.13 total 30.00 last 402.17) - /unlink 17256 (time 1764794465.13 total 40.01 last 340.88) - /unlink 20000 (time 1764794472.52 total 47.40 last 371.36) - /unlink 24403 (time 1764794482.52 total 57.40 last 440.23) - /unlink 29472 (time 1764794492.52 total 67.40 last 506.85) - /unlink 33952 (time 1764794502.52 total 77.40 last 447.96) - /unlink 38284 (time 1764794512.52 total 87.40 last 433.15) - /unlink 40000 (time 1764794516.38 total 91.25 last 445.59) - /unlink 44245 (time 1764794526.38 total 101.25 last 424.47) - /unlink 48779 (time 1764794536.38 total 111.25 last 453.37) - /unlink 50000 (time 1764794538.78 total 113.66 last 507.60) - /unlink 55651 (time 1764794548.78 total 123.66 last 565.09) - /unlink 60000 (time 1764794557.60 total 132.47 last 493.51) total: 64768 /unlink in 141.45 seconds: 457.90 ops/second Waiting for MDT destroys to complete oleg353-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg353-client: oleg353-server: ssh exited with exit code 1 - open/close 3511 (time 1764794587.70 total 10.00 last 351.07) - open/close 6213 (time 1764794597.71 total 20.00 last 270.12) - open/close 9611 (time 1764794607.71 total 30.00 last 339.78) - open/close 13329 (time 1764794617.71 total 40.01 last 371.73) - open/close 15231 (time 1764794627.72 total 50.01 last 190.05) - open/close 16283 (time 1764794637.72 total 60.02 last 105.14) - open/close 17182 (time 1764794647.73 total 70.02 last 89.86) - open/close 17860 (time 1764794657.74 total 80.04 last 67.72) - open/close 18485 (time 1764794667.74 total 90.04 last 62.50) - open/close 19155 (time 1764794677.75 total 100.04 last 66.95) - open/close 19855 (time 1764794687.77 total 110.06 last 69.87) - open/close 20752 (time 1764794697.78 total 120.07 last 89.59) - open/close 21703 (time 1764794707.79 total 130.08 last 95.02) - open/close 22668 (time 1764794717.79 total 140.08 last 96.49) - open/close 23742 (time 1764794727.79 total 150.08 last 107.40) - open/close 24811 (time 1764794737.81 total 160.10 last 106.67) - open/close 25759 (time 1764794747.82 total 170.11 last 94.72) - open/close 26749 (time 1764794757.83 total 180.12 last 98.89) - open/close 27726 (time 1764794767.84 total 190.14 last 97.55) - open/close 28314 (time 1764794777.85 total 200.15 last 58.74) - open/close 28910 (time 1764794787.86 total 210.16 last 59.55) - open/close 29532 (time 1764794797.87 total 220.17 last 62.15) - open/close 30000 (time 1764794803.43 total 225.73 last 84.18) - open/close 30836 (time 1764794813.44 total 235.73 last 83.53) - open/close 31745 (time 1764794823.44 total 245.74 last 90.86) - open/close 32685 (time 1764794833.45 total 255.75 last 93.91) - open/close 33584 (time 1764794843.46 total 265.76 last 89.83) - open/close 34514 (time 1764794853.46 total 275.76 last 92.98) - open/close 35516 (time 1764794863.47 total 285.77 last 100.12) - open/close 36447 (time 1764794873.48 total 295.77 last 93.05) - open/close 37260 (time 1764794883.48 total 305.77 last 81.27) - open/close 38112 (time 1764794893.49 total 315.78 last 85.14) - open/close 38993 (time 1764794903.49 total 325.79 last 88.03) - open/close 39884 (time 1764794913.50 total 335.80 last 89.02) - open/close 40776 (time 1764794923.51 total 345.80 last 89.16) - open/close 41568 (time 1764794933.52 total 355.81 last 79.12) - open/close 42428 (time 1764794943.52 total 365.82 last 85.97) - open/close 43546 (time 1764794953.52 total 375.82 last 111.79) - open/close 44712 (time 1764794963.53 total 385.83 last 116.48) - open/close 45812 (time 1764794973.53 total 395.83 last 109.99) - open/close 46890 (time 1764794983.54 total 405.83 last 107.78) - open/close 48710 (time 1764794993.54 total 415.84 last 181.92) - open/close 50000 (time 1764794999.82 total 422.11 last 205.51) - open/close 51998 (time 1764795009.83 total 432.12 last 199.62) - open/close 53462 (time 1764795019.83 total 442.13 last 146.35) - open/close 54760 (time 1764795029.83 total 452.13 last 129.75) - open/close 55882 (time 1764795039.84 total 462.14 last 112.12) - open/close 56537 (time 1764795049.85 total 472.14 last 65.46) - open/close 57160 (time 1764795059.86 total 482.16 last 62.22) - open/close 57856 (time 1764795069.87 total 492.16 last 69.56) - open/close 58341 (time 1764795079.88 total 502.17 last 48.45) - open/close 58942 (time 1764795089.88 total 512.18 last 60.06) - open/close 59651 (time 1764795099.88 total 522.18 last 70.90) - open/close 60000 (time 1764795104.73 total 527.02 last 72.04) - open/close 60882 (time 1764795114.73 total 537.03 last 88.14) - open/close 61765 (time 1764795124.74 total 547.03 last 88.27) - open/close 62664 (time 1764795134.75 total 557.04 last 89.84) - open/close 63444 (time 1764795144.75 total 567.04 last 78.00) - open/close 64149 (time 1764795154.76 total 577.05 last 70.42) total: 64768 open/close in 585.83 seconds: 110.56 ops/second - /unlink 1375 (time 1764795177.39 total 10.01 last 137.39) - /unlink 2619 (time 1764795187.39 total 20.01 last 124.37) - /unlink 3459 (time 1764795197.40 total 30.02 last 83.96) - /unlink 4331 (time 1764795207.41 total 40.03 last 87.09) - /unlink 5220 (time 1764795217.42 total 50.04 last 88.80) - /unlink 6121 (time 1764795227.43 total 60.05 last 90.05) - /unlink 7034 (time 1764795237.43 total 70.05 last 91.27) - /unlink 7855 (time 1764795247.45 total 80.06 last 81.97) - /unlink 8731 (time 1764795257.45 total 90.06 last 87.60) - /unlink 9705 (time 1764795267.45 total 100.06 last 97.39) - /unlink 10000 (time 1764795271.00 total 103.61 last 83.11) - /unlink 10851 (time 1764795281.00 total 113.62 last 85.09) - /unlink 11709 (time 1764795291.01 total 123.63 last 85.70) - /unlink 12639 (time 1764795301.02 total 133.63 last 92.97) - /unlink 13550 (time 1764795311.02 total 143.63 last 91.09) - /unlink 14419 (time 1764795321.02 total 153.63 last 86.89) - /unlink 15333 (time 1764795331.02 total 163.64 last 91.37) - /unlink 16273 (time 1764795341.03 total 173.64 last 93.93) - /unlink 17172 (time 1764795351.03 total 183.65 last 89.87) - /unlink 18073 (time 1764795361.03 total 193.65 last 90.09) - /unlink 18996 (time 1764795371.04 total 203.66 last 92.25) - /unlink 19903 (time 1764795381.05 total 213.66 last 90.65) - /unlink 20762 (time 1764795391.05 total 223.67 last 85.85) - /unlink 21659 (time 1764795401.05 total 233.67 last 89.68) - /unlink 22544 (time 1764795411.06 total 243.67 last 88.45) - /unlink 23428 (time 1764795421.07 total 253.68 last 88.32) - /unlink 24337 (time 1764795431.08 total 263.70 last 90.78) - /unlink 25245 (time 1764795441.08 total 273.70 last 90.77) - /unlink 26015 (time 1764795451.09 total 283.70 last 76.98) - /unlink 26880 (time 1764795461.09 total 293.71 last 86.45) - /unlink 27787 (time 1764795471.09 total 303.71 last 90.68) - /unlink 28718 (time 1764795481.10 total 313.72 last 93.04) - /unlink 29720 (time 1764795491.10 total 323.72 last 100.16) - /unlink 30000 (time 1764795494.01 total 326.63 last 96.35) - /unlink 30885 (time 1764795504.01 total 336.63 last 88.49) - /unlink 31787 (time 1764795514.02 total 346.63 last 90.16) - /unlink 32637 (time 1764795524.02 total 356.64 last 84.94) - /unlink 33458 (time 1764795534.03 total 366.65 last 82.03) - /unlink 34303 (time 1764795544.04 total 376.66 last 84.43) - /unlink 35244 (time 1764795554.04 total 386.66 last 94.07) - /unlink 36155 (time 1764795564.05 total 396.66 last 91.07) - /unlink 37029 (time 1764795574.05 total 406.67 last 87.37) - /unlink 37950 (time 1764795584.06 total 416.67 last 92.06) - /unlink 38869 (time 1764795594.06 total 426.68 last 91.86) - /unlink 39760 (time 1764795604.06 total 436.68 last 89.09) - /unlink 40000 (time 1764795606.71 total 439.32 last 90.70) - /unlink 40835 (time 1764795616.72 total 449.33 last 83.41) - /unlink 41773 (time 1764795626.72 total 459.34 last 93.75) - /unlink 42637 (time 1764795636.74 total 469.35 last 86.26) - /unlink 43576 (time 1764795646.74 total 479.36 last 93.87) - /unlink 44476 (time 1764795656.76 total 489.38 last 89.82) - /unlink 45437 (time 1764795666.77 total 499.39 last 96.01) - /unlink 46339 (time 1764795676.77 total 509.39 last 90.18) - /unlink 47295 (time 1764795686.78 total 519.39 last 95.58) - /unlink 48077 (time 1764795696.79 total 529.40 last 78.12) - /unlink 48863 (time 1764795706.80 total 539.41 last 78.52) - /unlink 49725 (time 1764795716.81 total 549.43 last 86.06) - /unlink 50000 (time 1764795720.62 total 553.24 last 72.13) - /unlink 50772 (time 1764795730.63 total 563.24 last 77.19) - /unlink 51649 (time 1764795740.63 total 573.25 last 87.67) - /unlink 52505 (time 1764795750.63 total 583.25 last 85.56) - /unlink 53425 (time 1764795760.64 total 593.25 last 91.99) - /unlink 54285 (time 1764795770.65 total 603.26 last 85.92) - /unlink 55175 (time 1764795780.65 total 613.26 last 88.98) - /unlink 56111 (time 1764795790.66 total 623.27 last 93.51) - /unlink 57061 (time 1764795800.66 total 633.28 last 94.92) - /unlink 58023 (time 1764795810.67 total 643.29 last 96.11) - /unlink 58923 (time 1764795820.68 total 653.30 last 89.91) - /unlink 59755 (time 1764795830.70 total 663.31 last 83.11) - /unlink 60000 (time 1764795833.90 total 666.52 last 76.45) - /unlink 60899 (time 1764795843.90 total 676.52 last 89.87) - /unlink 61755 (time 1764795853.91 total 686.52 last 85.58) - /unlink 62628 (time 1764795863.92 total 696.53 last 87.19) - /unlink 63375 (time 1764795873.95 total 706.56 last 74.49) - /unlink 64044 (time 1764795883.96 total 716.58 last 66.80) total: 64768 /unlink in 725.19 seconds: 89.31 ops/second Waiting for MDT destroys to complete oleg353-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg353-client: oleg353-server: ssh exited with exit code 1 - open/close 898 (time 1764795914.61 total 10.00 last 89.79) - open/close 1829 (time 1764795924.61 total 20.00 last 93.08) - open/close 2721 (time 1764795934.63 total 30.02 last 89.03) - open/close 3651 (time 1764795944.64 total 40.03 last 92.90) - open/close 4606 (time 1764795954.64 total 50.04 last 95.43) - open/close 5531 (time 1764795964.65 total 60.04 last 92.46) - open/close 6481 (time 1764795974.65 total 70.05 last 94.98) - open/close 7447 (time 1764795984.65 total 80.05 last 96.57) - open/close 8487 (time 1764795994.67 total 90.06 last 103.87) - open/close 9424 (time 1764796004.69 total 100.08 last 93.52) - open/close 10000 (time 1764796010.73 total 106.12 last 95.35) - open/close 11006 (time 1764796020.73 total 116.13 last 100.56) - open/close 12078 (time 1764796030.73 total 126.13 last 107.17) - open/close 13084 (time 1764796040.74 total 136.14 last 100.49) - open/close 14057 (time 1764796050.75 total 146.14 last 97.29) - open/close 14985 (time 1764796060.75 total 156.15 last 92.75) - open/close 15986 (time 1764796070.75 total 166.15 last 100.07) - open/close 16928 (time 1764796080.76 total 176.15 last 94.15) - open/close 17870 (time 1764796090.76 total 186.16 last 94.18) - open/close 18803 (time 1764796100.77 total 196.16 last 93.26) - open/close 19727 (time 1764796110.77 total 206.16 last 92.38) - open/close 20000 (time 1764796113.67 total 209.06 last 94.18) - open/close 20986 (time 1764796123.68 total 219.08 last 98.47) - open/close 21823 (time 1764796133.69 total 229.09 last 83.59) - open/close 22707 (time 1764796143.70 total 239.09 last 88.34) - open/close 23663 (time 1764796153.70 total 249.10 last 95.57) - open/close 24624 (time 1764796163.72 total 259.12 last 95.91) - open/close 25638 (time 1764796173.73 total 269.13 last 101.32) - open/close 26513 (time 1764796183.74 total 279.13 last 87.43) - open/close 27322 (time 1764796193.75 total 289.14 last 80.83) - open/close 27982 (time 1764796203.76 total 299.16 last 65.91) - open/close 28650 (time 1764796213.76 total 309.16 last 66.79) - open/close 29364 (time 1764796223.76 total 319.16 last 71.40) - open/close 30000 (time 1764796232.29 total 327.68 last 74.60) - open/close 30858 (time 1764796242.30 total 337.69 last 85.73) - open/close 31740 (time 1764796252.30 total 347.69 last 88.17) - open/close 32600 (time 1764796262.31 total 357.70 last 85.95) - open/close 33501 (time 1764796272.31 total 367.70 last 90.10) - open/close 34347 (time 1764796282.31 total 377.71 last 84.52) - open/close 35241 (time 1764796292.32 total 387.71 last 89.35) - open/close 36165 (time 1764796302.33 total 397.73 last 92.30) - open/close 37084 (time 1764796312.37 total 407.77 last 91.50) - open/close 37995 (time 1764796322.38 total 417.78 last 91.03) - open/close 38977 (time 1764796332.38 total 427.78 last 98.19) - open/close 39942 (time 1764796342.39 total 437.78 last 96.48) - open/close 40912 (time 1764796352.40 total 447.80 last 96.84) - open/close 41855 (time 1764796362.42 total 457.81 last 94.15) - open/close 42721 (time 1764796372.42 total 467.81 last 86.58) - open/close 43677 (time 1764796382.43 total 477.82 last 95.55) - open/close 44604 (time 1764796392.43 total 487.83 last 92.62) - open/close 45547 (time 1764796402.44 total 497.83 last 94.27) - open/close 46475 (time 1764796412.44 total 507.84 last 92.77) - open/close 47393 (time 1764796422.44 total 517.84 last 91.79) - open/close 48261 (time 1764796432.45 total 527.85 last 86.69) - open/close 49083 (time 1764796442.46 total 537.86 last 82.12) - open/close 49895 (time 1764796452.47 total 547.87 last 81.11) - open/close 50624 (time 1764796462.50 total 557.89 last 72.73) - open/close 51355 (time 1764796472.50 total 567.89 last 73.10) - open/close 52186 (time 1764796482.51 total 577.90 last 83.04) - open/close 53048 (time 1764796492.51 total 587.90 last 86.18) - open/close 53874 (time 1764796502.52 total 597.91 last 82.52) - open/close 54805 (time 1764796512.52 total 607.92 last 93.05) - open/close 55697 (time 1764796522.55 total 617.94 last 88.96) - open/close 56616 (time 1764796532.56 total 627.95 last 91.83) - open/close 57399 (time 1764796542.56 total 637.95 last 78.30) - open/close 58248 (time 1764796552.57 total 647.97 last 84.77) - open/close 59094 (time 1764796562.59 total 657.98 last 84.47) - open/close 59908 (time 1764796572.59 total 667.99 last 81.39) - open/close 60739 (time 1764796582.60 total 677.99 last 83.06) - open/close 61594 (time 1764796592.60 total 688.00 last 85.42) - open/close 62378 (time 1764796602.61 total 698.00 last 78.37) - open/close 63132 (time 1764796612.61 total 708.01 last 75.38) - open/close 63872 (time 1764796622.63 total 718.02 last 73.87) - open/close 64681 (time 1764796632.64 total 728.03 last 80.84) total: 64768 open/close in 729.00 seconds: 88.85 ops/second - /unlink 779 (time 1764796647.10 total 10.00 last 77.89) - /unlink 1556 (time 1764796657.11 total 20.01 last 77.60) - /unlink 2395 (time 1764796667.12 total 30.02 last 83.84) - /unlink 3160 (time 1764796677.13 total 40.03 last 76.40) - /unlink 3837 (time 1764796687.14 total 50.05 last 67.60) - /unlink 4609 (time 1764796697.15 total 60.06 last 77.15) - /unlink 5375 (time 1764796707.15 total 70.06 last 76.60) - /unlink 6183 (time 1764796717.15 total 80.06 last 80.80) - /unlink 7009 (time 1764796727.15 total 90.06 last 82.57) - /unlink 7852 (time 1764796737.16 total 100.06 last 84.27) - /unlink 8708 (time 1764796747.17 total 110.07 last 85.51) - /unlink 9546 (time 1764796757.17 total 120.08 last 83.75) - /unlink 10000 (time 1764796762.42 total 125.32 last 86.58) - /unlink 10805 (time 1764796772.42 total 135.33 last 80.47) - /unlink 11589 (time 1764796782.43 total 145.33 last 78.33) - /unlink 12287 (time 1764796792.45 total 155.35 last 69.68) - /unlink 13019 (time 1764796802.47 total 165.37 last 73.06) - /unlink 13792 (time 1764796812.47 total 175.38 last 77.26) - /unlink 14486 (time 1764796822.47 total 185.38 last 69.38) - /unlink 15327 (time 1764796832.48 total 195.38 last 84.07) - /unlink 16222 (time 1764796842.48 total 205.39 last 89.44) - /unlink 17148 (time 1764796852.49 total 215.40 last 92.53) - /unlink 17985 (time 1764796862.50 total 225.41 last 83.62) - /unlink 18919 (time 1764796872.50 total 235.41 last 93.39) - /unlink 19783 (time 1764796882.51 total 245.42 last 86.31) - /unlink 20000 (time 1764796885.10 total 248.01 last 83.73) - /unlink 20874 (time 1764796895.13 total 258.03 last 87.21) - /unlink 21658 (time 1764796905.13 total 268.04 last 78.36) - /unlink 22540 (time 1764796915.13 total 278.04 last 88.18) - /unlink 23400 (time 1764796925.15 total 288.06 last 85.86) - /unlink 24291 (time 1764796935.16 total 298.06 last 89.05) - /unlink 25187 (time 1764796945.16 total 308.07 last 89.53) - /unlink 26052 (time 1764796955.16 total 318.07 last 86.50) - /unlink 26922 (time 1764796965.17 total 328.07 last 86.99) - /unlink 27788 (time 1764796975.17 total 338.07 last 86.60) - /unlink 28666 (time 1764796985.17 total 348.08 last 87.73) - /unlink 29548 (time 1764796995.18 total 358.08 last 88.15) - /unlink 30000 (time 1764797000.35 total 363.25 last 87.48) - /unlink 30846 (time 1764797010.35 total 373.26 last 84.55) - /unlink 31719 (time 1764797020.36 total 383.27 last 87.21) - /unlink 32601 (time 1764797030.37 total 393.28 last 88.10) - /unlink 33448 (time 1764797040.38 total 403.28 last 84.67) - /unlink 34258 (time 1764797050.39 total 413.30 last 80.86) - /unlink 35148 (time 1764797060.39 total 423.30 last 89.00) - /unlink 36056 (time 1764797070.40 total 433.30 last 90.75) - /unlink 36942 (time 1764797080.40 total 443.31 last 88.57) - /unlink 37861 (time 1764797090.41 total 453.32 last 91.83) - /unlink 38753 (time 1764797100.43 total 463.33 last 89.07) - /unlink 39607 (time 1764797110.43 total 473.34 last 85.34) - /unlink 40000 (time 1764797115.15 total 478.06 last 83.22) - /unlink 40905 (time 1764797125.16 total 488.07 last 90.42) - /unlink 41811 (time 1764797135.17 total 498.07 last 90.58) - /unlink 42729 (time 1764797145.17 total 508.08 last 91.76) - /unlink 43622 (time 1764797155.18 total 518.09 last 89.17) - /unlink 44443 (time 1764797165.21 total 528.12 last 81.87) - /unlink 45365 (time 1764797175.22 total 538.13 last 92.12) - /unlink 46308 (time 1764797185.23 total 548.13 last 94.25) - /unlink 47271 (time 1764797195.23 total 558.13 last 96.30) - /unlink 48177 (time 1764797205.24 total 568.15 last 90.44) - /unlink 49123 (time 1764797215.25 total 578.15 last 94.58) - /unlink 50000 (time 1764797224.47 total 587.38 last 95.06) - /unlink 50922 (time 1764797234.48 total 597.38 last 92.15) - /unlink 51867 (time 1764797244.48 total 607.39 last 94.43) - /unlink 52772 (time 1764797254.49 total 617.39 last 90.47) - /unlink 53663 (time 1764797264.50 total 627.41 last 88.98) - /unlink 54573 (time 1764797274.51 total 637.41 last 90.95) - /unlink 55536 (time 1764797284.51 total 647.42 last 96.26) - /unlink 56522 (time 1764797294.52 total 657.42 last 98.56) - /unlink 57446 (time 1764797304.52 total 667.43 last 92.34) - /unlink 58407 (time 1764797314.53 total 677.44 last 96.00) - /unlink 59325 (time 1764797324.54 total 687.44 last 91.76) - /unlink 60000 (time 1764797332.15 total 695.05 last 88.71) - /unlink 60914 (time 1764797342.15 total 705.06 last 91.33) - /unlink 61858 (time 1764797352.16 total 715.07 last 94.33) - /unlink 62805 (time 1764797362.17 total 725.08 last 94.59) - /unlink 63817 (time 1764797372.18 total 735.09 last 101.10) total: 64768 /unlink in 744.80 seconds: 86.96 ops/second Waiting for MDT destroys to complete oleg353-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg353-client: oleg353-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg353-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg353-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg353-server stop mds service on oleg353-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg353-server stop mds service on oleg353-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg353-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg353-server' oleg353-server: oleg353-server.virtnet: executing unload_modules_local oleg353-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg353-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg353-client: oleg353-client: ssh exited with exit code 2 pdsh@oleg353-client: oleg353-server: ssh exited with exit code 2 pdsh@oleg353-client: oleg353-client: ssh exited with exit code 2 pdsh@oleg353-client: oleg353-server: ssh exited with exit code 2 PASS 106 (6194s) Stopping clients: oleg353-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg353-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg353-client: oleg353-server: ssh exited with exit code 2 oleg353-server: oleg353-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg353-server' oleg353-server: oleg353-server.virtnet: executing load_modules_local oleg353-server: Loading modules from /home/green/git/lustre-release/lustre oleg353-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg353-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg353-server: detected 4 online CPUs by sysfs oleg353-server: MODOPTS_LIBCFS= oleg353-server: Force libcfs to create 2 CPU partitions oleg353-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg353-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 6407 sec ========== 16:31:22 (1764797482) === conf-sanity: start cleanup 16:31:24 (1764797484) === === conf-sanity: finish cleanup 16:31:26 (1764797486) ===