-----============= acceptance-small: conf-sanity ============----- Thu May 1 15:03:59 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg126-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex: No such file or directory excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg126-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg126-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg126-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg126-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg126-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg126-server oleg126-server: oleg126-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory loading modules on: 'oleg126-server' oleg126-server: oleg126-server.virtnet: executing load_modules_local oleg126-server: Loading modules from /home/green/git/lustre-release/lustre oleg126-server: detected 4 online CPUs by sysfs oleg126-server: MODOPTS_LIBCFS= oleg126-server: Force libcfs to create 2 CPU partitions oleg126-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg126-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg126-server: oleg126-server.virtnet: executing set_default_debug -1 all pdsh@oleg126-client: oleg126-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg126-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg126-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg126-server: oleg126-server.virtnet: executing set_default_debug -1 all pdsh@oleg126-client: oleg126-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg126-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg126-server: oleg126-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg126-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg126-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg126-server stop mds service on oleg126-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg126-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 15:05:29 (1746126329) Stopping clients: oleg126-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg126-client.virtnet /mnt/lustre2 (opts:-f) oleg126-server: oleg126-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg126-server' oleg126-server: oleg126-server.virtnet: executing load_modules_local oleg126-server: Loading modules from /home/green/git/lustre-release/lustre oleg126-server: detected 4 online CPUs by sysfs oleg126-server: MODOPTS_LIBCFS= oleg126-server: Force libcfs to create 2 CPU partitions oleg126-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg126-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg126-server: oleg126-server.virtnet: executing set_default_debug -1 all pdsh@oleg126-client: oleg126-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg126-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg126-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg126-server: oleg126-server.virtnet: executing set_default_debug -1 all pdsh@oleg126-client: oleg126-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg126-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg126-client.virtnet: -o user_xattr,flock 192.168.201.126@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 32648 392 32256 2% /mnt/lustre[OST:0] filesystem_summary: 32585 329 32256 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 780 (time 1746126400.80 total 10.01 last 77.94) - open/close 1528 (time 1746126410.80 total 20.01 last 74.76) - open/close 2363 (time 1746126420.81 total 30.02 last 83.47) - open/close 3267 (time 1746126430.81 total 40.02 last 90.38) - open/close 4159 (time 1746126440.83 total 50.03 last 89.07) - open/close 5134 (time 1746126450.83 total 60.04 last 97.44) - open/close 6009 (time 1746126460.84 total 70.05 last 87.46) - open/close 6911 (time 1746126470.84 total 80.05 last 90.16) - open/close 7746 (time 1746126480.86 total 90.07 last 83.35) - open/close 8507 (time 1746126490.86 total 100.07 last 76.07) - open/close 9352 (time 1746126500.87 total 110.08 last 84.44) - open/close 10000 (time 1746126508.80 total 118.01 last 81.68) - open/close 10877 (time 1746126518.81 total 128.02 last 87.63) - open/close 11724 (time 1746126528.81 total 138.02 last 84.66) - open/close 12504 (time 1746126538.82 total 148.03 last 77.92) - open/close 13322 (time 1746126548.83 total 158.04 last 81.79) - open/close 14176 (time 1746126558.83 total 168.04 last 85.34) - open/close 15042 (time 1746126568.85 total 178.06 last 86.42) - open/close 15923 (time 1746126578.86 total 188.07 last 88.04) - open/close 16831 (time 1746126588.87 total 198.08 last 90.71) - open/close 17670 (time 1746126598.88 total 208.09 last 83.81) - open/close 18352 (time 1746126608.89 total 218.10 last 68.15) - open/close 19175 (time 1746126618.89 total 228.10 last 82.25) - open/close 20000 (time 1746126627.99 total 237.20 last 90.71) - open/close 20930 (time 1746126637.99 total 247.20 last 92.95) - open/close 22014 (time 1746126647.99 total 257.20 last 108.39) - open/close 23066 (time 1746126658.00 total 267.21 last 105.14) - open/close 24077 (time 1746126668.01 total 277.21 last 101.05) - open/close 25124 (time 1746126678.01 total 287.22 last 104.64) - open/close 26110 (time 1746126688.02 total 297.23 last 98.54) - open/close 27031 (time 1746126698.03 total 307.24 last 92.00) - open/close 27965 (time 1746126708.05 total 317.26 last 93.20) - open/close 28921 (time 1746126718.06 total 327.26 last 95.53) - open/close 29737 (time 1746126728.06 total 337.27 last 81.59) - open/close 30000 (time 1746126731.31 total 340.52 last 80.79) - open/close 30788 (time 1746126741.32 total 350.53 last 78.72) - open/close 31664 (time 1746126751.33 total 360.54 last 87.56) - open/close 32634 (time 1746126761.33 total 370.54 last 96.99) - open/close 33506 (time 1746126771.33 total 380.54 last 87.18) - open/close 34453 (time 1746126781.33 total 390.54 last 94.69) - open/close 35320 (time 1746126791.33 total 400.54 last 86.67) - open/close 36343 (time 1746126801.34 total 410.55 last 102.21) - open/close 37298 (time 1746126811.35 total 420.56 last 95.44) - open/close 38263 (time 1746126821.37 total 430.58 last 96.27) - open/close 39190 (time 1746126831.38 total 440.59 last 92.62) - open/close 40000 (time 1746126839.52 total 448.73 last 99.51) - open/close 40941 (time 1746126849.52 total 458.73 last 94.09) - open/close 41884 (time 1746126859.54 total 468.75 last 94.19) - open/close 42871 (time 1746126869.54 total 478.75 last 98.67) - open/close 43939 (time 1746126879.54 total 488.75 last 106.75) - open/close 44833 (time 1746126889.55 total 498.76 last 89.34) - open/close 45697 (time 1746126899.56 total 508.77 last 86.34) - open/close 46484 (time 1746126909.56 total 518.77 last 78.66) - open/close 47380 (time 1746126919.57 total 528.78 last 89.56) - open/close 48445 (time 1746126929.57 total 538.78 last 106.47) - open/close 49568 (time 1746126939.58 total 548.79 last 112.21) - open/close 50000 (time 1746126943.79 total 553.00 last 102.65) - open/close 50957 (time 1746126953.79 total 563.00 last 95.63) - open/close 51826 (time 1746126963.80 total 573.01 last 86.82) - open/close 52685 (time 1746126973.81 total 583.02 last 85.87) - open/close 53611 (time 1746126983.81 total 593.02 last 92.54) - open/close 54555 (time 1746126993.82 total 603.03 last 94.32) - open/close 55535 (time 1746127003.83 total 613.04 last 97.89) - open/close 56382 (time 1746127013.85 total 623.06 last 84.55) - open/close 57339 (time 1746127023.86 total 633.07 last 95.62) - open/close 58270 (time 1746127033.86 total 643.07 last 93.04) - open/close 59204 (time 1746127043.87 total 653.08 last 93.34) - open/close 60000 (time 1746127051.93 total 661.14 last 98.81) - open/close 61040 (time 1746127061.93 total 671.14 last 103.97) - open/close 62130 (time 1746127071.94 total 681.15 last 108.93) - open/close 63313 (time 1746127081.94 total 691.15 last 118.28) - open/close 64373 (time 1746127091.95 total 701.16 last 105.92) total: 64768 open/close in 704.78 seconds: 91.90 ops/second - /unlink 1142 (time 1746127107.47 total 10.01 last 114.14) - /unlink 2435 (time 1746127117.47 total 20.01 last 129.29) - /unlink 3537 (time 1746127127.48 total 30.01 last 110.11) - /unlink 4552 (time 1746127137.48 total 40.02 last 101.43) - /unlink 5670 (time 1746127147.48 total 50.02 last 111.80) - /unlink 6803 (time 1746127157.49 total 60.02 last 113.26) - /unlink 7904 (time 1746127167.49 total 70.03 last 110.07) - /unlink 8980 (time 1746127177.49 total 80.03 last 107.53) - /unlink 9955 (time 1746127187.51 total 90.05 last 97.37) - /unlink 11131 (time 1746127197.51 total 100.05 last 117.52) - /unlink 12174 (time 1746127207.52 total 110.06 last 104.20) - /unlink 13137 (time 1746127217.53 total 120.06 last 96.28) - /unlink 14219 (time 1746127227.53 total 130.07 last 108.16) - /unlink 15200 (time 1746127237.53 total 140.07 last 98.07) - /unlink 16295 (time 1746127247.53 total 150.07 last 109.49) - /unlink 17357 (time 1746127257.54 total 160.08 last 106.12) - /unlink 18293 (time 1746127267.54 total 170.08 last 93.57) - /unlink 19206 (time 1746127277.55 total 180.08 last 91.28) - /unlink 20000 (time 1746127286.76 total 189.30 last 86.19) - /unlink 20933 (time 1746127296.76 total 199.30 last 93.27) - /unlink 21806 (time 1746127306.78 total 209.32 last 87.15) - /unlink 22584 (time 1746127316.78 total 219.32 last 77.78) - /unlink 23421 (time 1746127326.79 total 229.33 last 83.64) - /unlink 24211 (time 1746127336.79 total 239.33 last 78.98) - /unlink 25067 (time 1746127346.79 total 249.33 last 85.58) - /unlink 26053 (time 1746127356.80 total 259.33 last 98.59) - /unlink 26875 (time 1746127366.80 total 269.34 last 82.18) - /unlink 27908 (time 1746127376.81 total 279.35 last 103.20) - /unlink 28878 (time 1746127386.81 total 289.35 last 96.93) - /unlink 29828 (time 1746127396.82 total 299.36 last 94.93) - /unlink 30724 (time 1746127406.83 total 309.37 last 89.50) - /unlink 31680 (time 1746127416.84 total 319.38 last 95.55) - /unlink 32729 (time 1746127426.84 total 329.38 last 104.87) - /unlink 33582 (time 1746127436.84 total 339.38 last 85.27) - /unlink 34425 (time 1746127446.86 total 349.40 last 84.13) - /unlink 35247 (time 1746127456.86 total 359.40 last 82.20) - /unlink 36029 (time 1746127466.87 total 369.41 last 78.14) - /unlink 36859 (time 1746127476.88 total 379.41 last 82.96) - /unlink 37722 (time 1746127486.88 total 389.42 last 86.26) - /unlink 38610 (time 1746127496.89 total 399.43 last 88.74) - /unlink 39489 (time 1746127506.89 total 409.43 last 87.89) - /unlink 40000 (time 1746127511.40 total 413.94 last 113.31) - /unlink 41049 (time 1746127521.41 total 423.95 last 104.81) - /unlink 42164 (time 1746127531.43 total 433.96 last 111.31) - /unlink 43133 (time 1746127541.43 total 443.97 last 96.83) - /unlink 44002 (time 1746127551.44 total 453.97 last 86.88) - /unlink 44887 (time 1746127561.44 total 463.98 last 88.43) - /unlink 45746 (time 1746127571.44 total 473.98 last 85.89) - /unlink 46560 (time 1746127581.45 total 483.99 last 81.35) - /unlink 47482 (time 1746127591.45 total 493.99 last 92.17) - /unlink 48374 (time 1746127601.46 total 504.00 last 89.11) - /unlink 49193 (time 1746127611.48 total 514.01 last 81.81) - /unlink 50000 (time 1746127620.64 total 523.18 last 88.01) - /unlink 50778 (time 1746127630.65 total 533.19 last 77.76) - /unlink 51790 (time 1746127640.66 total 543.20 last 101.10) - /unlink 52667 (time 1746127650.67 total 553.21 last 87.64) - /unlink 53660 (time 1746127660.68 total 563.21 last 99.22) - /unlink 54550 (time 1746127670.68 total 573.22 last 88.93) - /unlink 55337 (time 1746127680.69 total 583.22 last 78.67) - /unlink 56288 (time 1746127690.69 total 593.23 last 95.07) - /unlink 57455 (time 1746127700.70 total 603.23 last 116.62) - /unlink 58714 (time 1746127710.71 total 613.25 last 125.76) - /unlink 59658 (time 1746127720.72 total 623.26 last 94.27) - /unlink 60000 (time 1746127724.42 total 626.95 last 92.54) - /unlink 60963 (time 1746127734.42 total 636.96 last 96.30) - /unlink 61896 (time 1746127744.42 total 646.96 last 93.25) - /unlink 62894 (time 1746127754.43 total 656.97 last 99.67) - /unlink 63944 (time 1746127764.44 total 666.98 last 104.95) total: 64768 /unlink in 673.83 seconds: 96.12 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1060 (time 1746127801.10 total 10.00 last 105.97) - open/close 2340 (time 1746127811.11 total 20.01 last 127.87) - open/close 3363 (time 1746127821.13 total 30.03 last 102.14) - open/close 4457 (time 1746127831.13 total 40.03 last 109.39) - open/close 5749 (time 1746127841.14 total 50.04 last 129.09) - open/close 6780 (time 1746127851.17 total 60.07 last 102.75) - open/close 7873 (time 1746127861.17 total 70.07 last 109.30) - open/close 9036 (time 1746127871.17 total 80.08 last 116.26) - open/close 10000 (time 1746127878.93 total 87.84 last 124.22) - open/close 11243 (time 1746127888.94 total 97.85 last 124.20) - open/close 12253 (time 1746127898.95 total 107.85 last 100.97) - open/close 13430 (time 1746127908.95 total 117.86 last 117.62) - open/close 14512 (time 1746127918.96 total 127.87 last 108.08) - open/close 15661 (time 1746127928.97 total 137.87 last 114.85) - open/close 16814 (time 1746127938.99 total 147.89 last 115.10) - open/close 17837 (time 1746127948.99 total 157.89 last 102.28) - open/close 19059 (time 1746127959.00 total 167.90 last 122.11) - open/close 20000 (time 1746127967.45 total 176.36 last 111.24) - open/close 21162 (time 1746127977.46 total 186.36 last 116.17) - open/close 22292 (time 1746127987.46 total 196.36 last 113.00) - open/close 23728 (time 1746127997.46 total 206.37 last 143.50) - open/close 25044 (time 1746128007.47 total 216.37 last 131.58) - open/close 26044 (time 1746128017.47 total 226.37 last 99.99) - open/close 26992 (time 1746128027.47 total 236.38 last 94.75) - open/close 28022 (time 1746128037.47 total 246.38 last 102.97) - open/close 29123 (time 1746128047.48 total 256.39 last 110.02) - open/close 30000 (time 1746128055.00 total 263.91 last 116.59) - open/close 31108 (time 1746128065.01 total 273.91 last 110.77) - open/close 32110 (time 1746128075.02 total 283.92 last 100.11) - open/close 33133 (time 1746128085.02 total 293.92 last 102.29) - open/close 34131 (time 1746128095.02 total 303.93 last 99.74) - open/close 34973 (time 1746128105.03 total 313.94 last 84.10) - open/close 35896 (time 1746128115.04 total 323.94 last 92.26) - open/close 36710 (time 1746128125.05 total 333.95 last 81.33) - open/close 37575 (time 1746128135.05 total 343.95 last 86.48) - open/close 38582 (time 1746128145.05 total 353.95 last 100.69) - open/close 39391 (time 1746128155.06 total 363.97 last 80.80) - open/close 40000 (time 1746128161.90 total 370.80 last 89.10) - open/close 40907 (time 1746128171.90 total 380.81 last 90.65) - open/close 41763 (time 1746128181.91 total 390.81 last 85.56) - open/close 42619 (time 1746128191.91 total 400.82 last 85.55) - open/close 43414 (time 1746128201.92 total 410.82 last 79.45) - open/close 44233 (time 1746128211.92 total 420.83 last 81.87) - open/close 45083 (time 1746128221.95 total 430.85 last 84.78) - open/close 45846 (time 1746128231.95 total 440.86 last 76.28) - open/close 46850 (time 1746128241.95 total 450.86 last 100.39) - open/close 47748 (time 1746128251.96 total 460.86 last 89.74) - open/close 48621 (time 1746128261.99 total 470.89 last 87.08) - open/close 49492 (time 1746128271.99 total 480.90 last 87.04) - open/close 50000 (time 1746128277.86 total 486.77 last 86.55) - open/close 50759 (time 1746128287.87 total 496.77 last 75.88) - open/close 51475 (time 1746128297.88 total 506.78 last 71.53) - open/close 52179 (time 1746128307.88 total 516.78 last 70.39) - open/close 52932 (time 1746128317.88 total 526.79 last 75.26) - open/close 53734 (time 1746128327.89 total 536.79 last 80.17) - open/close 54526 (time 1746128337.89 total 546.79 last 79.20) - open/close 55358 (time 1746128347.90 total 556.80 last 83.14) - open/close 56141 (time 1746128357.91 total 566.81 last 78.22) - open/close 56934 (time 1746128367.91 total 576.81 last 79.30) - open/close 57700 (time 1746128377.92 total 586.82 last 76.51) - open/close 58541 (time 1746128387.92 total 596.82 last 84.09) - open/close 59359 (time 1746128397.92 total 606.83 last 81.77) - open/close 60000 (time 1746128406.39 total 615.30 last 75.66) - open/close 60888 (time 1746128416.40 total 625.31 last 88.73) - open/close 61659 (time 1746128426.40 total 635.31 last 77.08) - open/close 62404 (time 1746128436.41 total 645.31 last 74.48) - open/close 63128 (time 1746128446.41 total 655.31 last 72.39) - open/close 63804 (time 1746128456.42 total 665.33 last 67.51) - open/close 64479 (time 1746128466.44 total 675.34 last 67.38) total: 64768 open/close in 679.67 seconds: 95.29 ops/second - /unlink 602 (time 1746128483.91 total 10.02 last 60.07) - /unlink 1218 (time 1746128493.92 total 20.03 last 61.53) - /unlink 1883 (time 1746128503.92 total 30.03 last 66.49) - /unlink 2570 (time 1746128513.92 total 40.04 last 68.69) - /unlink 3240 (time 1746128523.92 total 50.04 last 67.00) - /unlink 3914 (time 1746128533.92 total 60.04 last 67.40) - /unlink 4594 (time 1746128543.94 total 70.05 last 67.91) - /unlink 5261 (time 1746128553.94 total 80.05 last 66.68) - /unlink 5933 (time 1746128563.95 total 90.06 last 67.14) - /unlink 6537 (time 1746128573.95 total 100.07 last 60.36) - /unlink 7177 (time 1746128583.97 total 110.08 last 63.91) - /unlink 7793 (time 1746128593.97 total 120.08 last 61.59) - /unlink 8432 (time 1746128603.99 total 130.10 last 63.77) - /unlink 9119 (time 1746128614.00 total 140.11 last 68.65) - /unlink 9795 (time 1746128624.02 total 150.13 last 67.46) - /unlink 10000 (time 1746128627.15 total 153.26 last 65.47) - /unlink 10614 (time 1746128637.15 total 163.27 last 61.38) - /unlink 11282 (time 1746128647.16 total 173.27 last 66.77) - /unlink 11971 (time 1746128657.16 total 183.27 last 68.89) - /unlink 12582 (time 1746128667.17 total 193.28 last 61.04) - /unlink 13316 (time 1746128677.17 total 203.29 last 73.38) - /unlink 14062 (time 1746128687.18 total 213.30 last 74.53) - /unlink 14795 (time 1746128697.19 total 223.30 last 73.27) - /unlink 15531 (time 1746128707.20 total 233.31 last 73.52) - /unlink 16271 (time 1746128717.21 total 243.33 last 73.88) - /unlink 16987 (time 1746128727.22 total 253.33 last 71.56) - /unlink 17682 (time 1746128737.23 total 263.34 last 69.45) - /unlink 18343 (time 1746128747.24 total 273.35 last 66.01) - /unlink 19037 (time 1746128757.24 total 283.35 last 69.39) - /unlink 19749 (time 1746128767.25 total 293.36 last 71.14) - /unlink 20000 (time 1746128770.23 total 296.34 last 84.34) - /unlink 20852 (time 1746128780.24 total 306.35 last 85.12) - /unlink 21607 (time 1746128790.25 total 316.36 last 75.41) - /unlink 22409 (time 1746128800.27 total 326.38 last 80.05) - /unlink 23196 (time 1746128810.27 total 336.38 last 78.69) - /unlink 23917 (time 1746128820.27 total 346.38 last 72.08) - /unlink 24591 (time 1746128830.28 total 356.39 last 67.35) - /unlink 25382 (time 1746128840.28 total 366.40 last 79.05) - /unlink 26187 (time 1746128850.30 total 376.41 last 80.38) - /unlink 26990 (time 1746128860.31 total 386.43 last 80.20) - /unlink 27656 (time 1746128870.33 total 396.45 last 66.46) - /unlink 28447 (time 1746128880.35 total 406.46 last 79.01) - /unlink 29202 (time 1746128890.35 total 416.47 last 75.44) - /unlink 29931 (time 1746128900.37 total 426.48 last 72.80) - /unlink 30577 (time 1746128910.38 total 436.49 last 64.52) - /unlink 31231 (time 1746128920.39 total 446.50 last 65.36) - /unlink 31908 (time 1746128930.40 total 456.51 last 67.64) - /unlink 32634 (time 1746128940.40 total 466.51 last 72.59) - /unlink 33332 (time 1746128950.41 total 476.53 last 69.69) - /unlink 34078 (time 1746128960.42 total 486.54 last 74.53) - /unlink 34745 (time 1746128970.43 total 496.54 last 66.67) - /unlink 35393 (time 1746128980.44 total 506.55 last 64.73) - /unlink 35990 (time 1746128990.44 total 516.55 last 59.67) - /unlink 36701 (time 1746129000.44 total 526.56 last 71.08) - /unlink 37344 (time 1746129010.45 total 536.56 last 64.29) - /unlink 38075 (time 1746129020.45 total 546.56 last 73.10) - /unlink 38765 (time 1746129030.45 total 556.57 last 68.94) - /unlink 39460 (time 1746129040.47 total 566.58 last 69.42) - /unlink 40000 (time 1746129048.20 total 574.31 last 69.83) - /unlink 40698 (time 1746129058.20 total 584.32 last 69.77) - /unlink 41360 (time 1746129068.21 total 594.33 last 66.13) - /unlink 41986 (time 1746129078.21 total 604.33 last 62.59) - /unlink 42658 (time 1746129088.22 total 614.34 last 67.15) - /unlink 43433 (time 1746129098.23 total 624.34 last 77.46) - /unlink 44178 (time 1746129108.23 total 634.34 last 74.49) - /unlink 44850 (time 1746129118.23 total 644.35 last 67.18) - /unlink 45643 (time 1746129128.24 total 654.35 last 79.26) - /unlink 46417 (time 1746129138.24 total 664.35 last 77.40) - /unlink 47243 (time 1746129148.25 total 674.36 last 82.51) - /unlink 47997 (time 1746129158.27 total 684.39 last 75.23) - /unlink 48781 (time 1746129168.28 total 694.39 last 78.34) - /unlink 49628 (time 1746129178.28 total 704.40 last 84.66) - /unlink 50000 (time 1746129183.05 total 709.16 last 78.04) - /unlink 50744 (time 1746129193.05 total 719.17 last 74.39) - /unlink 51464 (time 1746129203.06 total 729.17 last 71.95) - /unlink 52141 (time 1746129213.06 total 739.18 last 67.65) - /unlink 52888 (time 1746129223.07 total 749.18 last 74.69) - /unlink 53623 (time 1746129233.07 total 759.18 last 73.48) - /unlink 54417 (time 1746129243.07 total 769.18 last 79.40) - /unlink 55224 (time 1746129253.07 total 779.19 last 80.68) - /unlink 56014 (time 1746129263.07 total 789.19 last 78.98) - /unlink 56772 (time 1746129273.08 total 799.20 last 75.75) - /unlink 57558 (time 1746129283.10 total 809.21 last 78.45) - /unlink 58389 (time 1746129293.11 total 819.23 last 82.98) - /unlink 59255 (time 1746129303.12 total 829.24 last 86.54) - /unlink 60000 (time 1746129311.75 total 837.86 last 86.35) - /unlink 60877 (time 1746129321.76 total 847.87 last 87.62) - /unlink 61652 (time 1746129331.77 total 857.88 last 77.45) - /unlink 62493 (time 1746129341.78 total 867.89 last 83.99) - /unlink 63195 (time 1746129351.78 total 877.90 last 70.17) - /unlink 63929 (time 1746129361.78 total 887.90 last 73.39) - /unlink 64686 (time 1746129371.80 total 897.91 last 75.59) total: 64768 /unlink in 899.03 seconds: 72.04 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 744 (time 1746129404.99 total 10.00 last 74.37) - open/close 1547 (time 1746129415.00 total 20.00 last 80.29) - open/close 2370 (time 1746129425.00 total 30.01 last 82.25) - open/close 3126 (time 1746129435.00 total 40.01 last 75.58) - open/close 3893 (time 1746129445.01 total 50.02 last 76.63) - open/close 4675 (time 1746129455.02 total 60.03 last 78.15) - open/close 5471 (time 1746129465.03 total 70.04 last 79.52) - open/close 6220 (time 1746129475.03 total 80.04 last 74.90) - open/close 7009 (time 1746129485.04 total 90.05 last 78.81) - open/close 7794 (time 1746129495.06 total 100.07 last 78.35) - open/close 8560 (time 1746129505.06 total 110.07 last 76.57) - open/close 9312 (time 1746129515.07 total 120.08 last 75.16) - open/close 10000 (time 1746129523.79 total 128.80 last 78.90) - open/close 10757 (time 1746129533.80 total 138.81 last 75.62) - open/close 11500 (time 1746129543.80 total 148.81 last 74.27) - open/close 12221 (time 1746129553.82 total 158.83 last 72.00) - open/close 12958 (time 1746129563.82 total 168.83 last 73.66) - open/close 13681 (time 1746129573.83 total 178.84 last 72.27) - open/close 14411 (time 1746129583.84 total 188.85 last 72.91) - open/close 15096 (time 1746129593.86 total 198.87 last 68.35) - open/close 15830 (time 1746129603.87 total 208.88 last 73.31) - open/close 16582 (time 1746129613.88 total 218.89 last 75.12) - open/close 17347 (time 1746129623.89 total 228.90 last 76.47) - open/close 18105 (time 1746129633.89 total 238.90 last 75.77) - open/close 18829 (time 1746129643.92 total 248.93 last 72.19) - open/close 19575 (time 1746129653.92 total 258.93 last 74.57) - open/close 20000 (time 1746129659.74 total 264.75 last 73.02) - open/close 20690 (time 1746129669.75 total 274.76 last 68.96) - open/close 21350 (time 1746129679.75 total 284.76 last 65.99) - open/close 22069 (time 1746129689.76 total 294.77 last 71.82) - open/close 22817 (time 1746129699.77 total 304.78 last 74.75) - open/close 23578 (time 1746129709.77 total 314.78 last 76.08) - open/close 24303 (time 1746129719.78 total 324.79 last 72.45) - open/close 25195 (time 1746129729.79 total 334.80 last 89.08) - open/close 26013 (time 1746129739.80 total 344.81 last 81.69) - open/close 26779 (time 1746129749.81 total 354.82 last 76.53) - open/close 27539 (time 1746129759.82 total 364.83 last 75.98) - open/close 28410 (time 1746129769.83 total 374.84 last 87.01) - open/close 29098 (time 1746129779.86 total 384.86 last 68.61) - open/close 29886 (time 1746129789.87 total 394.88 last 78.68) - open/close 30599 (time 1746129799.88 total 404.89 last 71.24) - open/close 31300 (time 1746129809.89 total 414.90 last 70.03) - open/close 31962 (time 1746129819.89 total 424.90 last 66.16) - open/close 32622 (time 1746129829.90 total 434.91 last 65.97) - open/close 33334 (time 1746129839.90 total 444.91 last 71.19) - open/close 34067 (time 1746129849.90 total 454.91 last 73.28) - open/close 34847 (time 1746129859.92 total 464.93 last 77.90) - open/close 35696 (time 1746129869.94 total 474.95 last 84.70) - open/close 36406 (time 1746129879.94 total 484.95 last 70.97) - open/close 37040 (time 1746129889.97 total 494.98 last 63.26) - open/close 37697 (time 1746129899.97 total 504.98 last 65.68) - open/close 38311 (time 1746129909.97 total 514.98 last 61.36) - open/close 38985 (time 1746129919.99 total 525.00 last 67.31) - open/close 39616 (time 1746129929.99 total 535.00 last 63.08) - open/close 40000 (time 1746129935.19 total 540.20 last 73.91) - open/close 40749 (time 1746129945.19 total 550.20 last 74.85) - open/close 41494 (time 1746129955.21 total 560.22 last 74.36) - open/close 42209 (time 1746129965.21 total 570.22 last 71.50) - open/close 42948 (time 1746129975.23 total 580.24 last 73.81) - open/close 43658 (time 1746129985.23 total 590.24 last 70.94) - open/close 44333 (time 1746129995.24 total 600.25 last 67.44) - open/close 45081 (time 1746130005.25 total 610.26 last 74.72) - open/close 45831 (time 1746130015.26 total 620.27 last 74.95) - open/close 46520 (time 1746130025.27 total 630.28 last 68.85) - open/close 47220 (time 1746130035.27 total 640.28 last 69.96) - open/close 47919 (time 1746130045.29 total 650.30 last 69.77) - open/close 48688 (time 1746130055.29 total 660.30 last 76.90) - open/close 49434 (time 1746130065.30 total 670.31 last 74.58) - open/close 50000 (time 1746130073.63 total 678.64 last 67.88) - open/close 50758 (time 1746130083.64 total 688.65 last 75.74) - open/close 51459 (time 1746130093.65 total 698.66 last 70.04) - open/close 52218 (time 1746130103.66 total 708.67 last 75.84) - open/close 52889 (time 1746130113.66 total 718.67 last 67.08) - open/close 53632 (time 1746130123.67 total 728.68 last 74.25) - open/close 54313 (time 1746130133.67 total 738.68 last 68.08) - open/close 55098 (time 1746130143.68 total 748.69 last 78.43) - open/close 55935 (time 1746130153.69 total 758.70 last 83.64) - open/close 56809 (time 1746130163.69 total 768.70 last 87.37) - open/close 57633 (time 1746130173.70 total 778.71 last 82.30) - open/close 58461 (time 1746130183.71 total 788.72 last 82.77) - open/close 59253 (time 1746130193.71 total 798.72 last 79.16) - open/close 59958 (time 1746130203.71 total 808.72 last 70.49) - open/close 60725 (time 1746130213.72 total 818.73 last 76.65) - open/close 61480 (time 1746130223.72 total 828.73 last 75.47) - open/close 62218 (time 1746130233.73 total 838.74 last 73.76) - open/close 63002 (time 1746130243.73 total 848.74 last 78.39) - open/close 63942 (time 1746130253.73 total 858.74 last 93.99) - open/close 64739 (time 1746130263.73 total 868.74 last 79.68) total: 64768 open/close in 869.04 seconds: 74.53 ops/second - /unlink 797 (time 1746130276.93 total 10.01 last 79.62) - /unlink 1579 (time 1746130286.94 total 20.02 last 78.13) - /unlink 2322 (time 1746130296.95 total 30.03 last 74.25) - /unlink 3006 (time 1746130306.98 total 40.06 last 68.20) - /unlink 3620 (time 1746130316.99 total 50.07 last 61.29) - /unlink 4272 (time 1746130327.00 total 60.08 last 65.16) - /unlink 4961 (time 1746130337.02 total 70.10 last 68.78) - /unlink 5626 (time 1746130347.02 total 80.10 last 66.50) - /unlink 6349 (time 1746130357.03 total 90.11 last 72.23) - /unlink 7074 (time 1746130367.03 total 100.11 last 72.49) - /unlink 7853 (time 1746130377.04 total 110.12 last 77.78) - /unlink 8562 (time 1746130387.06 total 120.14 last 70.80) - /unlink 9298 (time 1746130397.07 total 130.15 last 73.49) - /unlink 10000 (time 1746130406.47 total 139.55 last 74.72) - /unlink 10761 (time 1746130416.50 total 149.58 last 75.88) - /unlink 11533 (time 1746130426.50 total 159.58 last 77.15) - /unlink 12361 (time 1746130436.51 total 169.59 last 82.73) - /unlink 12994 (time 1746130446.52 total 179.60 last 63.25) - /unlink 13709 (time 1746130456.55 total 189.63 last 71.25) - /unlink 14575 (time 1746130466.58 total 199.66 last 86.39) - /unlink 15390 (time 1746130476.58 total 209.66 last 81.47) - /unlink 16282 (time 1746130486.58 total 219.66 last 89.18) - /unlink 17169 (time 1746130496.59 total 229.67 last 88.68) - /unlink 18052 (time 1746130506.59 total 239.67 last 88.26) - /unlink 18882 (time 1746130516.61 total 249.69 last 82.85) - /unlink 19692 (time 1746130526.62 total 259.70 last 80.93) - /unlink 20000 (time 1746130530.07 total 263.15 last 89.24) - /unlink 20880 (time 1746130540.08 total 273.16 last 87.87) - /unlink 21628 (time 1746130550.09 total 283.17 last 74.75) - /unlink 22395 (time 1746130560.10 total 293.18 last 76.64) - /unlink 23214 (time 1746130570.10 total 303.18 last 81.89) - /unlink 23975 (time 1746130580.11 total 313.19 last 76.02) - /unlink 24809 (time 1746130590.12 total 323.20 last 83.30) - /unlink 25561 (time 1746130600.13 total 333.21 last 75.17) - /unlink 26308 (time 1746130610.14 total 343.21 last 74.64) - /unlink 27162 (time 1746130620.14 total 353.22 last 85.37) - /unlink 27960 (time 1746130630.14 total 363.22 last 79.79) - /unlink 28896 (time 1746130640.14 total 373.22 last 93.56) - /unlink 29694 (time 1746130650.14 total 383.22 last 79.80) - /unlink 30000 (time 1746130653.85 total 386.93 last 82.63) - /unlink 30798 (time 1746130663.86 total 396.94 last 79.67) - /unlink 31586 (time 1746130673.87 total 406.95 last 78.77) - /unlink 32481 (time 1746130683.87 total 416.95 last 89.49) - /unlink 33379 (time 1746130693.87 total 426.95 last 89.77) - /unlink 34328 (time 1746130703.88 total 436.96 last 94.87) - /unlink 35224 (time 1746130713.88 total 446.96 last 89.60) - /unlink 36074 (time 1746130723.88 total 456.96 last 84.96) - /unlink 36936 (time 1746130733.89 total 466.97 last 86.13) - /unlink 37895 (time 1746130743.90 total 476.98 last 95.83) - /unlink 38870 (time 1746130753.90 total 486.98 last 97.46) - /unlink 39828 (time 1746130763.91 total 496.99 last 95.67) - /unlink 40635 (time 1746130773.91 total 506.99 last 80.69) - /unlink 41579 (time 1746130783.92 total 517.00 last 94.30) - /unlink 42470 (time 1746130793.93 total 527.01 last 89.03) - /unlink 43236 (time 1746130803.94 total 537.02 last 76.54) - /unlink 44064 (time 1746130813.95 total 547.03 last 82.71) - /unlink 44952 (time 1746130823.95 total 557.03 last 88.78) - /unlink 45868 (time 1746130833.95 total 567.03 last 91.60) - /unlink 46708 (time 1746130843.96 total 577.04 last 83.97) - /unlink 47596 (time 1746130853.96 total 587.04 last 88.76) - /unlink 48561 (time 1746130863.96 total 597.04 last 96.49) - /unlink 49491 (time 1746130873.97 total 607.05 last 92.95) - /unlink 50000 (time 1746130879.40 total 612.48 last 93.74) - /unlink 50796 (time 1746130889.41 total 622.49 last 79.54) - /unlink 51631 (time 1746130899.41 total 632.49 last 83.48) - /unlink 52592 (time 1746130909.42 total 642.50 last 96.00) - /unlink 53422 (time 1746130919.42 total 652.50 last 82.97) - /unlink 54169 (time 1746130929.43 total 662.51 last 74.64) - /unlink 54790 (time 1746130939.44 total 672.51 last 62.07) - /unlink 55628 (time 1746130949.44 total 682.52 last 83.74) - /unlink 56469 (time 1746130959.45 total 692.53 last 84.06) - /unlink 57356 (time 1746130969.46 total 702.54 last 88.60) - /unlink 58136 (time 1746130979.47 total 712.55 last 77.93) - /unlink 58989 (time 1746130989.48 total 722.55 last 85.22) - /unlink 59924 (time 1746130999.48 total 732.56 last 93.47) - /unlink 60811 (time 1746131009.48 total 742.56 last 88.69) - /unlink 61666 (time 1746131019.49 total 752.57 last 85.43) - /unlink 62511 (time 1746131029.50 total 762.58 last 84.39) - /unlink 63336 (time 1746131039.52 total 772.60 last 82.38) - /unlink 64270 (time 1746131049.52 total 782.60 last 93.38) total: 64768 /unlink in 787.96 seconds: 82.20 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete