-----============= acceptance-small: conf-sanity ============----- Thu May 1 15:03:56 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg117-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex: No such file or directory excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg117-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg117-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg117-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg117-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg117-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg117-server oleg117-server: oleg117-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory loading modules on: 'oleg117-server' oleg117-server: oleg117-server.virtnet: executing load_modules_local oleg117-server: Loading modules from /home/green/git/lustre-release/lustre oleg117-server: detected 4 online CPUs by sysfs oleg117-server: MODOPTS_LIBCFS= oleg117-server: Force libcfs to create 2 CPU partitions oleg117-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg117-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg117-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg117-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg117-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg117-server: oleg117-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg117-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg117-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg117-server stop mds service on oleg117-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg117-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 15:05:24 (1746126324) Stopping clients: oleg117-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg117-client.virtnet /mnt/lustre2 (opts:-f) oleg117-server: oleg117-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg117-server' oleg117-server: oleg117-server.virtnet: executing load_modules_local oleg117-server: Loading modules from /home/green/git/lustre-release/lustre oleg117-server: detected 4 online CPUs by sysfs oleg117-server: MODOPTS_LIBCFS= oleg117-server: Force libcfs to create 2 CPU partitions oleg117-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg117-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg117-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg117-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg117-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg117-client.virtnet: -o user_xattr,flock 192.168.201.117@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 32648 392 32256 2% /mnt/lustre[OST:0] filesystem_summary: 32585 329 32256 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 917 (time 1746126394.68 total 10.01 last 91.63) - open/close 1742 (time 1746126404.69 total 20.02 last 82.42) - open/close 2604 (time 1746126414.70 total 30.03 last 86.12) - open/close 3519 (time 1746126424.70 total 40.03 last 91.48) - open/close 4523 (time 1746126434.70 total 50.03 last 100.39) - open/close 5534 (time 1746126444.71 total 60.04 last 101.04) - open/close 6556 (time 1746126454.71 total 70.04 last 102.11) - open/close 7505 (time 1746126464.72 total 80.05 last 94.85) - open/close 8466 (time 1746126474.73 total 90.07 last 95.95) - open/close 9374 (time 1746126484.75 total 100.08 last 90.65) - open/close 10000 (time 1746126492.85 total 108.18 last 77.30) - open/close 10828 (time 1746126502.85 total 118.18 last 82.77) - open/close 11722 (time 1746126512.85 total 128.19 last 89.39) - open/close 12620 (time 1746126522.86 total 138.19 last 89.75) - open/close 13436 (time 1746126532.87 total 148.20 last 81.50) - open/close 14338 (time 1746126542.88 total 158.21 last 90.15) - open/close 15190 (time 1746126552.88 total 168.21 last 85.18) - open/close 16130 (time 1746126562.89 total 178.22 last 93.93) - open/close 17069 (time 1746126572.90 total 188.23 last 93.83) - open/close 18020 (time 1746126582.90 total 198.23 last 95.04) - open/close 18985 (time 1746126592.91 total 208.24 last 96.45) - open/close 19772 (time 1746126602.92 total 218.25 last 78.60) - open/close 20000 (time 1746126606.20 total 221.53 last 69.60) - open/close 20815 (time 1746126616.20 total 231.53 last 81.44) - open/close 21650 (time 1746126626.20 total 241.54 last 83.50) - open/close 22697 (time 1746126636.21 total 251.54 last 104.69) - open/close 23806 (time 1746126646.21 total 261.54 last 110.89) - open/close 24988 (time 1746126656.21 total 271.54 last 118.13) - open/close 26025 (time 1746126666.21 total 281.54 last 103.69) - open/close 27127 (time 1746126676.22 total 291.55 last 110.17) - open/close 28214 (time 1746126686.22 total 301.55 last 108.69) - open/close 29215 (time 1746126696.22 total 311.55 last 100.05) - open/close 30000 (time 1746126704.12 total 319.45 last 99.42) - open/close 31014 (time 1746126714.12 total 329.45 last 101.37) - open/close 31854 (time 1746126724.12 total 339.45 last 83.99) - open/close 32668 (time 1746126734.13 total 349.46 last 81.36) - open/close 33448 (time 1746126744.13 total 359.47 last 77.94) - open/close 34394 (time 1746126754.14 total 369.47 last 94.58) - open/close 35409 (time 1746126764.14 total 379.47 last 101.50) - open/close 36342 (time 1746126774.14 total 389.48 last 93.23) - open/close 37395 (time 1746126784.16 total 399.49 last 105.19) - open/close 38296 (time 1746126794.16 total 409.49 last 90.07) - open/close 39349 (time 1746126804.16 total 419.50 last 105.24) - open/close 40000 (time 1746126810.53 total 425.86 last 102.23) - open/close 41140 (time 1746126820.54 total 435.87 last 113.96) - open/close 42059 (time 1746126830.54 total 445.87 last 91.84) - open/close 43087 (time 1746126840.56 total 455.89 last 102.62) - open/close 44084 (time 1746126850.56 total 465.89 last 99.69) - open/close 45070 (time 1746126860.56 total 475.89 last 98.59) - open/close 46143 (time 1746126870.57 total 485.90 last 107.19) - open/close 47294 (time 1746126880.58 total 495.92 last 114.97) - open/close 48225 (time 1746126890.59 total 505.92 last 93.07) - open/close 49096 (time 1746126900.60 total 515.93 last 87.00) - open/close 49929 (time 1746126910.62 total 525.95 last 83.17) - open/close 50889 (time 1746126920.62 total 535.96 last 95.91) - open/close 52020 (time 1746126930.63 total 545.97 last 112.99) - open/close 53236 (time 1746126940.64 total 555.98 last 121.48) - open/close 54228 (time 1746126950.65 total 565.98 last 99.12) - open/close 55201 (time 1746126960.66 total 575.99 last 97.24) - open/close 56144 (time 1746126970.66 total 585.99 last 94.29) - open/close 57061 (time 1746126980.66 total 595.99 last 91.69) - open/close 58073 (time 1746126990.68 total 606.01 last 101.04) - open/close 59134 (time 1746127000.68 total 616.01 last 106.09) - open/close 60000 (time 1746127009.49 total 624.82 last 98.27) - open/close 60941 (time 1746127019.50 total 634.83 last 94.05) - open/close 61906 (time 1746127029.50 total 644.83 last 96.50) - open/close 62897 (time 1746127039.50 total 654.83 last 99.02) - open/close 63994 (time 1746127049.51 total 664.84 last 109.62) total: 64768 open/close in 672.18 seconds: 96.36 ops/second - /unlink 1166 (time 1746127068.89 total 10.01 last 116.50) - /unlink 2411 (time 1746127078.89 total 20.01 last 124.47) - /unlink 3527 (time 1746127088.90 total 30.02 last 111.50) - /unlink 4700 (time 1746127098.90 total 40.02 last 117.25) - /unlink 5987 (time 1746127108.90 total 50.03 last 128.67) - /unlink 7404 (time 1746127118.91 total 60.04 last 141.57) - /unlink 8543 (time 1746127128.92 total 70.04 last 113.82) - /unlink 9609 (time 1746127138.92 total 80.04 last 106.59) - /unlink 10000 (time 1746127142.23 total 83.35 last 118.34) - /unlink 11318 (time 1746127152.23 total 93.35 last 131.79) - /unlink 12471 (time 1746127162.23 total 103.35 last 115.29) - /unlink 13902 (time 1746127172.24 total 113.36 last 142.98) - /unlink 15015 (time 1746127182.24 total 123.36 last 111.25) - /unlink 16217 (time 1746127192.25 total 133.37 last 120.11) - /unlink 17558 (time 1746127202.26 total 143.38 last 133.93) - /unlink 18644 (time 1746127212.27 total 153.39 last 108.49) - /unlink 19817 (time 1746127222.29 total 163.41 last 117.11) - /unlink 20895 (time 1746127232.29 total 173.42 last 107.72) - /unlink 22123 (time 1746127242.30 total 183.42 last 122.75) - /unlink 23389 (time 1746127252.30 total 193.42 last 126.58) - /unlink 24488 (time 1746127262.31 total 203.43 last 109.82) - /unlink 25580 (time 1746127272.31 total 213.43 last 109.18) - /unlink 26657 (time 1746127282.31 total 223.43 last 107.67) - /unlink 27716 (time 1746127292.32 total 233.44 last 105.84) - /unlink 28743 (time 1746127302.32 total 243.44 last 102.69) - /unlink 29802 (time 1746127312.34 total 253.46 last 105.66) - /unlink 30000 (time 1746127314.55 total 255.67 last 89.82) - /unlink 30960 (time 1746127324.56 total 265.68 last 95.84) - /unlink 31786 (time 1746127334.57 total 275.69 last 82.56) - /unlink 32718 (time 1746127344.57 total 285.70 last 93.13) - /unlink 33791 (time 1746127354.58 total 295.71 last 107.19) - /unlink 34683 (time 1746127364.59 total 305.71 last 89.14) - /unlink 35753 (time 1746127374.60 total 315.72 last 106.96) - /unlink 36867 (time 1746127384.60 total 325.72 last 111.33) - /unlink 38057 (time 1746127394.60 total 335.72 last 119.00) - /unlink 39042 (time 1746127404.60 total 345.72 last 98.49) - /unlink 40000 (time 1746127414.07 total 355.19 last 101.17) - /unlink 41242 (time 1746127424.08 total 365.20 last 124.15) - /unlink 42629 (time 1746127434.08 total 375.21 last 138.58) - /unlink 44290 (time 1746127444.09 total 385.21 last 166.09) - /unlink 45795 (time 1746127454.09 total 395.21 last 150.45) - /unlink 47295 (time 1746127464.10 total 405.22 last 149.87) - /unlink 48964 (time 1746127474.10 total 415.22 last 166.90) - /unlink 50000 (time 1746127479.93 total 421.05 last 177.62) - /unlink 51966 (time 1746127489.93 total 431.05 last 196.59) - /unlink 53716 (time 1746127499.93 total 441.05 last 174.98) - /unlink 55696 (time 1746127509.93 total 451.06 last 197.96) - /unlink 57868 (time 1746127519.93 total 461.06 last 217.20) - /unlink 60000 (time 1746127529.13 total 470.25 last 231.79) - /unlink 62132 (time 1746127539.13 total 480.25 last 213.18) - /unlink 63930 (time 1746127549.14 total 490.26 last 179.74) total: 64768 /unlink in 495.94 seconds: 130.60 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1083 (time 1746127585.91 total 10.01 last 108.19) - open/close 2213 (time 1746127595.92 total 20.01 last 112.95) - open/close 3271 (time 1746127605.92 total 30.02 last 105.73) - open/close 4325 (time 1746127615.93 total 40.02 last 105.37) - open/close 5276 (time 1746127625.93 total 50.02 last 95.10) - open/close 6430 (time 1746127635.93 total 60.03 last 115.36) - open/close 7717 (time 1746127645.95 total 70.05 last 128.44) - open/close 8887 (time 1746127655.96 total 80.05 last 116.94) - open/close 10000 (time 1746127664.72 total 88.82 last 127.02) - open/close 10893 (time 1746127674.72 total 98.82 last 89.29) - open/close 11942 (time 1746127684.72 total 108.82 last 104.89) - open/close 13311 (time 1746127694.72 total 118.82 last 136.88) - open/close 14813 (time 1746127704.72 total 128.82 last 150.18) - open/close 16193 (time 1746127714.73 total 138.83 last 137.89) - open/close 17372 (time 1746127724.73 total 148.83 last 117.86) - open/close 18660 (time 1746127734.74 total 158.84 last 128.74) - open/close 19743 (time 1746127744.75 total 168.84 last 108.23) - open/close 20000 (time 1746127747.12 total 171.22 last 108.04) - open/close 21175 (time 1746127757.13 total 181.22 last 117.49) - open/close 22454 (time 1746127767.13 total 191.23 last 127.80) - open/close 23819 (time 1746127777.13 total 201.23 last 136.50) - open/close 25136 (time 1746127787.15 total 211.25 last 131.44) - open/close 26352 (time 1746127797.15 total 221.25 last 121.59) - open/close 27734 (time 1746127807.16 total 231.26 last 138.15) - open/close 29136 (time 1746127817.16 total 241.26 last 140.14) - open/close 30000 (time 1746127824.17 total 248.27 last 123.24) - open/close 31360 (time 1746127834.18 total 258.27 last 135.98) - open/close 32862 (time 1746127844.18 total 268.28 last 150.16) - open/close 34033 (time 1746127854.18 total 278.28 last 117.02) - open/close 35489 (time 1746127864.19 total 288.28 last 145.57) - open/close 36923 (time 1746127874.19 total 298.29 last 143.37) - open/close 38473 (time 1746127884.19 total 308.29 last 154.91) - open/close 39770 (time 1746127894.20 total 318.29 last 129.68) - open/close 40000 (time 1746127896.20 total 320.30 last 114.82) - open/close 41557 (time 1746127906.20 total 330.30 last 155.63) - open/close 42929 (time 1746127916.20 total 340.30 last 137.19) - open/close 44221 (time 1746127926.21 total 350.31 last 129.16) - open/close 45659 (time 1746127936.22 total 360.32 last 143.63) - open/close 46974 (time 1746127946.22 total 370.32 last 131.44) - open/close 48478 (time 1746127956.23 total 380.32 last 150.36) - open/close 49840 (time 1746127966.24 total 390.33 last 136.09) - open/close 51217 (time 1746127976.24 total 400.34 last 137.63) - open/close 52544 (time 1746127986.26 total 410.36 last 132.46) - open/close 54221 (time 1746127996.27 total 420.36 last 167.58) - open/close 55920 (time 1746128006.27 total 430.37 last 169.79) - open/close 57252 (time 1746128016.28 total 440.38 last 133.11) - open/close 58430 (time 1746128026.29 total 450.39 last 117.70) - open/close 59699 (time 1746128036.29 total 460.39 last 126.82) - open/close 60000 (time 1746128038.49 total 462.59 last 137.17) - open/close 61385 (time 1746128048.49 total 472.59 last 138.44) - open/close 62813 (time 1746128058.50 total 482.60 last 142.74) - open/close 64154 (time 1746128068.50 total 492.60 last 134.09) total: 64768 open/close in 497.79 seconds: 130.11 ops/second - /unlink 2147 (time 1746128085.61 total 10.00 last 214.63) - /unlink 4107 (time 1746128095.61 total 20.00 last 195.99) - /unlink 5891 (time 1746128105.61 total 30.01 last 178.35) - /unlink 7863 (time 1746128115.62 total 40.01 last 197.06) - /unlink 9435 (time 1746128125.63 total 50.02 last 157.11) - /unlink 10000 (time 1746128128.72 total 53.11 last 182.52) - /unlink 12067 (time 1746128138.72 total 63.12 last 206.64) - /unlink 14266 (time 1746128148.72 total 73.12 last 219.89) - /unlink 15986 (time 1746128158.73 total 83.13 last 171.87) - /unlink 18005 (time 1746128168.73 total 93.13 last 201.85) - /unlink 19879 (time 1746128178.74 total 103.13 last 187.37) - /unlink 21603 (time 1746128188.74 total 113.13 last 172.36) - /unlink 23288 (time 1746128198.74 total 123.13 last 168.44) - /unlink 25006 (time 1746128208.75 total 133.14 last 171.68) - /unlink 26735 (time 1746128218.75 total 143.14 last 172.88) - /unlink 28421 (time 1746128228.75 total 153.15 last 168.53) - /unlink 30000 (time 1746128237.37 total 161.76 last 183.33) - /unlink 32019 (time 1746128247.37 total 171.76 last 201.85) - /unlink 33982 (time 1746128257.37 total 181.77 last 196.21) - /unlink 35729 (time 1746128267.38 total 191.77 last 174.66) - /unlink 37543 (time 1746128277.38 total 201.77 last 181.35) - /unlink 38926 (time 1746128287.38 total 211.77 last 138.27) - /unlink 40000 (time 1746128294.87 total 219.27 last 143.35) - /unlink 41624 (time 1746128304.88 total 229.28 last 162.25) - /unlink 43357 (time 1746128314.89 total 239.28 last 173.21) - /unlink 45140 (time 1746128324.89 total 249.28 last 178.25) - /unlink 46832 (time 1746128334.89 total 259.29 last 169.17) - /unlink 48533 (time 1746128344.89 total 269.29 last 170.09) - /unlink 50000 (time 1746128354.00 total 278.40 last 161.01) - /unlink 51538 (time 1746128364.01 total 288.40 last 153.75) - /unlink 52998 (time 1746128374.01 total 298.40 last 146.00) - /unlink 54648 (time 1746128384.01 total 308.40 last 164.98) - /unlink 56479 (time 1746128394.01 total 318.40 last 183.08) - /unlink 58084 (time 1746128404.02 total 328.41 last 160.35) - /unlink 59694 (time 1746128414.02 total 338.42 last 160.95) - /unlink 61196 (time 1746128424.04 total 348.43 last 149.98) - /unlink 62706 (time 1746128434.04 total 358.43 last 150.96) - /unlink 64194 (time 1746128444.04 total 368.43 last 148.77) total: 64768 /unlink in 371.60 seconds: 174.29 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 841 (time 1746128476.42 total 10.00 last 84.09) - open/close 1690 (time 1746128486.42 total 20.01 last 84.83) - open/close 2603 (time 1746128496.42 total 30.01 last 91.30) - open/close 3572 (time 1746128506.42 total 40.01 last 96.89) - open/close 4539 (time 1746128516.43 total 50.02 last 96.63) - open/close 5473 (time 1746128526.45 total 60.03 last 93.27) - open/close 6410 (time 1746128536.45 total 70.03 last 93.68) - open/close 7356 (time 1746128546.45 total 80.04 last 94.56) - open/close 8211 (time 1746128556.47 total 90.05 last 85.37) - open/close 8962 (time 1746128566.49 total 100.08 last 74.93) - open/close 9850 (time 1746128576.50 total 110.08 last 88.72) - open/close 10672 (time 1746128586.52 total 120.10 last 82.03) - open/close 11504 (time 1746128596.52 total 130.11 last 83.19) - open/close 12391 (time 1746128606.53 total 140.11 last 88.64) - open/close 13244 (time 1746128616.54 total 150.13 last 85.19) - open/close 14070 (time 1746128626.54 total 160.13 last 82.57) - open/close 14818 (time 1746128636.54 total 170.13 last 74.79) - open/close 15590 (time 1746128646.57 total 180.15 last 77.04) - open/close 16509 (time 1746128656.57 total 190.16 last 91.86) - open/close 17307 (time 1746128666.57 total 200.16 last 79.77) - open/close 18236 (time 1746128676.57 total 210.16 last 92.89) - open/close 19195 (time 1746128686.57 total 220.16 last 95.90) - open/close 20000 (time 1746128695.54 total 229.13 last 89.74) - open/close 20810 (time 1746128705.55 total 239.14 last 80.94) - open/close 21622 (time 1746128715.56 total 249.15 last 81.14) - open/close 22487 (time 1746128725.59 total 259.17 last 86.25) - open/close 23300 (time 1746128735.61 total 269.20 last 81.09) - open/close 24032 (time 1746128745.62 total 279.21 last 73.14) - open/close 24912 (time 1746128755.62 total 289.21 last 88.00) - open/close 25825 (time 1746128765.64 total 299.22 last 91.19) - open/close 26756 (time 1746128775.64 total 309.23 last 93.07) - open/close 27714 (time 1746128785.64 total 319.23 last 95.79) - open/close 28632 (time 1746128795.65 total 329.23 last 91.75) - open/close 29470 (time 1746128805.65 total 339.24 last 83.75) - open/close 30000 (time 1746128811.33 total 344.91 last 93.38) - open/close 30878 (time 1746128821.33 total 354.92 last 87.78) - open/close 31733 (time 1746128831.34 total 364.92 last 85.44) - open/close 32624 (time 1746128841.35 total 374.93 last 89.00) - open/close 33519 (time 1746128851.35 total 384.94 last 89.44) - open/close 34344 (time 1746128861.36 total 394.95 last 82.45) - open/close 35176 (time 1746128871.37 total 404.95 last 83.14) - open/close 36042 (time 1746128881.38 total 414.96 last 86.50) - open/close 36875 (time 1746128891.39 total 424.98 last 83.18) - open/close 37693 (time 1746128901.40 total 434.99 last 81.70) - open/close 38561 (time 1746128911.43 total 445.02 last 86.57) - open/close 39397 (time 1746128921.44 total 455.03 last 83.49) - open/close 40000 (time 1746128928.72 total 462.30 last 82.91) - open/close 40849 (time 1746128938.72 total 472.30 last 84.89) - open/close 41663 (time 1746128948.72 total 482.30 last 81.39) - open/close 42491 (time 1746128958.73 total 492.32 last 82.70) - open/close 43338 (time 1746128968.73 total 502.32 last 84.69) - open/close 44187 (time 1746128978.73 total 512.32 last 84.90) - open/close 45007 (time 1746128988.73 total 522.32 last 81.98) - open/close 45867 (time 1746128998.74 total 532.33 last 85.95) - open/close 46650 (time 1746129008.74 total 542.33 last 78.29) - open/close 47503 (time 1746129018.75 total 552.33 last 85.24) - open/close 48323 (time 1746129028.75 total 562.34 last 81.99) - open/close 49170 (time 1746129038.77 total 572.36 last 84.50) - open/close 50000 (time 1746129048.60 total 582.18 last 84.48) - open/close 50842 (time 1746129058.60 total 592.19 last 84.17) - open/close 51708 (time 1746129068.60 total 602.19 last 86.59) - open/close 52434 (time 1746129078.61 total 612.19 last 72.58) - open/close 53262 (time 1746129088.61 total 622.20 last 82.74) - open/close 54017 (time 1746129098.62 total 632.20 last 75.47) - open/close 54814 (time 1746129108.63 total 642.22 last 79.60) - open/close 55549 (time 1746129118.64 total 652.22 last 73.44) - open/close 56399 (time 1746129128.65 total 662.23 last 84.93) - open/close 57351 (time 1746129138.65 total 672.24 last 95.16) - open/close 58233 (time 1746129148.66 total 682.25 last 88.10) - open/close 59047 (time 1746129158.67 total 692.26 last 81.34) - open/close 59874 (time 1746129168.67 total 702.26 last 82.68) - open/close 60750 (time 1746129178.67 total 712.26 last 87.59) - open/close 61584 (time 1746129188.69 total 722.27 last 83.28) - open/close 62400 (time 1746129198.69 total 732.28 last 81.55) - open/close 63173 (time 1746129208.70 total 742.29 last 77.20) - open/close 64008 (time 1746129218.71 total 752.30 last 83.46) total: 64768 open/close in 760.41 seconds: 85.18 ops/second - /unlink 883 (time 1746129239.38 total 10.00 last 88.26) - /unlink 1783 (time 1746129249.39 total 20.01 last 89.96) - /unlink 2620 (time 1746129259.39 total 30.01 last 83.68) - /unlink 3401 (time 1746129269.39 total 40.01 last 78.09) - /unlink 4303 (time 1746129279.39 total 50.01 last 90.19) - /unlink 5177 (time 1746129289.41 total 60.03 last 87.25) - /unlink 6241 (time 1746129299.41 total 70.03 last 106.40) - /unlink 7246 (time 1746129309.41 total 80.03 last 100.49) - /unlink 8273 (time 1746129319.42 total 90.04 last 102.65) - /unlink 9234 (time 1746129329.42 total 100.04 last 96.10) - /unlink 10000 (time 1746129337.65 total 108.26 last 93.10) - /unlink 10799 (time 1746129347.65 total 118.27 last 79.88) - /unlink 11652 (time 1746129357.65 total 128.27 last 85.26) - /unlink 12500 (time 1746129367.66 total 138.28 last 84.75) - /unlink 13394 (time 1746129377.66 total 148.28 last 89.36) - /unlink 14361 (time 1746129387.68 total 158.30 last 96.56) - /unlink 15210 (time 1746129397.69 total 168.31 last 84.83) - /unlink 15994 (time 1746129407.69 total 178.31 last 78.38) - /unlink 16932 (time 1746129417.70 total 188.32 last 93.72) - /unlink 17865 (time 1746129427.71 total 198.33 last 93.21) - /unlink 18706 (time 1746129437.71 total 208.33 last 84.06) - /unlink 19533 (time 1746129447.72 total 218.34 last 82.64) - /unlink 20000 (time 1746129452.68 total 223.30 last 94.13) - /unlink 20916 (time 1746129462.69 total 233.31 last 91.55) - /unlink 21768 (time 1746129472.71 total 243.33 last 84.95) - /unlink 22759 (time 1746129482.73 total 253.34 last 99.00) - /unlink 23725 (time 1746129492.73 total 263.35 last 96.56) - /unlink 24592 (time 1746129502.74 total 273.36 last 86.62) - /unlink 25461 (time 1746129512.74 total 283.36 last 86.88) - /unlink 26440 (time 1746129522.75 total 293.37 last 97.81) - /unlink 27350 (time 1746129532.76 total 303.38 last 90.95) - /unlink 28314 (time 1746129542.76 total 313.38 last 96.33) - /unlink 29158 (time 1746129552.76 total 323.38 last 84.39) - /unlink 29922 (time 1746129562.77 total 333.39 last 76.36) - /unlink 30862 (time 1746129572.78 total 343.40 last 93.89) - /unlink 31740 (time 1746129582.79 total 353.40 last 87.76) - /unlink 32671 (time 1746129592.79 total 363.41 last 93.09) - /unlink 33560 (time 1746129602.80 total 373.42 last 88.76) - /unlink 34514 (time 1746129612.81 total 383.43 last 95.35) - /unlink 35447 (time 1746129622.81 total 393.43 last 93.29) - /unlink 36372 (time 1746129632.81 total 403.43 last 92.46) - /unlink 37221 (time 1746129642.81 total 413.43 last 84.89) - /unlink 38103 (time 1746129652.82 total 423.44 last 88.13) - /unlink 39005 (time 1746129662.84 total 433.45 last 90.08) - /unlink 39825 (time 1746129672.84 total 443.46 last 81.95) - /unlink 40652 (time 1746129682.85 total 453.47 last 82.65) - /unlink 41456 (time 1746129692.85 total 463.47 last 80.40) - /unlink 42340 (time 1746129702.86 total 473.47 last 88.33) - /unlink 43205 (time 1746129712.86 total 483.48 last 86.43) - /unlink 44177 (time 1746129722.87 total 493.49 last 97.12) - /unlink 45283 (time 1746129732.87 total 503.49 last 110.59) - /unlink 46133 (time 1746129742.88 total 513.49 last 84.98) - /unlink 46984 (time 1746129752.88 total 523.50 last 85.07) - /unlink 47851 (time 1746129762.88 total 533.50 last 86.65) - /unlink 48796 (time 1746129772.89 total 543.51 last 94.47) - /unlink 49669 (time 1746129782.89 total 553.51 last 87.26) - /unlink 50000 (time 1746129786.56 total 557.18 last 90.28) - /unlink 50843 (time 1746129796.57 total 567.19 last 84.16) - /unlink 51711 (time 1746129806.59 total 577.21 last 86.66) - /unlink 52507 (time 1746129816.60 total 587.21 last 79.56) - /unlink 53443 (time 1746129826.60 total 597.22 last 93.54) - /unlink 54397 (time 1746129836.61 total 607.23 last 95.33) - /unlink 55399 (time 1746129846.61 total 617.23 last 100.20) - /unlink 56286 (time 1746129856.61 total 627.23 last 88.69) - /unlink 57226 (time 1746129866.62 total 637.24 last 93.90) - /unlink 58184 (time 1746129876.63 total 647.25 last 95.72) - /unlink 59131 (time 1746129886.64 total 657.26 last 94.60) - /unlink 60000 (time 1746129896.23 total 666.85 last 90.63) - /unlink 60886 (time 1746129906.25 total 676.87 last 88.43) - /unlink 61734 (time 1746129916.25 total 686.87 last 84.78) - /unlink 62630 (time 1746129926.27 total 696.89 last 89.47) - /unlink 63509 (time 1746129936.27 total 706.89 last 87.90) - /unlink 64425 (time 1746129946.27 total 716.89 last 91.56) total: 64768 /unlink in 721.43 seconds: 89.78 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 923 (time 1746129980.84 total 10.02 last 92.14) - open/close 1771 (time 1746129990.84 total 20.02 last 84.77) - open/close 2640 (time 1746130000.85 total 30.03 last 86.83) - open/close 3575 (time 1746130010.86 total 40.04 last 93.40) - open/close 4608 (time 1746130020.87 total 50.05 last 103.20) - open/close 5523 (time 1746130030.87 total 60.05 last 91.44) - open/close 6453 (time 1746130040.88 total 70.06 last 92.98) - open/close 7394 (time 1746130050.88 total 80.06 last 94.06) - open/close 8368 (time 1746130060.90 total 90.08 last 97.23) - open/close 9264 (time 1746130070.90 total 100.08 last 89.59) - open/close 10000 (time 1746130079.09 total 108.27 last 89.85) - open/close 10918 (time 1746130089.10 total 118.28 last 91.74) - open/close 11831 (time 1746130099.10 total 128.28 last 91.27) - open/close 12714 (time 1746130109.10 total 138.28 last 88.26) - open/close 13590 (time 1746130119.10 total 148.29 last 87.59) - open/close 14511 (time 1746130129.11 total 158.29 last 92.05) - open/close 15465 (time 1746130139.11 total 168.29 last 95.39) - open/close 16434 (time 1746130149.11 total 178.29 last 96.90) - open/close 17484 (time 1746130159.11 total 188.29 last 105.00) - open/close 18459 (time 1746130169.12 total 198.30 last 97.44) - open/close 19421 (time 1746130179.13 total 208.31 last 96.11) - open/close 20000 (time 1746130184.55 total 213.73 last 106.86) - open/close 20886 (time 1746130194.55 total 223.73 last 88.57) - open/close 21796 (time 1746130204.55 total 233.73 last 90.99) - open/close 22801 (time 1746130214.56 total 243.74 last 100.39) - open/close 23681 (time 1746130224.57 total 253.75 last 87.88) - open/close 24617 (time 1746130234.58 total 263.77 last 93.51) - open/close 25587 (time 1746130244.59 total 273.77 last 96.97) - open/close 26794 (time 1746130254.59 total 283.77 last 120.62) - open/close 27841 (time 1746130264.60 total 293.78 last 104.61) - open/close 28842 (time 1746130274.61 total 303.79 last 100.05) - open/close 29940 (time 1746130284.61 total 313.79 last 109.74) - open/close 30912 (time 1746130294.61 total 323.80 last 97.18) - open/close 31724 (time 1746130304.62 total 333.80 last 81.20) - open/close 32657 (time 1746130314.62 total 343.80 last 93.28) - open/close 33497 (time 1746130324.63 total 353.81 last 83.92) - open/close 34257 (time 1746130334.64 total 363.82 last 75.93) - open/close 35018 (time 1746130344.64 total 373.82 last 76.09) - open/close 35942 (time 1746130354.64 total 383.82 last 92.36) - open/close 36816 (time 1746130364.64 total 393.83 last 87.37) - open/close 37676 (time 1746130374.64 total 403.83 last 86.00) - open/close 38625 (time 1746130384.65 total 413.83 last 94.84) - open/close 39623 (time 1746130394.66 total 423.84 last 99.75) - open/close 40000 (time 1746130398.91 total 428.09 last 88.58) - open/close 40898 (time 1746130408.95 total 438.13 last 89.46) - open/close 41780 (time 1746130418.98 total 448.16 last 87.91) - open/close 42758 (time 1746130429.00 total 458.18 last 97.60) - open/close 43644 (time 1746130439.00 total 468.19 last 88.60) - open/close 44444 (time 1746130449.01 total 478.19 last 79.94) - open/close 45368 (time 1746130459.02 total 488.20 last 92.30) - open/close 46324 (time 1746130469.03 total 498.21 last 95.53) - open/close 47200 (time 1746130479.04 total 508.22 last 87.51) - open/close 48192 (time 1746130489.05 total 518.23 last 99.10) - open/close 49156 (time 1746130499.06 total 528.24 last 96.30) - open/close 50000 (time 1746130507.50 total 536.68 last 100.01) - open/close 50940 (time 1746130517.50 total 546.68 last 93.97) - open/close 51812 (time 1746130527.51 total 556.69 last 87.18) - open/close 52769 (time 1746130537.51 total 566.69 last 95.64) - open/close 53620 (time 1746130547.53 total 576.71 last 84.92) - open/close 54461 (time 1746130557.56 total 586.74 last 83.90) - open/close 55432 (time 1746130567.57 total 596.75 last 97.01) - open/close 56393 (time 1746130577.57 total 606.76 last 96.02) - open/close 57286 (time 1746130587.58 total 616.76 last 89.26) - open/close 58196 (time 1746130597.59 total 626.77 last 90.94) - open/close 59069 (time 1746130607.59 total 636.77 last 87.24) - open/close 60000 (time 1746130617.17 total 646.35 last 97.23) - open/close 60968 (time 1746130627.17 total 656.35 last 96.78) - open/close 62033 (time 1746130637.17 total 666.36 last 106.45) - open/close 63000 (time 1746130647.18 total 676.36 last 96.65) - open/close 63938 (time 1746130657.18 total 686.36 last 93.79) total: 64768 open/close in 694.86 seconds: 93.21 ops/second - /unlink 989 (time 1746130678.04 total 10.00 last 98.87) - /unlink 2131 (time 1746130688.05 total 20.01 last 114.17) - /unlink 3129 (time 1746130698.06 total 30.02 last 99.66) - /unlink 4120 (time 1746130708.06 total 40.02 last 99.10) - /unlink 5072 (time 1746130718.07 total 50.03 last 95.13) - /unlink 6017 (time 1746130728.07 total 60.03 last 94.43) - /unlink 7021 (time 1746130738.08 total 70.04 last 100.37) - /unlink 8224 (time 1746130748.08 total 80.04 last 120.28) - /unlink 9326 (time 1746130758.08 total 90.04 last 110.14) - /unlink 10000 (time 1746130763.71 total 95.67 last 119.72) - /unlink 11003 (time 1746130773.72 total 105.68 last 100.28) - /unlink 12044 (time 1746130783.72 total 115.68 last 104.04) - /unlink 13163 (time 1746130793.73 total 125.69 last 111.84) - /unlink 14051 (time 1746130803.73 total 135.69 last 88.80) - /unlink 14871 (time 1746130813.74 total 145.70 last 81.91) - /unlink 15857 (time 1746130823.75 total 155.71 last 98.47) - /unlink 16876 (time 1746130833.76 total 165.72 last 101.86) - /unlink 17794 (time 1746130843.76 total 175.72 last 91.80) - /unlink 18723 (time 1746130853.76 total 185.72 last 92.83) - /unlink 19745 (time 1746130863.77 total 195.73 last 102.17) - /unlink 20000 (time 1746130865.82 total 197.78 last 124.22) - /unlink 21026 (time 1746130875.82 total 207.78 last 102.59) - /unlink 22068 (time 1746130885.83 total 217.79 last 104.14) - /unlink 22863 (time 1746130895.84 total 227.80 last 79.42) - /unlink 23864 (time 1746130905.84 total 237.80 last 100.10) - /unlink 24950 (time 1746130915.84 total 247.80 last 108.54) - /unlink 25807 (time 1746130925.85 total 257.80 last 85.67) - /unlink 26698 (time 1746130935.86 total 267.82 last 88.95) - /unlink 27548 (time 1746130945.87 total 277.83 last 84.96) - /unlink 28419 (time 1746130955.87 total 287.83 last 87.05) - /unlink 29500 (time 1746130965.88 total 297.84 last 108.05) - /unlink 30000 (time 1746130971.07 total 303.03 last 96.26) - /unlink 30835 (time 1746130981.07 total 313.03 last 83.49) - /unlink 31731 (time 1746130991.09 total 323.05 last 89.44) - /unlink 32810 (time 1746131001.10 total 333.06 last 107.82) - /unlink 33765 (time 1746131011.10 total 343.06 last 95.45) - /unlink 34632 (time 1746131021.11 total 353.07 last 86.65) - /unlink 35612 (time 1746131031.12 total 363.08 last 97.91) - /unlink 36447 (time 1746131041.12 total 373.08 last 83.47) - /unlink 37568 (time 1746131051.13 total 383.09 last 111.97) - /unlink 38571 (time 1746131061.14 total 393.10 last 100.23) - /unlink 39555 (time 1746131071.14 total 403.10 last 98.39) - /unlink 40000 (time 1746131075.10 total 407.06 last 112.44) - /unlink 41232 (time 1746131085.10 total 417.06 last 123.10) - /unlink 42291 (time 1746131095.11 total 427.07 last 105.83) - /unlink 43260 (time 1746131105.11 total 437.07 last 96.89) - /unlink 44327 (time 1746131115.13 total 447.09 last 106.51) - /unlink 45513 (time 1746131125.14 total 457.10 last 118.47) - /unlink 46641 (time 1746131135.15 total 467.11 last 112.70) - /unlink 47697 (time 1746131145.15 total 477.11 last 105.60) - /unlink 48898 (time 1746131155.15 total 487.11 last 120.05) - /unlink 50000 (time 1746131163.76 total 495.72 last 128.05) - /unlink 51020 (time 1746131173.76 total 505.72 last 101.96) - /unlink 52093 (time 1746131183.77 total 515.73 last 107.25) - /unlink 53333 (time 1746131193.77 total 525.73 last 123.93) - /unlink 54606 (time 1746131203.78 total 535.74 last 127.26) - /unlink 55646 (time 1746131213.78 total 545.74 last 103.97) - /unlink 56865 (time 1746131223.79 total 555.75 last 121.77) - /unlink 57884 (time 1746131233.79 total 565.75 last 101.86) - /unlink 58941 (time 1746131243.79 total 575.75 last 105.69) - /unlink 60000 (time 1746131253.20 total 585.16 last 112.59) - /unlink 61070 (time 1746131263.20 total 595.16 last 106.97) - /unlink 62073 (time 1746131273.21 total 605.17 last 100.22) - /unlink 63041 (time 1746131283.22 total 615.18 last 96.75) - /unlink 64069 (time 1746131293.23 total 625.19 last 102.65) total: 64768 /unlink in 631.62 seconds: 102.54 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete