-----============= acceptance-small: conf-sanity ============----- Thu May 1 00:00:43 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg148-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex: No such file or directory excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg148-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg148-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg148-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg148-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg148-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg148-server oleg148-server: oleg148-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg148-server' oleg148-server: oleg148-server.virtnet: executing load_modules_local oleg148-server: Loading modules from /home/green/git/lustre-release/lustre oleg148-server: detected 4 online CPUs by sysfs oleg148-server: MODOPTS_LIBCFS= oleg148-server: Force libcfs to create 2 CPU partitions oleg148-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg148-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg148-server: oleg148-server.virtnet: executing set_default_debug -1 all pdsh@oleg148-client: oleg148-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg148-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg148-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg148-server: oleg148-server.virtnet: executing set_default_debug -1 all pdsh@oleg148-client: oleg148-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg148-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg148-server: oleg148-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg148-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg148-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg148-server stop mds service on oleg148-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg148-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 00:02:38 (1746072158) Stopping clients: oleg148-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg148-client.virtnet /mnt/lustre2 (opts:-f) oleg148-server: oleg148-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg148-server' oleg148-server: oleg148-server.virtnet: executing load_modules_local oleg148-server: Loading modules from /home/green/git/lustre-release/lustre oleg148-server: detected 4 online CPUs by sysfs oleg148-server: MODOPTS_LIBCFS= oleg148-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg148-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg148-server: oleg148-server.virtnet: executing set_default_debug -1 all pdsh@oleg148-client: oleg148-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg148-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg148-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg148-server: oleg148-server.virtnet: executing set_default_debug -1 all pdsh@oleg148-client: oleg148-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg148-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg148-client.virtnet: -o user_xattr,flock 192.168.201.148@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 32648 392 32256 2% /mnt/lustre[OST:0] filesystem_summary: 32585 329 32256 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 815 (time 1746072233.64 total 10.00 last 81.49) - open/close 1632 (time 1746072243.64 total 20.00 last 81.67) - open/close 2419 (time 1746072253.65 total 30.02 last 78.60) - open/close 3154 (time 1746072263.66 total 40.02 last 73.45) - open/close 3860 (time 1746072273.66 total 50.02 last 70.60) - open/close 4501 (time 1746072283.67 total 60.03 last 64.06) - open/close 5215 (time 1746072293.67 total 70.04 last 71.35) - open/close 5940 (time 1746072303.68 total 80.04 last 72.49) - open/close 6575 (time 1746072313.68 total 90.04 last 63.49) - open/close 7218 (time 1746072323.68 total 100.04 last 64.30) - open/close 7904 (time 1746072333.68 total 110.05 last 68.57) - open/close 8616 (time 1746072343.69 total 120.06 last 71.12) - open/close 9430 (time 1746072353.70 total 130.06 last 81.37) - open/close 10000 (time 1746072361.17 total 137.53 last 76.32) - open/close 10705 (time 1746072371.17 total 147.54 last 70.46) - open/close 11473 (time 1746072381.19 total 157.55 last 76.67) - open/close 12255 (time 1746072391.20 total 167.56 last 78.12) - open/close 12948 (time 1746072401.21 total 177.57 last 69.27) - open/close 13725 (time 1746072411.21 total 187.57 last 77.66) - open/close 14437 (time 1746072421.22 total 197.59 last 71.11) - open/close 15143 (time 1746072431.23 total 207.59 last 70.56) - open/close 15909 (time 1746072441.24 total 217.60 last 76.54) - open/close 16702 (time 1746072451.24 total 227.60 last 79.27) - open/close 17522 (time 1746072461.24 total 237.61 last 81.98) - open/close 18263 (time 1746072471.25 total 247.62 last 74.02) - open/close 18972 (time 1746072481.26 total 257.62 last 70.86) - open/close 19635 (time 1746072491.26 total 267.63 last 66.26) - open/close 20000 (time 1746072496.14 total 272.51 last 74.83) - open/close 20711 (time 1746072506.15 total 282.51 last 71.04) - open/close 21457 (time 1746072516.15 total 292.52 last 74.57) - open/close 22184 (time 1746072526.16 total 302.53 last 72.62) - open/close 22855 (time 1746072536.18 total 312.54 last 67.03) - open/close 23555 (time 1746072546.19 total 322.55 last 69.92) - open/close 24261 (time 1746072556.19 total 332.55 last 70.60) - open/close 25014 (time 1746072566.19 total 342.56 last 75.25) - open/close 25887 (time 1746072576.20 total 352.56 last 87.27) - open/close 26588 (time 1746072586.22 total 362.58 last 69.95) - open/close 27244 (time 1746072596.23 total 372.59 last 65.55) - open/close 27861 (time 1746072606.23 total 382.59 last 61.69) - open/close 28574 (time 1746072616.23 total 392.59 last 71.29) - open/close 29399 (time 1746072626.23 total 402.60 last 82.48) - open/close 30000 (time 1746072634.09 total 410.45 last 76.51) - open/close 30671 (time 1746072644.09 total 420.45 last 67.09) - open/close 31363 (time 1746072654.09 total 430.45 last 69.19) - open/close 32092 (time 1746072664.09 total 440.46 last 72.88) - open/close 32826 (time 1746072674.11 total 450.47 last 73.31) - open/close 33614 (time 1746072684.11 total 460.48 last 78.75) - open/close 34365 (time 1746072694.12 total 470.48 last 75.05) - open/close 35071 (time 1746072704.13 total 480.49 last 70.55) - open/close 35733 (time 1746072714.13 total 490.49 last 66.18) - open/close 36443 (time 1746072724.13 total 500.49 last 70.99) - open/close 37187 (time 1746072734.14 total 510.50 last 74.37) - open/close 37909 (time 1746072744.14 total 520.50 last 72.19) - open/close 38588 (time 1746072754.14 total 530.51 last 67.86) - open/close 39198 (time 1746072764.15 total 540.52 last 60.94) - open/close 39900 (time 1746072774.16 total 550.53 last 70.12) - open/close 40587 (time 1746072784.18 total 560.54 last 68.60) - open/close 41475 (time 1746072794.18 total 570.55 last 88.75) - open/close 42211 (time 1746072804.18 total 580.55 last 73.59) - open/close 42942 (time 1746072814.18 total 590.55 last 73.09) - open/close 43632 (time 1746072824.19 total 600.56 last 68.94) - open/close 44295 (time 1746072834.20 total 610.57 last 66.23) - open/close 44986 (time 1746072844.22 total 620.58 last 68.99) - open/close 45745 (time 1746072854.23 total 630.59 last 75.82) - open/close 46421 (time 1746072864.24 total 640.60 last 67.54) - open/close 47086 (time 1746072874.25 total 650.61 last 66.43) - open/close 47727 (time 1746072884.26 total 660.62 last 64.06) - open/close 48415 (time 1746072894.27 total 670.63 last 68.74) - open/close 49115 (time 1746072904.27 total 680.64 last 69.94) - open/close 49857 (time 1746072914.28 total 690.64 last 74.18) - open/close 50000 (time 1746072916.50 total 692.86 last 64.46) - open/close 50724 (time 1746072926.50 total 702.86 last 72.39) - open/close 51432 (time 1746072936.50 total 712.86 last 70.78) - open/close 52159 (time 1746072946.50 total 722.86 last 72.70) - open/close 52889 (time 1746072956.50 total 732.87 last 72.99) - open/close 53731 (time 1746072966.50 total 742.87 last 84.19) - open/close 54389 (time 1746072976.51 total 752.87 last 65.78) - open/close 55026 (time 1746072986.52 total 762.88 last 63.64) - open/close 55748 (time 1746072996.53 total 772.89 last 72.13) - open/close 56448 (time 1746073006.53 total 782.90 last 69.95) - open/close 57199 (time 1746073016.53 total 792.90 last 75.09) - open/close 57974 (time 1746073026.54 total 802.90 last 77.45) - open/close 58669 (time 1746073036.54 total 812.90 last 69.49) - open/close 59364 (time 1746073046.55 total 822.92 last 69.42) - open/close 60000 (time 1746073054.84 total 831.21 last 76.71) - open/close 60718 (time 1746073064.85 total 841.22 last 71.72) - open/close 61467 (time 1746073074.86 total 851.23 last 74.83) - open/close 62337 (time 1746073084.87 total 861.23 last 86.97) - open/close 63130 (time 1746073094.87 total 871.23 last 79.30) - open/close 63817 (time 1746073104.87 total 881.24 last 68.65) - open/close 64539 (time 1746073114.88 total 891.24 last 72.15) total: 64768 open/close in 894.16 seconds: 72.43 ops/second - /unlink 779 (time 1746073130.88 total 10.00 last 77.90) - /unlink 1529 (time 1746073140.89 total 20.00 last 74.97) - /unlink 2349 (time 1746073150.89 total 30.01 last 81.95) - /unlink 3160 (time 1746073160.89 total 40.01 last 81.10) - /unlink 3928 (time 1746073170.90 total 50.02 last 76.76) - /unlink 4753 (time 1746073180.91 total 60.02 last 82.45) - /unlink 5599 (time 1746073190.91 total 70.02 last 84.59) - /unlink 6438 (time 1746073200.93 total 80.04 last 83.75) - /unlink 7445 (time 1746073210.93 total 90.05 last 100.64) - /unlink 8313 (time 1746073220.94 total 100.06 last 86.71) - /unlink 9133 (time 1746073230.95 total 110.07 last 81.94) - /unlink 9876 (time 1746073240.96 total 120.08 last 74.20) - /unlink 10702 (time 1746073250.97 total 130.08 last 82.57) - /unlink 11636 (time 1746073260.97 total 140.09 last 93.36) - /unlink 12570 (time 1746073270.99 total 150.10 last 93.27) - /unlink 13409 (time 1746073281.01 total 160.13 last 83.69) - /unlink 14278 (time 1746073291.01 total 170.13 last 86.87) - /unlink 15160 (time 1746073301.01 total 180.13 last 88.19) - /unlink 15943 (time 1746073311.03 total 190.14 last 78.20) - /unlink 16693 (time 1746073321.03 total 200.14 last 75.00) - /unlink 17578 (time 1746073331.03 total 210.14 last 88.49) - /unlink 18574 (time 1746073341.04 total 220.15 last 99.51) - /unlink 19456 (time 1746073351.04 total 230.15 last 88.19) - /unlink 20000 (time 1746073356.66 total 235.77 last 96.81) - /unlink 20819 (time 1746073366.66 total 245.77 last 81.89) - /unlink 21715 (time 1746073376.66 total 255.78 last 89.59) - /unlink 22475 (time 1746073386.66 total 265.78 last 75.99) - /unlink 23277 (time 1746073396.68 total 275.79 last 80.08) - /unlink 24144 (time 1746073406.68 total 285.80 last 86.68) - /unlink 24868 (time 1746073416.69 total 295.81 last 72.29) - /unlink 25582 (time 1746073426.70 total 305.81 last 71.39) - /unlink 26254 (time 1746073436.70 total 315.82 last 67.16) - /unlink 27046 (time 1746073446.71 total 325.83 last 79.11) - /unlink 27842 (time 1746073456.72 total 335.84 last 79.54) - /unlink 28682 (time 1746073466.73 total 345.85 last 83.90) - /unlink 29487 (time 1746073476.74 total 355.86 last 80.44) - /unlink 30000 (time 1746073482.89 total 362.00 last 83.46) - /unlink 30834 (time 1746073492.89 total 372.00 last 83.39) - /unlink 31713 (time 1746073502.89 total 382.01 last 87.85) - /unlink 32579 (time 1746073512.90 total 392.02 last 86.54) - /unlink 33412 (time 1746073522.90 total 402.02 last 83.28) - /unlink 34183 (time 1746073532.91 total 412.02 last 77.06) - /unlink 34931 (time 1746073542.92 total 422.03 last 74.73) - /unlink 35672 (time 1746073552.92 total 432.04 last 74.08) - /unlink 36418 (time 1746073562.94 total 442.05 last 74.47) - /unlink 37128 (time 1746073572.95 total 452.06 last 70.94) - /unlink 37911 (time 1746073582.96 total 462.07 last 78.23) - /unlink 38744 (time 1746073592.96 total 472.08 last 83.23) - /unlink 39493 (time 1746073602.96 total 482.08 last 74.89) - /unlink 40000 (time 1746073609.51 total 488.62 last 77.48) - /unlink 40801 (time 1746073619.51 total 498.63 last 80.06) - /unlink 41598 (time 1746073629.52 total 508.63 last 79.69) - /unlink 42462 (time 1746073639.52 total 518.64 last 86.36) - /unlink 43236 (time 1746073649.53 total 528.64 last 77.34) - /unlink 43938 (time 1746073659.53 total 538.64 last 70.20) - /unlink 44706 (time 1746073669.55 total 548.66 last 76.66) - /unlink 45522 (time 1746073679.56 total 558.67 last 81.52) - /unlink 46228 (time 1746073689.58 total 568.69 last 70.46) - /unlink 46929 (time 1746073699.58 total 578.69 last 70.10) - /unlink 47719 (time 1746073709.58 total 588.70 last 78.96) - /unlink 48516 (time 1746073719.58 total 598.70 last 79.69) - /unlink 49210 (time 1746073729.59 total 608.71 last 69.35) - /unlink 49923 (time 1746073739.60 total 618.71 last 71.26) - /unlink 50841 (time 1746073749.61 total 628.72 last 91.70) - /unlink 51654 (time 1746073759.61 total 638.73 last 81.28) - /unlink 52398 (time 1746073769.62 total 648.73 last 74.35) - /unlink 53100 (time 1746073779.62 total 658.73 last 70.18) - /unlink 53797 (time 1746073789.63 total 668.74 last 69.64) - /unlink 54628 (time 1746073799.63 total 678.75 last 83.08) - /unlink 55328 (time 1746073809.63 total 688.75 last 69.98) - /unlink 56061 (time 1746073819.65 total 698.76 last 73.21) - /unlink 56935 (time 1746073829.65 total 708.77 last 87.33) - /unlink 57627 (time 1746073839.66 total 718.77 last 69.18) - /unlink 58395 (time 1746073849.66 total 728.77 last 76.78) - /unlink 59189 (time 1746073859.67 total 738.78 last 79.31) - /unlink 59971 (time 1746073869.67 total 748.79 last 78.16) - /unlink 60852 (time 1746073879.68 total 758.79 last 88.09) - /unlink 61696 (time 1746073889.68 total 768.80 last 84.33) - /unlink 62539 (time 1746073899.68 total 778.80 last 84.29) - /unlink 63436 (time 1746073909.69 total 788.80 last 89.68) - /unlink 64239 (time 1746073919.69 total 798.81 last 80.25) total: 64768 /unlink in 804.75 seconds: 80.48 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 830 (time 1746073958.52 total 10.01 last 82.93) - open/close 1785 (time 1746073968.54 total 20.03 last 95.32) - open/close 2825 (time 1746073978.54 total 30.03 last 103.95) - open/close 3664 (time 1746073988.55 total 40.04 last 83.83) - open/close 4562 (time 1746073998.56 total 50.05 last 89.73) - open/close 5383 (time 1746074008.57 total 60.06 last 82.02) - open/close 6201 (time 1746074018.57 total 70.06 last 81.80) - open/close 6966 (time 1746074028.59 total 80.07 last 76.38) - open/close 7787 (time 1746074038.59 total 90.08 last 82.04) - open/close 8678 (time 1746074048.61 total 100.10 last 88.98) - open/close 9493 (time 1746074058.63 total 110.12 last 81.30) - open/close 10000 (time 1746074064.91 total 116.40 last 80.78) - open/close 10814 (time 1746074074.92 total 126.40 last 81.34) - open/close 11622 (time 1746074084.92 total 136.41 last 80.73) - open/close 12521 (time 1746074094.93 total 146.42 last 89.83) - open/close 13332 (time 1746074104.94 total 156.43 last 81.00) - open/close 14162 (time 1746074114.95 total 166.44 last 82.96) - open/close 14973 (time 1746074124.96 total 176.45 last 81.01) - open/close 15826 (time 1746074134.96 total 186.45 last 85.28) - open/close 16671 (time 1746074144.97 total 196.46 last 84.41) - open/close 17558 (time 1746074154.98 total 206.47 last 88.65) - open/close 18471 (time 1746074164.99 total 216.47 last 91.23) - open/close 19318 (time 1746074175.00 total 226.48 last 84.61) - open/close 20000 (time 1746074182.20 total 233.68 last 94.74) - open/close 20943 (time 1746074192.20 total 243.69 last 94.25) - open/close 21845 (time 1746074202.20 total 253.69 last 90.19) - open/close 22730 (time 1746074212.21 total 263.70 last 88.43) - open/close 23598 (time 1746074222.22 total 273.70 last 86.76) - open/close 24432 (time 1746074232.22 total 283.71 last 83.39) - open/close 25261 (time 1746074242.22 total 293.71 last 82.84) - open/close 26119 (time 1746074252.23 total 303.72 last 85.72) - open/close 26931 (time 1746074262.24 total 313.73 last 81.12) - open/close 27713 (time 1746074272.24 total 323.73 last 78.19) - open/close 28495 (time 1746074282.26 total 333.74 last 78.12) - open/close 29356 (time 1746074292.26 total 343.75 last 86.04) - open/close 30000 (time 1746074299.55 total 351.04 last 88.37) - open/close 30832 (time 1746074309.55 total 361.04 last 83.19) - open/close 31603 (time 1746074319.56 total 371.05 last 77.03) - open/close 32372 (time 1746074329.56 total 381.05 last 76.89) - open/close 33162 (time 1746074339.56 total 391.05 last 78.98) - open/close 33950 (time 1746074349.57 total 401.06 last 78.72) - open/close 34703 (time 1746074359.58 total 411.06 last 75.28) - open/close 35458 (time 1746074369.59 total 421.07 last 75.42) - open/close 36260 (time 1746074379.59 total 431.08 last 80.19) - open/close 37083 (time 1746074389.61 total 441.09 last 82.16) - open/close 37852 (time 1746074399.61 total 451.10 last 76.83) - open/close 38584 (time 1746074409.62 total 461.11 last 73.14) - open/close 39344 (time 1746074419.63 total 471.12 last 75.96) - open/close 40000 (time 1746074427.51 total 479.00 last 83.20) - open/close 40812 (time 1746074437.52 total 489.01 last 81.11) - open/close 41553 (time 1746074447.53 total 499.02 last 74.04) - open/close 42334 (time 1746074457.53 total 509.02 last 78.09) - open/close 43228 (time 1746074467.54 total 519.03 last 89.28) - open/close 44110 (time 1746074477.55 total 529.03 last 88.19) - open/close 44926 (time 1746074487.56 total 539.05 last 81.49) - open/close 45844 (time 1746074497.57 total 549.06 last 91.72) - open/close 46688 (time 1746074507.57 total 559.06 last 84.35) - open/close 47421 (time 1746074517.58 total 569.07 last 73.26) - open/close 48140 (time 1746074527.59 total 579.08 last 71.84) - open/close 48919 (time 1746074537.59 total 589.08 last 77.87) - open/close 49761 (time 1746074547.62 total 599.11 last 83.97) - open/close 50000 (time 1746074550.29 total 601.78 last 89.58) - open/close 50777 (time 1746074560.29 total 611.78 last 77.68) - open/close 51615 (time 1746074570.30 total 621.78 last 83.75) - open/close 52416 (time 1746074580.30 total 631.79 last 80.05) - open/close 53235 (time 1746074590.31 total 641.80 last 81.82) - open/close 54144 (time 1746074600.31 total 651.80 last 90.86) - open/close 54975 (time 1746074610.32 total 661.81 last 83.03) - open/close 55781 (time 1746074620.32 total 671.81 last 80.60) - open/close 56657 (time 1746074630.32 total 681.81 last 87.59) - open/close 57472 (time 1746074640.33 total 691.82 last 81.47) - open/close 58299 (time 1746074650.34 total 701.82 last 82.63) - open/close 59084 (time 1746074660.35 total 711.84 last 78.37) - open/close 59979 (time 1746074670.36 total 721.85 last 89.40) - open/close 60832 (time 1746074680.37 total 731.86 last 85.24) - open/close 61664 (time 1746074690.37 total 741.86 last 83.16) - open/close 62528 (time 1746074700.39 total 751.88 last 86.29) - open/close 63320 (time 1746074710.39 total 761.88 last 79.17) - open/close 64162 (time 1746074720.40 total 771.89 last 84.13) total: 64768 open/close in 779.24 seconds: 83.12 ops/second - /unlink 825 (time 1746074740.03 total 10.01 last 82.45) - /unlink 1689 (time 1746074750.03 total 20.01 last 86.36) - /unlink 2580 (time 1746074760.04 total 30.01 last 89.06) - /unlink 3429 (time 1746074770.04 total 40.02 last 84.87) - /unlink 4230 (time 1746074780.05 total 50.02 last 80.05) - /unlink 4987 (time 1746074790.06 total 60.03 last 75.62) - /unlink 5753 (time 1746074800.07 total 70.04 last 76.53) - /unlink 6657 (time 1746074810.07 total 80.05 last 90.34) - /unlink 7639 (time 1746074820.08 total 90.06 last 98.13) - /unlink 8616 (time 1746074830.09 total 100.06 last 97.66) - /unlink 9518 (time 1746074840.10 total 110.08 last 90.07) - /unlink 10000 (time 1746074845.46 total 115.43 last 89.97) - /unlink 11038 (time 1746074855.46 total 125.43 last 103.80) - /unlink 11995 (time 1746074865.47 total 135.45 last 95.55) - /unlink 12766 (time 1746074875.48 total 145.45 last 77.08) - /unlink 13583 (time 1746074885.48 total 155.45 last 81.69) - /unlink 14384 (time 1746074895.48 total 165.46 last 80.09) - /unlink 15251 (time 1746074905.48 total 175.46 last 86.70) - /unlink 16137 (time 1746074915.48 total 185.46 last 88.57) - /unlink 16931 (time 1746074925.50 total 195.48 last 79.28) - /unlink 17735 (time 1746074935.50 total 205.48 last 80.40) - /unlink 18585 (time 1746074945.51 total 215.48 last 84.93) - /unlink 19525 (time 1746074955.51 total 225.49 last 93.95) - /unlink 20000 (time 1746074961.44 total 231.42 last 80.13) - /unlink 20857 (time 1746074971.45 total 241.43 last 85.61) - /unlink 21802 (time 1746074981.45 total 251.43 last 94.48) - /unlink 22823 (time 1746074991.46 total 261.44 last 102.02) - /unlink 23886 (time 1746075001.47 total 271.44 last 106.25) - /unlink 24815 (time 1746075011.47 total 281.45 last 92.83) - /unlink 25649 (time 1746075021.48 total 291.45 last 83.39) - /unlink 26562 (time 1746075031.48 total 301.46 last 91.25) - /unlink 27384 (time 1746075041.49 total 311.46 last 82.15) - /unlink 28287 (time 1746075051.49 total 321.47 last 90.29) - /unlink 29113 (time 1746075061.49 total 331.47 last 82.59) - /unlink 29931 (time 1746075071.50 total 341.48 last 81.72) - /unlink 30729 (time 1746075081.51 total 351.49 last 79.72) - /unlink 31617 (time 1746075091.52 total 361.49 last 88.74) - /unlink 32460 (time 1746075101.53 total 371.50 last 84.23) - /unlink 33236 (time 1746075111.53 total 381.50 last 77.60) - /unlink 33997 (time 1746075121.53 total 391.51 last 76.06) - /unlink 34807 (time 1746075131.53 total 401.51 last 80.98) - /unlink 35559 (time 1746075141.55 total 411.53 last 75.06) - /unlink 36238 (time 1746075151.57 total 421.54 last 67.82) - /unlink 37074 (time 1746075161.58 total 431.55 last 83.52) - /unlink 37792 (time 1746075171.58 total 441.56 last 71.77) - /unlink 38618 (time 1746075181.58 total 451.56 last 82.59) - /unlink 39400 (time 1746075191.59 total 461.56 last 78.16) - /unlink 40000 (time 1746075199.50 total 469.48 last 75.79) - /unlink 40807 (time 1746075209.52 total 479.50 last 80.57) - /unlink 41665 (time 1746075219.53 total 489.51 last 85.71) - /unlink 42531 (time 1746075229.53 total 499.51 last 86.58) - /unlink 43441 (time 1746075239.54 total 509.52 last 90.94) - /unlink 44291 (time 1746075249.55 total 519.52 last 84.93) - /unlink 45122 (time 1746075259.55 total 529.53 last 83.04) - /unlink 46056 (time 1746075269.56 total 539.53 last 93.40) - /unlink 46875 (time 1746075279.56 total 549.54 last 81.83) - /unlink 47684 (time 1746075289.57 total 559.55 last 80.84) - /unlink 48394 (time 1746075299.58 total 569.56 last 70.92) - /unlink 49102 (time 1746075309.60 total 579.57 last 70.71) - /unlink 49887 (time 1746075319.61 total 589.59 last 78.39) - /unlink 50651 (time 1746075329.63 total 599.61 last 76.22) - /unlink 51427 (time 1746075339.65 total 609.62 last 77.50) - /unlink 52251 (time 1746075349.65 total 619.63 last 82.36) - /unlink 53110 (time 1746075359.65 total 629.63 last 85.89) - /unlink 54022 (time 1746075369.66 total 639.63 last 91.15) - /unlink 54895 (time 1746075379.67 total 649.64 last 87.21) - /unlink 55791 (time 1746075389.67 total 659.65 last 89.55) - /unlink 56670 (time 1746075399.68 total 669.65 last 87.86) - /unlink 57458 (time 1746075409.68 total 679.66 last 78.79) - /unlink 58418 (time 1746075419.69 total 689.66 last 95.93) - /unlink 59235 (time 1746075429.70 total 699.67 last 81.63) - /unlink 60000 (time 1746075438.92 total 708.90 last 82.90) - /unlink 60757 (time 1746075448.93 total 718.90 last 75.69) - /unlink 61525 (time 1746075458.93 total 728.90 last 76.78) - /unlink 62176 (time 1746075468.94 total 738.92 last 65.02) - /unlink 63024 (time 1746075478.95 total 748.92 last 84.74) - /unlink 63749 (time 1746075488.96 total 758.94 last 72.41) - /unlink 64559 (time 1746075498.98 total 768.96 last 80.83) total: 64768 /unlink in 771.64 seconds: 83.94 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 750 (time 1746075536.87 total 10.01 last 74.96) - open/close 1558 (time 1746075546.88 total 20.02 last 80.69) - open/close 2526 (time 1746075556.88 total 30.02 last 96.79) - open/close 3397 (time 1746075566.88 total 40.02 last 87.09) - open/close 4298 (time 1746075576.88 total 50.02 last 90.10) - open/close 5129 (time 1746075586.89 total 60.02 last 83.08) - open/close 5937 (time 1746075596.89 total 70.03 last 80.79) - open/close 6774 (time 1746075606.89 total 80.03 last 83.66) - open/close 7563 (time 1746075616.90 total 90.04 last 78.84) - open/close 8378 (time 1746075626.91 total 100.04 last 81.46) - open/close 9235 (time 1746075636.91 total 110.05 last 85.66) - open/close 10000 (time 1746075645.42 total 118.55 last 89.93) - open/close 10821 (time 1746075655.42 total 128.56 last 82.08) - open/close 11635 (time 1746075665.42 total 138.56 last 81.38) - open/close 12392 (time 1746075675.43 total 148.56 last 75.66) - open/close 13277 (time 1746075685.43 total 158.57 last 88.46) - open/close 14027 (time 1746075695.44 total 168.58 last 74.93) - open/close 14900 (time 1746075705.44 total 178.58 last 87.27) - open/close 15720 (time 1746075715.44 total 188.58 last 82.00) - open/close 16558 (time 1746075725.45 total 198.59 last 83.73) - open/close 17400 (time 1746075735.47 total 208.60 last 84.10) - open/close 18202 (time 1746075745.47 total 218.61 last 80.17) - open/close 18974 (time 1746075755.48 total 228.61 last 77.15) - open/close 19762 (time 1746075765.48 total 238.62 last 78.77) - open/close 20000 (time 1746075768.28 total 241.42 last 85.05) - open/close 20883 (time 1746075778.28 total 251.42 last 88.30) - open/close 21615 (time 1746075788.29 total 261.43 last 73.09) - open/close 22358 (time 1746075798.30 total 271.44 last 74.23) - open/close 23094 (time 1746075808.35 total 281.49 last 73.24) - open/close 23847 (time 1746075818.36 total 291.50 last 75.24) - open/close 24563 (time 1746075828.36 total 301.50 last 71.57) - open/close 25328 (time 1746075838.37 total 311.51 last 76.42) - open/close 26171 (time 1746075848.39 total 321.52 last 84.21) - open/close 26915 (time 1746075858.40 total 331.53 last 74.32) - open/close 27766 (time 1746075868.40 total 341.54 last 85.08) - open/close 28641 (time 1746075878.40 total 351.54 last 87.50) - open/close 29509 (time 1746075888.41 total 361.55 last 86.73) - open/close 30000 (time 1746075893.93 total 367.07 last 88.86) - open/close 30854 (time 1746075903.94 total 377.08 last 85.34) - open/close 31783 (time 1746075913.95 total 387.08 last 92.85) - open/close 32684 (time 1746075923.95 total 397.09 last 90.08) - open/close 33537 (time 1746075933.95 total 407.09 last 85.27) - open/close 34440 (time 1746075943.96 total 417.10 last 90.22) - open/close 35251 (time 1746075953.97 total 427.11 last 81.02) - open/close 36048 (time 1746075963.98 total 437.12 last 79.61) - open/close 36865 (time 1746075973.98 total 447.12 last 81.67) - open/close 37639 (time 1746075983.99 total 457.13 last 77.33) - open/close 38359 (time 1746075994.00 total 467.14 last 71.95) - open/close 39076 (time 1746076004.00 total 477.14 last 71.68) - open/close 39844 (time 1746076014.00 total 487.14 last 76.80) - open/close 40000 (time 1746076016.17 total 489.31 last 72.07) - open/close 40724 (time 1746076026.18 total 499.32 last 72.30) - open/close 41556 (time 1746076036.19 total 509.32 last 83.18) - open/close 42320 (time 1746076046.19 total 519.33 last 76.38) - open/close 43069 (time 1746076056.20 total 529.34 last 74.82) - open/close 43856 (time 1746076066.21 total 539.34 last 78.65) - open/close 44705 (time 1746076076.21 total 549.34 last 84.89) - open/close 45507 (time 1746076086.21 total 559.35 last 80.17) - open/close 46360 (time 1746076096.22 total 569.35 last 85.26) - open/close 47252 (time 1746076106.22 total 579.36 last 89.13) - open/close 48292 (time 1746076116.23 total 589.37 last 103.92) - open/close 49358 (time 1746076126.24 total 599.37 last 106.53) - open/close 50000 (time 1746076133.67 total 606.81 last 86.40) - open/close 50814 (time 1746076143.67 total 616.81 last 81.38) - open/close 51682 (time 1746076153.67 total 626.81 last 86.76) - open/close 52410 (time 1746076163.68 total 636.82 last 72.77) - open/close 53182 (time 1746076173.68 total 646.82 last 77.19) - open/close 54112 (time 1746076183.69 total 656.82 last 92.95) - open/close 55148 (time 1746076193.69 total 666.83 last 103.56) - open/close 56170 (time 1746076203.69 total 676.83 last 102.15) - open/close 57296 (time 1746076213.72 total 686.86 last 112.29) - open/close 58351 (time 1746076223.73 total 696.87 last 105.37) - open/close 59475 (time 1746076233.74 total 706.88 last 112.37) - open/close 60000 (time 1746076239.07 total 712.20 last 98.51) - open/close 61191 (time 1746076249.08 total 722.21 last 118.99) - open/close 62293 (time 1746076259.08 total 732.21 last 110.19) - open/close 63147 (time 1746076269.09 total 742.23 last 85.28) - open/close 63961 (time 1746076279.10 total 752.23 last 81.36) - open/close 64744 (time 1746076289.10 total 762.24 last 78.28) total: 64768 open/close in 762.52 seconds: 84.94 ops/second - /unlink 749 (time 1746076302.34 total 10.00 last 74.89) - /unlink 1634 (time 1746076312.35 total 20.01 last 88.44) - /unlink 2450 (time 1746076322.36 total 30.02 last 81.53) - /unlink 3306 (time 1746076332.37 total 40.03 last 85.49) - /unlink 4053 (time 1746076342.39 total 50.04 last 74.59) - /unlink 4874 (time 1746076352.40 total 60.06 last 81.99) - /unlink 5674 (time 1746076362.41 total 70.07 last 79.89) - /unlink 6452 (time 1746076372.41 total 80.07 last 77.80) - /unlink 7194 (time 1746076382.42 total 90.08 last 74.13) - /unlink 7943 (time 1746076392.43 total 100.09 last 74.81) - /unlink 8756 (time 1746076402.44 total 110.09 last 81.27) - /unlink 9480 (time 1746076412.45 total 120.10 last 72.32) - /unlink 10000 (time 1746076419.30 total 126.95 last 75.91) - /unlink 10819 (time 1746076429.30 total 136.96 last 81.89) - /unlink 11779 (time 1746076439.31 total 146.97 last 95.88) - /unlink 12614 (time 1746076449.32 total 156.98 last 83.44) - /unlink 13376 (time 1746076459.33 total 166.99 last 76.13) - /unlink 14242 (time 1746076469.35 total 177.00 last 86.45) - /unlink 15045 (time 1746076479.35 total 187.00 last 80.29) - /unlink 15821 (time 1746076489.36 total 197.01 last 77.52) - /unlink 16670 (time 1746076499.36 total 207.02 last 84.84) - /unlink 17478 (time 1746076509.38 total 217.04 last 80.69) - /unlink 18305 (time 1746076519.38 total 227.04 last 82.68) - /unlink 19148 (time 1746076529.38 total 237.04 last 84.28) - /unlink 20000 (time 1746076537.97 total 245.63 last 99.16) - /unlink 21043 (time 1746076547.99 total 255.64 last 104.18) - /unlink 22079 (time 1746076558.00 total 265.65 last 103.50) - /unlink 22919 (time 1746076568.00 total 275.66 last 83.98) - /unlink 24035 (time 1746076578.00 total 285.66 last 111.54) - /unlink 24926 (time 1746076588.02 total 295.68 last 88.95) - /unlink 25695 (time 1746076598.02 total 305.68 last 76.88) - /unlink 26434 (time 1746076608.02 total 315.68 last 73.90) - /unlink 27135 (time 1746076618.03 total 325.68 last 70.09) - /unlink 27811 (time 1746076628.04 total 335.69 last 67.53) - /unlink 28590 (time 1746076638.04 total 345.70 last 77.83) - /unlink 29423 (time 1746076648.04 total 355.70 last 83.30) - /unlink 30000 (time 1746076654.82 total 362.48 last 85.13) - /unlink 30864 (time 1746076664.83 total 372.49 last 86.34) - /unlink 31761 (time 1746076674.83 total 382.49 last 89.68) - /unlink 32526 (time 1746076684.86 total 392.52 last 76.29) - /unlink 33325 (time 1746076694.87 total 402.53 last 79.83) - /unlink 34164 (time 1746076704.89 total 412.54 last 83.76) - /unlink 35031 (time 1746076714.89 total 422.54 last 86.68) - /unlink 35925 (time 1746076724.90 total 432.56 last 89.25) - /unlink 36830 (time 1746076734.91 total 442.57 last 90.45) - /unlink 37609 (time 1746076744.92 total 452.57 last 77.84) - /unlink 38545 (time 1746076754.92 total 462.58 last 93.55) - /unlink 39310 (time 1746076764.93 total 472.59 last 76.43) - /unlink 40000 (time 1746076772.44 total 480.10 last 91.90) - /unlink 40820 (time 1746076782.44 total 490.10 last 81.96) - /unlink 41693 (time 1746076792.45 total 500.11 last 87.25) - /unlink 42526 (time 1746076802.45 total 510.11 last 83.29) - /unlink 43286 (time 1746076812.46 total 520.12 last 75.95) - /unlink 43986 (time 1746076822.46 total 530.12 last 69.96) - /unlink 44695 (time 1746076832.47 total 540.13 last 70.83) - /unlink 45463 (time 1746076842.47 total 550.13 last 76.80) - /unlink 46292 (time 1746076852.48 total 560.13 last 82.88) - /unlink 46977 (time 1746076862.49 total 570.15 last 68.42) - /unlink 47694 (time 1746076872.49 total 580.15 last 71.68) - /unlink 48515 (time 1746076882.50 total 590.16 last 82.01) - /unlink 49334 (time 1746076892.51 total 600.17 last 81.85) - /unlink 50000 (time 1746076900.10 total 607.75 last 87.77) - /unlink 50815 (time 1746076910.11 total 617.77 last 81.40) - /unlink 51548 (time 1746076920.11 total 627.77 last 73.27) - /unlink 52361 (time 1746076930.12 total 637.78 last 81.23) - /unlink 53168 (time 1746076940.15 total 647.80 last 80.52) - /unlink 54007 (time 1746076950.16 total 657.81 last 83.80) - /unlink 54736 (time 1746076960.20 total 667.86 last 72.59) - /unlink 55463 (time 1746076970.21 total 677.87 last 72.63) - /unlink 56144 (time 1746076980.22 total 687.88 last 68.02) - /unlink 56917 (time 1746076990.23 total 697.89 last 77.24) - /unlink 57624 (time 1746077000.24 total 707.89 last 70.65) - /unlink 58330 (time 1746077010.28 total 717.94 last 70.26) - /unlink 59063 (time 1746077020.30 total 727.96 last 73.19) - /unlink 59838 (time 1746077030.33 total 737.99 last 77.23) - /unlink 60653 (time 1746077040.34 total 748.00 last 81.43) - /unlink 61641 (time 1746077050.35 total 758.01 last 98.72) - /unlink 62458 (time 1746077060.35 total 768.01 last 81.70) - /unlink 63290 (time 1746077070.35 total 778.01 last 83.17) - /unlink 64107 (time 1746077080.36 total 788.02 last 81.64) total: 64768 /unlink in 796.38 seconds: 81.33 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete