-----============= acceptance-small: conf-sanity ============----- Tue Feb 27 12:09:33 EST 2024 excepting tests: 32newtarball 110 Stopping clients: oleg454-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg454-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg454-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg454-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg454-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg454-server oleg454-server: oleg454-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg454-server' oleg454-server: oleg454-server.virtnet: executing load_modules_local oleg454-server: Loading modules from /home/green/git/lustre-release/lustre oleg454-server: detected 4 online CPUs by sysfs oleg454-server: Force libcfs to create 2 CPU partitions oleg454-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg454-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg454-server: oleg454-server.virtnet: executing set_default_debug -1 all pdsh@oleg454-client: oleg454-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg454-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg454-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg454-server: oleg454-server.virtnet: executing set_default_debug -1 all pdsh@oleg454-client: oleg454-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg454-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg454-server: oleg454-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg454-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg454-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg454-server stop mds service on oleg454-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg454-server debug_raw_pointers=Y debug_raw_pointers=Y == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 12:10:32 (1709053832) Stopping clients: oleg454-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg454-client.virtnet /mnt/lustre2 (opts:-f) oleg454-server: oleg454-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg454-server' oleg454-server: oleg454-server.virtnet: executing load_modules_local oleg454-server: Loading modules from /home/green/git/lustre-release/lustre oleg454-server: detected 4 online CPUs by sysfs oleg454-server: Force libcfs to create 2 CPU partitions oleg454-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg454-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg454-server: oleg454-server.virtnet: executing set_default_debug -1 all pdsh@oleg454-client: oleg454-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg454-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg454-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg454-server: oleg454-server.virtnet: executing set_default_debug -1 all pdsh@oleg454-client: oleg454-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg454-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg454-client.virtnet: -o user_xattr,flock oleg454-server@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 16134 326 15808 3% /mnt/lustre[OST:0] filesystem_summary: 16137 329 15808 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 5035 (time 1709053864.23 total 10.00 last 503.46) - open/close 8879 (time 1709053874.24 total 20.00 last 384.30) - open/close 10000 (time 1709053877.57 total 23.34 last 336.41) - open/close 12991 (time 1709053887.57 total 33.34 last 299.07) - open/close 15333 (time 1709053897.57 total 43.34 last 234.18) - open/close 16273 (time 1709053907.57 total 53.34 last 93.98) - open/close 16982 (time 1709053917.57 total 63.34 last 70.90) - open/close 17940 (time 1709053927.58 total 73.35 last 95.73) - open/close 18814 (time 1709053937.58 total 83.35 last 87.39) - open/close 19718 (time 1709053947.59 total 93.36 last 90.33) - open/close 20000 (time 1709053951.58 total 97.35 last 70.63) - open/close 20647 (time 1709053961.58 total 107.35 last 64.68) - open/close 21505 (time 1709053971.59 total 117.35 last 85.77) - open/close 22627 (time 1709053981.60 total 127.36 last 112.12) - open/close 23601 (time 1709053991.60 total 137.37 last 97.34) - open/close 24578 (time 1709054001.61 total 147.38 last 97.60) - open/close 25354 (time 1709054011.61 total 157.38 last 77.58) - open/close 26177 (time 1709054021.62 total 167.39 last 82.26) - open/close 26979 (time 1709054031.63 total 177.39 last 80.13) - open/close 27778 (time 1709054041.64 total 187.40 last 79.84) - open/close 28652 (time 1709054051.64 total 197.41 last 87.33) - open/close 29523 (time 1709054061.65 total 207.41 last 87.08) - open/close 30000 (time 1709054066.79 total 212.55 last 92.81) - open/close 30895 (time 1709054076.80 total 222.56 last 89.39) - open/close 31616 (time 1709054086.80 total 232.57 last 72.09) - open/close 32275 (time 1709054096.82 total 242.58 last 65.78) - open/close 32585 (time 1709054106.83 total 252.59 last 30.97) - open/close 32822 (time 1709054116.84 total 262.61 last 23.67) - open/close 33220 (time 1709054126.85 total 272.62 last 39.76) - open/close 33644 (time 1709054136.87 total 282.64 last 42.31) - open/close 34138 (time 1709054146.87 total 292.64 last 49.39) - open/close 34543 (time 1709054156.91 total 302.67 last 40.37) - open/close 34869 (time 1709054166.91 total 312.67 last 32.60) - open/close 35239 (time 1709054176.93 total 322.70 last 36.90) - open/close 35694 (time 1709054186.95 total 332.72 last 45.43) - open/close 36220 (time 1709054196.97 total 342.74 last 52.49) - open/close 36652 (time 1709054206.98 total 352.75 last 43.14) - open/close 37162 (time 1709054216.99 total 362.75 last 51.00) - open/close 37572 (time 1709054227.00 total 372.77 last 40.93) - open/close 37869 (time 1709054237.03 total 382.80 last 29.62) - open/close 38114 (time 1709054247.04 total 392.80 last 24.48) - open/close 38430 (time 1709054257.04 total 402.81 last 31.60) - open/close 38774 (time 1709054267.05 total 412.82 last 34.35) - open/close 39020 (time 1709054277.11 total 422.87 last 24.47) - open/close 39346 (time 1709054287.11 total 432.88 last 32.59) - open/close 39620 (time 1709054297.12 total 442.89 last 27.37) - open/close 39889 (time 1709054307.12 total 452.89 last 26.89) - open/close 40000 (time 1709054311.45 total 457.22 last 25.65) - open/close 40348 (time 1709054321.46 total 467.22 last 34.79) - open/close 40628 (time 1709054331.47 total 477.24 last 27.95) - open/close 40926 (time 1709054341.48 total 487.25 last 29.78) - open/close 41252 (time 1709054351.51 total 497.28 last 32.50) - open/close 41519 (time 1709054361.52 total 507.29 last 26.67) - open/close 41802 (time 1709054371.53 total 517.30 last 28.28) - open/close 42049 (time 1709054381.55 total 527.32 last 24.64) - open/close 42299 (time 1709054391.59 total 537.36 last 24.91) - open/close 42546 (time 1709054401.63 total 547.40 last 24.60) - open/close 42749 (time 1709054411.69 total 557.45 last 20.19) - open/close 42997 (time 1709054421.69 total 567.45 last 24.80) - open/close 43231 (time 1709054431.69 total 577.46 last 23.39) - open/close 43491 (time 1709054441.70 total 587.47 last 25.99) - open/close 43745 (time 1709054451.75 total 597.51 last 25.28) - open/close 43975 (time 1709054461.77 total 607.54 last 22.94) - open/close 44310 (time 1709054471.80 total 617.57 last 33.41) - open/close 44660 (time 1709054481.82 total 627.59 last 34.92) - open/close 44909 (time 1709054491.84 total 637.60 last 24.86) - open/close 45127 (time 1709054501.87 total 647.63 last 21.74) - open/close 45358 (time 1709054511.88 total 657.65 last 23.06) - open/close 45641 (time 1709054521.89 total 667.66 last 28.28) - open/close 45915 (time 1709054531.90 total 677.66 last 27.38) - open/close 46169 (time 1709054541.90 total 687.67 last 25.39) - open/close 46435 (time 1709054551.93 total 697.70 last 26.52) - open/close 46726 (time 1709054561.96 total 707.73 last 29.01) - open/close 46948 (time 1709054571.97 total 717.73 last 22.19) - open/close 47248 (time 1709054581.99 total 727.75 last 29.94) - open/close 47608 (time 1709054591.99 total 737.76 last 36.00) - open/close 47958 (time 1709054602.01 total 747.78 last 34.92) - open/close 48324 (time 1709054612.02 total 757.78 last 36.59) - open/close 48698 (time 1709054622.02 total 767.79 last 37.39) - open/close 49056 (time 1709054632.04 total 777.81 last 35.72) - open/close 49371 (time 1709054642.06 total 787.82 last 31.45) - open/close 49618 (time 1709054652.07 total 797.84 last 24.66) - open/close 49894 (time 1709054662.10 total 807.87 last 27.53) - open/close 50000 (time 1709054665.48 total 811.25 last 31.34) - open/close 50268 (time 1709054675.54 total 821.30 last 26.66) - open/close 50551 (time 1709054685.55 total 831.32 last 28.25) - open/close 50815 (time 1709054695.61 total 841.37 last 26.26) - open/close 51042 (time 1709054705.66 total 851.42 last 22.58) - open/close 51277 (time 1709054715.70 total 861.47 last 23.40) - open/close 51517 (time 1709054725.72 total 871.49 last 23.95) - open/close 51846 (time 1709054735.72 total 881.49 last 32.90) - open/close 52204 (time 1709054745.74 total 891.51 last 35.74) - open/close 52547 (time 1709054755.76 total 901.53 last 34.23) - open/close 52809 (time 1709054765.78 total 911.55 last 26.14) - open/close 53145 (time 1709054775.79 total 921.55 last 33.59) - open/close 53491 (time 1709054785.81 total 931.57 last 34.54) - open/close 53841 (time 1709054795.83 total 941.60 last 34.92) - open/close 54147 (time 1709054805.85 total 951.62 last 30.52) - open/close 54387 (time 1709054815.87 total 961.63 last 23.97) - open/close 54602 (time 1709054825.90 total 971.66 last 21.44) - open/close 54849 (time 1709054835.92 total 981.69 last 24.63) - open/close 55090 (time 1709054845.98 total 991.74 last 23.97) - open/close 55326 (time 1709054856.00 total 1001.77 last 23.55) - open/close 55588 (time 1709054866.03 total 1011.80 last 26.12) - open/close 55840 (time 1709054876.04 total 1021.81 last 25.18) - open/close 56095 (time 1709054886.05 total 1031.82 last 25.48) - open/close 56361 (time 1709054896.05 total 1041.82 last 26.59) - open/close 56662 (time 1709054906.09 total 1051.85 last 30.00) - open/close 56952 (time 1709054916.09 total 1061.85 last 29.00) - open/close 57233 (time 1709054926.09 total 1071.86 last 28.08) - open/close 57514 (time 1709054936.13 total 1081.89 last 28.01) - open/close 57754 (time 1709054946.13 total 1091.89 last 24.00) - open/close 58016 (time 1709054956.13 total 1101.90 last 26.18) - open/close 58336 (time 1709054966.16 total 1111.92 last 31.93) - open/close 58540 (time 1709054976.19 total 1121.96 last 20.33) - open/close 58742 (time 1709054986.23 total 1132.00 last 20.13) - open/close 58940 (time 1709054996.23 total 1142.00 last 19.80) - open/close 59170 (time 1709055006.24 total 1152.01 last 22.97) - open/close 59422 (time 1709055016.25 total 1162.02 last 25.18) - open/close 59687 (time 1709055026.27 total 1172.04 last 26.44) - open/close 59947 (time 1709055036.28 total 1182.04 last 25.99) - open/close 60196 (time 1709055046.29 total 1192.05 last 24.88) - open/close 60378 (time 1709055056.33 total 1202.10 last 18.11) - open/close 60591 (time 1709055066.38 total 1212.15 last 21.20) - open/close 60830 (time 1709055076.41 total 1222.18 last 23.82) - open/close 61111 (time 1709055086.43 total 1232.19 last 28.05) - open/close 61372 (time 1709055096.50 total 1242.26 last 25.92) - open/close 61651 (time 1709055106.52 total 1252.29 last 27.83) - open/close 61906 (time 1709055116.55 total 1262.32 last 25.43) - open/close 62145 (time 1709055126.56 total 1272.33 last 23.88) - open/close 62353 (time 1709055136.58 total 1282.35 last 20.75) - open/close 62596 (time 1709055146.59 total 1292.36 last 24.28) - open/close 62813 (time 1709055156.61 total 1302.38 last 21.65) - open/close 63003 (time 1709055166.64 total 1312.41 last 18.95) - open/close 63180 (time 1709055176.70 total 1322.46 last 17.60) - open/close 63350 (time 1709055186.72 total 1332.48 last 16.96) - open/close 63527 (time 1709055196.72 total 1342.49 last 17.69) - open/close 63764 (time 1709055206.74 total 1352.51 last 23.66) - open/close 64027 (time 1709055216.74 total 1362.51 last 26.29) - open/close 64309 (time 1709055226.75 total 1372.51 last 28.18) - open/close 64546 (time 1709055236.76 total 1382.53 last 23.66) total: 64768 open/close in 1392.16 seconds: 46.52 ops/second - /unlink 216 (time 1709055257.58 total 10.02 last 21.56) - /unlink 393 (time 1709055267.61 total 20.04 last 17.66) - /unlink 586 (time 1709055277.64 total 30.08 last 19.23) - /unlink 799 (time 1709055287.66 total 40.10 last 21.26) - /unlink 990 (time 1709055297.71 total 50.14 last 19.01) - /unlink 1180 (time 1709055307.75 total 60.18 last 18.92) - /unlink 1338 (time 1709055317.77 total 70.20 last 15.77) - /unlink 1510 (time 1709055327.81 total 80.24 last 17.13) - /unlink 1713 (time 1709055337.84 total 90.28 last 20.24) - /unlink 1937 (time 1709055347.87 total 100.31 last 22.33) - /unlink 2160 (time 1709055357.89 total 110.33 last 22.26) - /unlink 2388 (time 1709055367.90 total 120.33 last 22.79) - /unlink 2611 (time 1709055377.91 total 130.34 last 22.27) - /unlink 2820 (time 1709055387.95 total 140.39 last 20.81) - /unlink 3035 (time 1709055397.97 total 150.40 last 21.46) - /unlink 3289 (time 1709055408.00 total 160.44 last 25.32) - /unlink 3510 (time 1709055418.04 total 170.47 last 22.02) - /unlink 3744 (time 1709055428.05 total 180.48 last 23.38) - /unlink 3995 (time 1709055438.07 total 190.50 last 25.05) - /unlink 4249 (time 1709055448.10 total 200.53 last 25.32) - /unlink 4499 (time 1709055458.10 total 210.53 last 25.00) - /unlink 4763 (time 1709055468.13 total 220.56 last 26.32) - /unlink 5020 (time 1709055478.15 total 230.59 last 25.65) - /unlink 5247 (time 1709055488.17 total 240.60 last 22.67) - /unlink 5499 (time 1709055498.18 total 250.61 last 25.18) - /unlink 5752 (time 1709055508.21 total 260.65 last 25.21) - /unlink 5989 (time 1709055518.22 total 270.65 last 23.68) - /unlink 6217 (time 1709055528.25 total 280.68 last 22.74) - /unlink 6469 (time 1709055538.28 total 290.71 last 25.12) - /unlink 6725 (time 1709055548.31 total 300.75 last 25.51) - /unlink 6978 (time 1709055558.33 total 310.76 last 25.25) - /unlink 7222 (time 1709055568.38 total 320.82 last 24.27) - /unlink 7465 (time 1709055578.39 total 330.82 last 24.29) - /unlink 7707 (time 1709055588.41 total 340.85 last 24.14) - /unlink 7944 (time 1709055598.44 total 350.88 last 23.63) - /unlink 8189 (time 1709055608.45 total 360.88 last 24.49) - /unlink 8407 (time 1709055618.45 total 370.88 last 21.80) - /unlink 8650 (time 1709055628.49 total 380.92 last 24.20) - /unlink 8873 (time 1709055638.54 total 390.97 last 22.19) - /unlink 9134 (time 1709055648.57 total 401.01 last 26.01) - /unlink 9398 (time 1709055658.59 total 411.02 last 26.37) - /unlink 9653 (time 1709055668.62 total 421.06 last 25.40) - /unlink 9912 (time 1709055678.64 total 431.08 last 25.85) - /unlink 10000 (time 1709055681.73 total 434.16 last 28.53) - /unlink 10276 (time 1709055691.73 total 444.16 last 27.60) - /unlink 10541 (time 1709055701.75 total 454.19 last 26.44) - /unlink 10810 (time 1709055711.77 total 464.21 last 26.84) - /unlink 11059 (time 1709055721.78 total 474.21 last 24.89) - /unlink 11325 (time 1709055731.80 total 484.23 last 26.54) - /unlink 11597 (time 1709055741.82 total 494.25 last 27.15) - /unlink 11825 (time 1709055751.84 total 504.28 last 22.75) - /unlink 12096 (time 1709055761.85 total 514.28 last 27.08) - /unlink 12366 (time 1709055771.88 total 524.32 last 26.90) - /unlink 12630 (time 1709055781.90 total 534.33 last 26.36) - /unlink 12909 (time 1709055791.90 total 544.34 last 27.88) - /unlink 13176 (time 1709055801.92 total 554.35 last 26.67) - /unlink 13463 (time 1709055811.95 total 564.38 last 28.60) - /unlink 13708 (time 1709055821.99 total 574.42 last 24.40) - /unlink 13968 (time 1709055832.01 total 584.45 last 25.94) - /unlink 14254 (time 1709055842.05 total 594.48 last 28.51) - /unlink 14507 (time 1709055852.05 total 604.49 last 25.28) - /unlink 14768 (time 1709055862.06 total 614.49 last 26.09) - /unlink 15051 (time 1709055872.09 total 624.52 last 28.21) - /unlink 15326 (time 1709055882.10 total 634.53 last 27.47) - /unlink 15637 (time 1709055892.10 total 644.54 last 31.08) - /unlink 15934 (time 1709055902.13 total 654.56 last 29.63) - /unlink 16239 (time 1709055912.16 total 664.59 last 30.41) - /unlink 16524 (time 1709055922.19 total 674.63 last 28.41) - /unlink 16772 (time 1709055932.20 total 684.64 last 24.77) - /unlink 17070 (time 1709055942.21 total 694.65 last 29.77) - /unlink 17342 (time 1709055952.23 total 704.67 last 27.15) - /unlink 17641 (time 1709055962.27 total 714.70 last 29.80) - /unlink 17905 (time 1709055972.28 total 724.71 last 26.37) - /unlink 18184 (time 1709055982.28 total 734.72 last 27.89) - /unlink 18449 (time 1709055992.30 total 744.74 last 26.45) - /unlink 18746 (time 1709056002.31 total 754.75 last 29.67) - /unlink 19022 (time 1709056012.35 total 764.78 last 27.51) - /unlink 19325 (time 1709056022.36 total 774.80 last 30.24) - /unlink 19623 (time 1709056032.39 total 784.83 last 29.71) - /unlink 19908 (time 1709056042.42 total 794.85 last 28.42) - /unlink 20000 (time 1709056045.92 total 798.36 last 26.26) - /unlink 20268 (time 1709056055.96 total 808.39 last 26.71) - /unlink 20581 (time 1709056065.96 total 818.40 last 31.29) - /unlink 20898 (time 1709056075.98 total 828.41 last 31.66) - /unlink 21220 (time 1709056086.00 total 838.44 last 32.12) - /unlink 21562 (time 1709056096.01 total 848.44 last 34.18) - /unlink 21874 (time 1709056106.03 total 858.46 last 31.13) - /unlink 22190 (time 1709056116.03 total 868.46 last 31.60) - /unlink 22512 (time 1709056126.04 total 878.47 last 32.18) - /unlink 22826 (time 1709056136.04 total 888.47 last 31.40) - /unlink 23085 (time 1709056146.04 total 898.48 last 25.89) - /unlink 23346 (time 1709056156.07 total 908.51 last 26.02) - /unlink 23593 (time 1709056166.10 total 918.54 last 24.62) - /unlink 23853 (time 1709056176.14 total 928.57 last 25.92) - /unlink 24107 (time 1709056186.15 total 938.58 last 25.37) - /unlink 24404 (time 1709056196.17 total 948.61 last 29.63) - /unlink 24685 (time 1709056206.21 total 958.64 last 28.00) - /unlink 24974 (time 1709056216.24 total 968.67 last 28.81) - /unlink 25245 (time 1709056226.27 total 978.70 last 27.03) - /unlink 25531 (time 1709056236.29 total 988.73 last 28.52) - /unlink 25790 (time 1709056246.34 total 998.77 last 25.78) - /unlink 26057 (time 1709056256.36 total 1008.80 last 26.64) - /unlink 26325 (time 1709056266.37 total 1018.80 last 26.78) - /unlink 26579 (time 1709056276.37 total 1028.81 last 25.39) - /unlink 26893 (time 1709056286.38 total 1038.81 last 31.39) - /unlink 27147 (time 1709056296.38 total 1048.81 last 25.40) - /unlink 27450 (time 1709056306.39 total 1058.82 last 30.27) - /unlink 27682 (time 1709056316.42 total 1068.85 last 23.13) - /unlink 27973 (time 1709056326.44 total 1078.87 last 29.04) - /unlink 28307 (time 1709056336.45 total 1088.89 last 33.35) - /unlink 28572 (time 1709056346.46 total 1098.90 last 26.48) - /unlink 28828 (time 1709056356.48 total 1108.91 last 25.56) - /unlink 29165 (time 1709056366.48 total 1118.92 last 33.69) - /unlink 29496 (time 1709056376.49 total 1128.93 last 33.06) - /unlink 29824 (time 1709056386.51 total 1138.95 last 32.74) - /unlink 30000 (time 1709056392.10 total 1144.54 last 31.48) - /unlink 30370 (time 1709056402.11 total 1154.54 last 36.97) - /unlink 30724 (time 1709056412.13 total 1164.57 last 35.33) - /unlink 31067 (time 1709056422.14 total 1174.57 last 34.27) - /unlink 31439 (time 1709056432.16 total 1184.59 last 37.12) - /unlink 31827 (time 1709056442.17 total 1194.61 last 38.75) - /unlink 32139 (time 1709056452.20 total 1204.63 last 31.12) - /unlink 32493 (time 1709056462.20 total 1214.64 last 35.38) - /unlink 32887 (time 1709056472.22 total 1224.66 last 39.33) - /unlink 33281 (time 1709056482.25 total 1234.68 last 39.30) - /unlink 33677 (time 1709056492.26 total 1244.70 last 39.53) - /unlink 34104 (time 1709056502.28 total 1254.71 last 42.64) - /unlink 34511 (time 1709056512.30 total 1264.74 last 40.59) - /unlink 34947 (time 1709056522.32 total 1274.75 last 43.54) - /unlink 35371 (time 1709056532.34 total 1284.78 last 42.29) - /unlink 35784 (time 1709056542.37 total 1294.81 last 41.19) - /unlink 36142 (time 1709056552.39 total 1304.83 last 35.72) - /unlink 36482 (time 1709056562.40 total 1314.83 last 33.99) - /unlink 36856 (time 1709056572.42 total 1324.85 last 37.32) - /unlink 37306 (time 1709056582.43 total 1334.86 last 44.96) - /unlink 37764 (time 1709056592.43 total 1344.87 last 45.77) - /unlink 38186 (time 1709056602.45 total 1354.88 last 42.13) - /unlink 38602 (time 1709056612.45 total 1364.88 last 41.59) - /unlink 39032 (time 1709056622.47 total 1374.91 last 42.91) - /unlink 39418 (time 1709056632.49 total 1384.92 last 38.54) - /unlink 39890 (time 1709056642.49 total 1394.93 last 47.17) - /unlink 40360 (time 1709056652.51 total 1404.94 last 46.93) - /unlink 40807 (time 1709056662.52 total 1414.96 last 44.62) - /unlink 41238 (time 1709056672.54 total 1424.97 last 43.05) - /unlink 41666 (time 1709056682.55 total 1434.98 last 42.75) - /unlink 42159 (time 1709056692.56 total 1445.00 last 49.22) - /unlink 42644 (time 1709056702.57 total 1455.00 last 48.48) - /unlink 43129 (time 1709056712.57 total 1465.01 last 48.48) - /unlink 43612 (time 1709056722.58 total 1475.02 last 48.24) - /unlink 44063 (time 1709056732.60 total 1485.03 last 45.05) - /unlink 44601 (time 1709056742.60 total 1495.04 last 53.77) - /unlink 45055 (time 1709056752.61 total 1505.04 last 45.37) - /unlink 45538 (time 1709056762.61 total 1515.04 last 48.29) - /unlink 46037 (time 1709056772.63 total 1525.06 last 49.81) - /unlink 46563 (time 1709056782.63 total 1535.07 last 52.58) - /unlink 47179 (time 1709056792.64 total 1545.08 last 61.54) - /unlink 47785 (time 1709056802.66 total 1555.09 last 60.51) - /unlink 48404 (time 1709056812.67 total 1565.10 last 61.84) - /unlink 48979 (time 1709056822.67 total 1575.10 last 57.48) - /unlink 49656 (time 1709056832.68 total 1585.11 last 67.65) - /unlink 50000 (time 1709056838.13 total 1590.56 last 63.13) - /unlink 50749 (time 1709056848.13 total 1600.57 last 74.84) - /unlink 51598 (time 1709056858.15 total 1610.58 last 84.81) - /unlink 52463 (time 1709056868.16 total 1620.59 last 86.39) - /unlink 53286 (time 1709056878.16 total 1630.59 last 82.29) - /unlink 54216 (time 1709056888.16 total 1640.60 last 92.95) - /unlink 55146 (time 1709056898.17 total 1650.60 last 92.96) - /unlink 56254 (time 1709056908.17 total 1660.61 last 110.75) - /unlink 57254 (time 1709056918.17 total 1670.61 last 100.00) - /unlink 58483 (time 1709056928.18 total 1680.62 last 122.77) - /unlink 59847 (time 1709056938.19 total 1690.63 last 136.31) - /unlink 61317 (time 1709056948.19 total 1700.63 last 147.00) - /unlink 62988 (time 1709056958.19 total 1710.63 last 167.04) total: 64768 /unlink in 1719.45 seconds: 37.67 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete - open/close 1405 (time 1709056997.68 total 10.01 last 140.40) - open/close 2771 (time 1709057007.69 total 20.02 last 136.49) - open/close 3828 (time 1709057017.73 total 30.05 last 105.33) - open/close 4885 (time 1709057027.73 total 40.05 last 105.65) - open/close 6041 (time 1709057037.74 total 50.06 last 115.56) - open/close 7279 (time 1709057047.74 total 60.07 last 123.71) - open/close 8438 (time 1709057057.74 total 70.07 last 115.88) - open/close 9363 (time 1709057067.75 total 80.07 last 92.48) - open/close 10000 (time 1709057074.05 total 86.37 last 101.02) - open/close 10798 (time 1709057084.06 total 96.38 last 79.76) - open/close 11619 (time 1709057094.06 total 106.39 last 82.04) - open/close 12269 (time 1709057104.08 total 116.40 last 64.93) - open/close 13057 (time 1709057114.08 total 126.40 last 78.79) - open/close 13718 (time 1709057124.09 total 136.41 last 66.03) - open/close 14288 (time 1709057134.10 total 146.42 last 56.95) - open/close 14906 (time 1709057144.10 total 156.42 last 61.80) - open/close 15627 (time 1709057154.10 total 166.43 last 72.05) - open/close 16252 (time 1709057164.11 total 176.43 last 62.47) - open/close 16834 (time 1709057174.12 total 186.45 last 58.10) - open/close 17370 (time 1709057184.13 total 196.45 last 53.57) - open/close 17858 (time 1709057194.14 total 206.46 last 48.74) - open/close 18424 (time 1709057204.14 total 216.47 last 56.59) - open/close 18969 (time 1709057214.17 total 226.49 last 54.37) - open/close 19467 (time 1709057224.18 total 236.51 last 49.72) - open/close 19880 (time 1709057234.20 total 246.52 last 41.22) - open/close 20000 (time 1709057236.78 total 249.10 last 46.55) - open/close 20539 (time 1709057246.79 total 259.12 last 53.83) - open/close 21086 (time 1709057256.80 total 269.12 last 54.67) - open/close 21595 (time 1709057266.83 total 279.15 last 50.76) - open/close 22056 (time 1709057276.84 total 289.16 last 46.06) - open/close 22575 (time 1709057286.84 total 299.17 last 51.87) - open/close 23035 (time 1709057296.85 total 309.18 last 45.94) - open/close 23552 (time 1709057306.87 total 319.19 last 51.64) - open/close 24066 (time 1709057316.88 total 329.20 last 51.31) - open/close 24512 (time 1709057326.88 total 339.21 last 44.59) - open/close 24939 (time 1709057336.96 total 349.28 last 42.39) - open/close 25325 (time 1709057346.99 total 359.31 last 38.49) - open/close 25744 (time 1709057356.99 total 369.31 last 41.90) - open/close 26162 (time 1709057367.00 total 379.32 last 41.74) - open/close 26539 (time 1709057377.01 total 389.33 last 37.67) - open/close 26937 (time 1709057387.03 total 399.35 last 39.72) - open/close 27250 (time 1709057397.07 total 409.40 last 31.16) - open/close 27573 (time 1709057407.10 total 419.42 last 32.22) - open/close 27954 (time 1709057417.11 total 429.44 last 38.03) - open/close 28282 (time 1709057427.12 total 439.45 last 32.77) - open/close 28602 (time 1709057437.15 total 449.47 last 31.92) - open/close 28908 (time 1709057447.17 total 459.49 last 30.54) - open/close 29243 (time 1709057457.22 total 469.54 last 33.34) - open/close 29565 (time 1709057467.22 total 479.54 last 32.20) - open/close 29916 (time 1709057477.24 total 489.56 last 35.03) - open/close 30000 (time 1709057479.48 total 491.80 last 37.47) - open/close 30404 (time 1709057489.50 total 501.82 last 40.32) - open/close 30730 (time 1709057499.52 total 511.85 last 32.51) - open/close 31057 (time 1709057509.54 total 521.87 last 32.64) - open/close 31379 (time 1709057519.55 total 531.87 last 32.18) - open/close 31695 (time 1709057529.60 total 541.92 last 31.44) - open/close 31995 (time 1709057539.60 total 551.93 last 29.99) - open/close 32305 (time 1709057549.61 total 561.93 last 30.98) - open/close 32573 (time 1709057559.62 total 571.94 last 26.78) - open/close 32839 (time 1709057569.64 total 581.96 last 26.55) - open/close 33149 (time 1709057579.75 total 592.08 last 30.64) - open/close 33481 (time 1709057589.75 total 602.08 last 33.20) - open/close 33781 (time 1709057599.77 total 612.09 last 29.96) - open/close 34113 (time 1709057609.77 total 622.10 last 33.18) - open/close 34473 (time 1709057619.81 total 632.13 last 35.86) - open/close 34809 (time 1709057629.82 total 642.14 last 33.58) - open/close 35146 (time 1709057639.82 total 652.14 last 33.69) - open/close 35494 (time 1709057649.83 total 662.15 last 34.77) - open/close 35830 (time 1709057659.85 total 672.17 last 33.52) - open/close 36145 (time 1709057669.88 total 682.20 last 31.41) - open/close 36469 (time 1709057679.90 total 692.22 last 32.34) - open/close 36766 (time 1709057689.92 total 702.24 last 29.65) - open/close 37025 (time 1709057699.92 total 712.25 last 25.89) - open/close 37322 (time 1709057709.96 total 722.29 last 29.57) - open/close 37594 (time 1709057720.05 total 732.37 last 26.97) - open/close 37892 (time 1709057730.07 total 742.39 last 29.74) - open/close 38188 (time 1709057740.11 total 752.43 last 29.49) - open/close 38483 (time 1709057750.12 total 762.44 last 29.47) - open/close 38850 (time 1709057760.13 total 772.45 last 36.65) - open/close 39281 (time 1709057770.14 total 782.46 last 43.06) - open/close 39644 (time 1709057780.16 total 792.48 last 36.24) - open/close 40000 (time 1709057788.60 total 800.92 last 42.17) - open/close 40513 (time 1709057798.61 total 810.93 last 51.27) - open/close 40935 (time 1709057808.61 total 820.93 last 42.19) - open/close 41357 (time 1709057818.64 total 830.96 last 42.07) - open/close 41736 (time 1709057828.66 total 840.99 last 37.81) - open/close 42137 (time 1709057838.67 total 850.99 last 40.07) - open/close 42586 (time 1709057848.71 total 861.03 last 44.74) - open/close 42950 (time 1709057858.71 total 871.03 last 36.39) - open/close 43284 (time 1709057868.76 total 881.08 last 33.23) - open/close 43587 (time 1709057878.78 total 891.10 last 30.25) - open/close 43892 (time 1709057888.78 total 901.10 last 30.49) - open/close 44195 (time 1709057898.79 total 911.11 last 30.27) - open/close 44551 (time 1709057908.81 total 921.14 last 35.52) - open/close 44932 (time 1709057918.84 total 931.16 last 38.02) - open/close 45300 (time 1709057928.85 total 941.17 last 36.76) - open/close 45650 (time 1709057938.87 total 951.19 last 34.91) - open/close 46016 (time 1709057948.89 total 961.21 last 36.53) - open/close 46383 (time 1709057958.92 total 971.24 last 36.60) - open/close 46711 (time 1709057968.96 total 981.28 last 32.66) - open/close 47029 (time 1709057978.98 total 991.30 last 31.74) - open/close 47373 (time 1709057988.98 total 1001.31 last 34.38) - open/close 47707 (time 1709057998.99 total 1011.31 last 33.38) - open/close 48004 (time 1709058009.02 total 1021.35 last 29.60) - open/close 48292 (time 1709058019.03 total 1031.35 last 28.79) - open/close 48590 (time 1709058029.04 total 1041.36 last 29.77) - open/close 48910 (time 1709058039.05 total 1051.37 last 31.95) - open/close 49231 (time 1709058049.06 total 1061.39 last 32.06) - open/close 49564 (time 1709058059.08 total 1071.41 last 33.23) - open/close 49925 (time 1709058069.09 total 1081.41 last 36.09) - open/close 50234 (time 1709058079.11 total 1091.44 last 30.82) - open/close 50529 (time 1709058089.14 total 1101.46 last 29.44) - open/close 50823 (time 1709058099.16 total 1111.48 last 29.33) - open/close 51125 (time 1709058109.16 total 1121.49 last 30.19) - open/close 51424 (time 1709058119.19 total 1131.51 last 29.83) - open/close 51685 (time 1709058129.27 total 1141.59 last 25.90) - open/close 51943 (time 1709058139.27 total 1151.59 last 25.79) - open/close 52233 (time 1709058149.29 total 1161.62 last 28.94) - open/close 52513 (time 1709058159.33 total 1171.65 last 27.91) - open/close 52857 (time 1709058169.34 total 1181.66 last 34.36) - open/close 53188 (time 1709058179.35 total 1191.68 last 33.04) - open/close 53440 (time 1709058197.84 total 1210.16 last 13.63) - open/close 53720 (time 1709058207.84 total 1220.17 last 27.98) - open/close 53968 (time 1709058217.87 total 1230.19 last 24.74) - open/close 54251 (time 1709058227.88 total 1240.21 last 28.26) - open/close 54521 (time 1709058237.90 total 1250.22 last 26.96) - open/close 54822 (time 1709058247.91 total 1260.23 last 30.07) - open/close 55115 (time 1709058257.94 total 1270.26 last 29.22) - open/close 55410 (time 1709058267.95 total 1280.27 last 29.46) - open/close 55681 (time 1709058277.96 total 1290.29 last 27.07) - open/close 55941 (time 1709058287.99 total 1300.32 last 25.92) - open/close 55962 (time 1709058300.03 total 1312.35 last 1.74) - open/close 56210 (time 1709058310.09 total 1322.41 last 24.66) - open/close 56539 (time 1709058320.10 total 1332.43 last 32.85) - open/close 56821 (time 1709058330.12 total 1342.44 last 28.16) - open/close 57089 (time 1709058340.13 total 1352.46 last 26.76) - open/close 57310 (time 1709058350.17 total 1362.49 last 22.02) - open/close 57561 (time 1709058360.18 total 1372.50 last 25.08) - open/close 57806 (time 1709058370.21 total 1382.54 last 24.41) - open/close 58049 (time 1709058380.22 total 1392.54 last 24.28) - open/close 58270 (time 1709058390.25 total 1402.58 last 22.03) - open/close 58490 (time 1709058400.33 total 1412.65 last 21.83) - open/close 58699 (time 1709058410.35 total 1422.67 last 20.86) - open/close 58907 (time 1709058420.40 total 1432.73 last 20.69) - open/close 59121 (time 1709058430.43 total 1442.75 last 21.35) - open/close 59364 (time 1709058440.44 total 1452.77 last 24.26) - open/close 59607 (time 1709058450.45 total 1462.78 last 24.27) - open/close 59847 (time 1709058460.47 total 1472.79 last 23.97) - open/close 60000 (time 1709058466.77 total 1479.09 last 24.27) - open/close 60223 (time 1709058476.77 total 1489.10 last 22.29) - open/close 60427 (time 1709058486.81 total 1499.13 last 20.33) - open/close 60645 (time 1709058496.81 total 1509.14 last 21.78) - open/close 60858 (time 1709058506.85 total 1519.17 last 21.23) - open/close 61065 (time 1709058516.86 total 1529.18 last 20.67) - open/close 61263 (time 1709058526.87 total 1539.20 last 19.78) - open/close 61480 (time 1709058536.89 total 1549.22 last 21.66) - open/close 61696 (time 1709058546.91 total 1559.23 last 21.56) - open/close 61914 (time 1709058556.93 total 1569.25 last 21.76) - open/close 62137 (time 1709058566.96 total 1579.28 last 22.24) - open/close 62378 (time 1709058576.98 total 1589.30 last 24.04) - open/close 62627 (time 1709058587.01 total 1599.33 last 24.83) - open/close 62862 (time 1709058597.03 total 1609.35 last 23.46) - open/close 63110 (time 1709058607.04 total 1619.36 last 24.77) - open/close 63346 (time 1709058617.04 total 1629.37 last 23.59) - open/close 63667 (time 1709058627.07 total 1639.39 last 32.01) - open/close 63915 (time 1709058637.09 total 1649.41 last 24.76) - open/close 64173 (time 1709058647.11 total 1659.43 last 25.74) - open/close 64412 (time 1709058657.12 total 1669.44 last 23.89) - open/close 64670 (time 1709058667.15 total 1679.48 last 25.70) total: 64768 open/close in 1683.92 seconds: 38.46 ops/second