== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 23:55:27 (1746071727) Stopping clients: oleg137-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg137-client.virtnet /mnt/lustre2 (opts:-f) oleg137-server: oleg137-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: MODOPTS_LIBCFS= oleg137-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg137-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg137-server: oleg137-server.virtnet: executing set_default_debug -1 all pdsh@oleg137-client: oleg137-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg137-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg137-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg137-server: oleg137-server.virtnet: executing set_default_debug -1 all pdsh@oleg137-client: oleg137-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg137-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg137-client.virtnet: -o user_xattr,flock 192.168.201.137@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 32648 392 32256 2% /mnt/lustre[OST:0] filesystem_summary: 32585 329 32256 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 966 (time 1746071801.96 total 10.01 last 96.55) - open/close 1721 (time 1746071811.96 total 20.01 last 75.49) - open/close 2543 (time 1746071821.96 total 30.01 last 82.18) - open/close 3542 (time 1746071831.97 total 40.02 last 99.82) - open/close 4456 (time 1746071841.98 total 50.02 last 91.34) - open/close 5317 (time 1746071851.98 total 60.02 last 86.10) - open/close 6291 (time 1746071861.98 total 70.03 last 97.36) - open/close 7222 (time 1746071871.99 total 80.03 last 93.05) - open/close 8186 (time 1746071881.99 total 90.04 last 96.38) - open/close 9003 (time 1746071892.00 total 100.05 last 81.57) - open/close 9855 (time 1746071902.01 total 110.06 last 85.14) - open/close 10761 (time 1746071912.01 total 120.06 last 90.60) - open/close 11748 (time 1746071922.01 total 130.06 last 98.70) - open/close 12554 (time 1746071932.03 total 140.08 last 80.45) - open/close 13280 (time 1746071942.04 total 150.09 last 72.54) - open/close 14099 (time 1746071952.04 total 160.09 last 81.88) - open/close 14876 (time 1746071962.05 total 170.09 last 77.66) - open/close 15719 (time 1746071972.05 total 180.10 last 84.26) - open/close 16511 (time 1746071982.06 total 190.11 last 79.10) - open/close 17277 (time 1746071992.06 total 200.11 last 76.59) - open/close 18151 (time 1746072002.07 total 210.12 last 87.30) - open/close 18934 (time 1746072012.08 total 220.13 last 78.23) - open/close 19697 (time 1746072022.08 total 230.13 last 76.30) - open/close 20000 (time 1746072025.89 total 233.94 last 79.58) - open/close 20850 (time 1746072035.91 total 243.96 last 84.82) - open/close 21601 (time 1746072045.91 total 253.96 last 75.08) - open/close 22369 (time 1746072055.92 total 263.97 last 76.76) - open/close 23167 (time 1746072065.92 total 273.97 last 79.76) - open/close 23968 (time 1746072075.93 total 283.98 last 80.04) - open/close 24791 (time 1746072085.96 total 294.00 last 82.10) - open/close 25512 (time 1746072095.97 total 304.02 last 72.00) - open/close 26303 (time 1746072105.97 total 314.02 last 79.10) - open/close 27069 (time 1746072115.97 total 324.02 last 76.58) - open/close 27855 (time 1746072125.97 total 334.02 last 78.59) - open/close 28893 (time 1746072135.98 total 344.03 last 103.72) - open/close 29768 (time 1746072146.00 total 354.04 last 87.36) - open/close 30000 (time 1746072148.82 total 356.87 last 82.07) - open/close 30825 (time 1746072158.83 total 366.88 last 82.42) - open/close 31607 (time 1746072168.84 total 376.88 last 78.17) - open/close 32608 (time 1746072178.84 total 386.89 last 100.09) - open/close 33649 (time 1746072188.84 total 396.89 last 104.07) - open/close 34565 (time 1746072198.85 total 406.89 last 91.55) - open/close 35362 (time 1746072208.86 total 416.90 last 79.63) - open/close 36232 (time 1746072218.86 total 426.91 last 86.98) - open/close 37065 (time 1746072228.86 total 436.91 last 83.27) - open/close 38016 (time 1746072238.87 total 446.92 last 95.01) - open/close 38903 (time 1746072248.88 total 456.92 last 88.67) - open/close 39684 (time 1746072258.88 total 466.92 last 78.09) - open/close 40000 (time 1746072262.80 total 470.84 last 80.59) - open/close 40692 (time 1746072272.80 total 480.85 last 69.16) - open/close 41338 (time 1746072282.81 total 490.86 last 64.55) - open/close 42090 (time 1746072292.82 total 500.87 last 75.12) - open/close 42883 (time 1746072302.83 total 510.88 last 79.24) - open/close 43611 (time 1746072312.84 total 520.88 last 72.74) - open/close 44359 (time 1746072322.86 total 530.90 last 74.65) - open/close 45105 (time 1746072332.86 total 540.91 last 74.57) - open/close 45870 (time 1746072342.86 total 550.91 last 76.49) - open/close 46731 (time 1746072352.87 total 560.91 last 86.06) - open/close 47573 (time 1746072362.87 total 570.92 last 84.16) - open/close 48305 (time 1746072372.87 total 580.92 last 73.20) - open/close 49153 (time 1746072382.88 total 590.92 last 84.75) - open/close 50000 (time 1746072392.62 total 600.66 last 86.97) - open/close 50728 (time 1746072402.62 total 610.66 last 72.80) - open/close 51567 (time 1746072412.62 total 620.66 last 83.90) - open/close 52324 (time 1746072422.62 total 630.67 last 75.68) - open/close 53114 (time 1746072432.62 total 640.67 last 78.95) - open/close 53895 (time 1746072442.63 total 650.67 last 78.08) - open/close 54702 (time 1746072452.63 total 660.68 last 80.68) - open/close 55497 (time 1746072462.64 total 670.69 last 79.42) - open/close 56214 (time 1746072472.64 total 680.69 last 71.67) - open/close 56921 (time 1746072482.64 total 690.69 last 70.70) - open/close 57700 (time 1746072492.65 total 700.70 last 77.82) - open/close 58398 (time 1746072502.68 total 710.72 last 69.63) - open/close 59091 (time 1746072512.68 total 720.73 last 69.27) - open/close 59840 (time 1746072522.68 total 730.73 last 74.87) - open/close 60000 (time 1746072524.88 total 732.92 last 73.04) - open/close 60718 (time 1746072534.88 total 742.93 last 71.78) - open/close 61457 (time 1746072544.89 total 752.94 last 73.82) - open/close 62189 (time 1746072554.90 total 762.94 last 73.16) - open/close 62944 (time 1746072564.91 total 772.96 last 75.38) - open/close 63858 (time 1746072574.91 total 782.96 last 91.37) - open/close 64634 (time 1746072584.92 total 792.97 last 77.53) total: 64768 open/close in 794.88 seconds: 81.48 ops/second - /unlink 706 (time 1746072599.58 total 10.00 last 70.59) - /unlink 1345 (time 1746072609.58 total 20.00 last 63.89) - /unlink 2046 (time 1746072619.59 total 30.01 last 70.07) - /unlink 2871 (time 1746072629.59 total 40.01 last 82.45) - /unlink 3529 (time 1746072639.60 total 50.02 last 65.74) - /unlink 4216 (time 1746072649.63 total 60.05 last 68.54) - /unlink 4854 (time 1746072659.64 total 70.06 last 63.73) - /unlink 5633 (time 1746072669.64 total 80.06 last 77.88) - /unlink 6366 (time 1746072679.64 total 90.06 last 73.29) - /unlink 7107 (time 1746072689.64 total 100.06 last 74.10) - /unlink 7961 (time 1746072699.65 total 110.07 last 85.36) - /unlink 8722 (time 1746072709.65 total 120.07 last 76.06) - /unlink 9423 (time 1746072719.66 total 130.08 last 70.03) - /unlink 10000 (time 1746072728.17 total 138.59 last 67.80) - /unlink 10758 (time 1746072738.18 total 148.60 last 75.72) - /unlink 11458 (time 1746072748.19 total 158.61 last 69.92) - /unlink 12157 (time 1746072758.21 total 168.63 last 69.78) - /unlink 12928 (time 1746072768.21 total 178.63 last 77.10) - /unlink 13657 (time 1746072778.22 total 188.64 last 72.85) - /unlink 14489 (time 1746072788.23 total 198.65 last 83.12) - /unlink 15389 (time 1746072798.23 total 208.65 last 89.97) - /unlink 16184 (time 1746072808.24 total 218.66 last 79.43) - /unlink 16915 (time 1746072818.24 total 228.66 last 73.08) - /unlink 17676 (time 1746072828.24 total 238.67 last 76.09) - /unlink 18414 (time 1746072838.25 total 248.67 last 73.77) - /unlink 19168 (time 1746072848.25 total 258.67 last 75.36) - /unlink 19924 (time 1746072858.26 total 268.68 last 75.57) - /unlink 20581 (time 1746072868.26 total 278.68 last 65.68) - /unlink 21219 (time 1746072878.27 total 288.69 last 63.75) - /unlink 21914 (time 1746072888.28 total 298.70 last 69.39) - /unlink 22680 (time 1746072898.30 total 308.72 last 76.45) - /unlink 23560 (time 1746072908.30 total 318.73 last 87.98) - /unlink 24301 (time 1746072918.32 total 328.74 last 73.98) - /unlink 25103 (time 1746072928.33 total 338.75 last 80.16) - /unlink 25948 (time 1746072938.33 total 348.75 last 84.49) - /unlink 26749 (time 1746072948.33 total 358.76 last 80.05) - /unlink 27652 (time 1746072958.34 total 368.76 last 90.27) - /unlink 28472 (time 1746072968.34 total 378.76 last 81.98) - /unlink 29220 (time 1746072978.35 total 388.77 last 74.74) - /unlink 29934 (time 1746072988.35 total 398.78 last 71.36) - /unlink 30742 (time 1746072998.36 total 408.78 last 80.78) - /unlink 31561 (time 1746073008.36 total 418.78 last 81.88) - /unlink 32366 (time 1746073018.36 total 428.78 last 80.47) - /unlink 33138 (time 1746073028.36 total 438.79 last 77.19) - /unlink 33890 (time 1746073038.38 total 448.80 last 75.07) - /unlink 34659 (time 1746073048.38 total 458.81 last 76.88) - /unlink 35514 (time 1746073058.40 total 468.83 last 85.32) - /unlink 36254 (time 1746073068.42 total 478.84 last 73.90) - /unlink 37077 (time 1746073078.42 total 488.84 last 82.29) - /unlink 38093 (time 1746073088.43 total 498.85 last 101.52) - /unlink 38939 (time 1746073098.44 total 508.86 last 84.48) - /unlink 39649 (time 1746073108.45 total 518.87 last 70.96) - /unlink 40000 (time 1746073113.48 total 523.90 last 69.67) - /unlink 40748 (time 1746073123.49 total 533.91 last 74.79) - /unlink 41556 (time 1746073133.49 total 543.91 last 80.78) - /unlink 42338 (time 1746073143.49 total 553.91 last 78.18) - /unlink 43179 (time 1746073153.49 total 563.91 last 84.09) - /unlink 44023 (time 1746073163.49 total 573.92 last 84.37) - /unlink 44814 (time 1746073173.50 total 583.92 last 79.06) - /unlink 45736 (time 1746073183.50 total 593.93 last 92.15) - /unlink 46655 (time 1746073193.51 total 603.93 last 91.83) - /unlink 47623 (time 1746073203.51 total 613.93 last 96.79) - /unlink 48710 (time 1746073213.52 total 623.94 last 108.68) - /unlink 49566 (time 1746073223.52 total 633.94 last 85.55) - /unlink 50000 (time 1746073228.75 total 639.17 last 83.06) - /unlink 50809 (time 1746073238.75 total 649.17 last 80.87) - /unlink 51662 (time 1746073248.75 total 659.17 last 85.30) - /unlink 52649 (time 1746073258.75 total 669.17 last 98.70) - /unlink 53672 (time 1746073268.76 total 679.18 last 102.21) - /unlink 54652 (time 1746073278.77 total 689.19 last 97.90) - /unlink 55533 (time 1746073288.78 total 699.20 last 88.05) - /unlink 56434 (time 1746073298.78 total 709.20 last 90.05) - /unlink 57291 (time 1746073308.79 total 719.21 last 85.66) - /unlink 58104 (time 1746073318.79 total 729.21 last 81.27) - /unlink 58997 (time 1746073328.80 total 739.22 last 89.18) - /unlink 59996 (time 1746073338.80 total 749.22 last 99.90) - /unlink 60950 (time 1746073348.81 total 759.23 last 95.36) - /unlink 61833 (time 1746073358.81 total 769.23 last 88.25) - /unlink 62665 (time 1746073368.82 total 779.24 last 83.17) - /unlink 63542 (time 1746073378.82 total 789.24 last 87.68) - /unlink 64356 (time 1746073388.82 total 799.24 last 81.37) total: 64768 /unlink in 804.36 seconds: 80.52 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 738 (time 1746073426.20 total 10.02 last 73.65) - open/close 1521 (time 1746073436.20 total 20.02 last 78.27) - open/close 2325 (time 1746073446.20 total 30.03 last 80.38) - open/close 3182 (time 1746073456.21 total 40.03 last 85.68) - open/close 4107 (time 1746073466.21 total 50.03 last 92.47) - open/close 4940 (time 1746073476.21 total 60.04 last 83.27) - open/close 5767 (time 1746073486.22 total 70.05 last 82.62) - open/close 6648 (time 1746073496.23 total 80.05 last 88.06) - open/close 7563 (time 1746073506.24 total 90.06 last 91.43) - open/close 8511 (time 1746073516.25 total 100.07 last 94.71) - open/close 9411 (time 1746073526.25 total 110.07 last 89.96) - open/close 10000 (time 1746073532.99 total 116.81 last 87.42) - open/close 10872 (time 1746073542.99 total 126.81 last 87.18) - open/close 11803 (time 1746073552.99 total 136.82 last 93.08) - open/close 12620 (time 1746073563.00 total 146.82 last 81.66) - open/close 13393 (time 1746073573.01 total 156.83 last 77.21) - open/close 14298 (time 1746073583.01 total 166.83 last 90.50) - open/close 15174 (time 1746073593.01 total 176.83 last 87.59) - open/close 15985 (time 1746073603.03 total 186.85 last 80.95) - open/close 16858 (time 1746073613.03 total 196.85 last 87.29) - open/close 17691 (time 1746073623.04 total 206.86 last 83.24) - open/close 18616 (time 1746073633.05 total 216.87 last 92.36) - open/close 19505 (time 1746073643.06 total 226.89 last 88.79) - open/close 20000 (time 1746073649.78 total 233.60 last 73.75) - open/close 20831 (time 1746073659.78 total 243.60 last 83.08) - open/close 21680 (time 1746073669.79 total 253.61 last 84.81) - open/close 22510 (time 1746073679.79 total 263.61 last 83.00) - open/close 23253 (time 1746073689.79 total 273.62 last 74.26) - open/close 23973 (time 1746073699.80 total 283.63 last 71.93) - open/close 24884 (time 1746073709.81 total 293.63 last 91.09) - open/close 25724 (time 1746073719.81 total 303.63 last 83.97) - open/close 26518 (time 1746073729.81 total 313.64 last 79.36) - open/close 27293 (time 1746073739.82 total 323.65 last 77.43) - open/close 28246 (time 1746073749.82 total 333.65 last 95.28) - open/close 29146 (time 1746073759.83 total 343.65 last 89.97) - open/close 29898 (time 1746073769.84 total 353.66 last 75.15) - open/close 30622 (time 1746073779.84 total 363.66 last 72.35) - open/close 31364 (time 1746073789.85 total 373.67 last 74.16) - open/close 32164 (time 1746073799.85 total 383.68 last 79.95) - open/close 32877 (time 1746073809.86 total 393.68 last 71.27) - open/close 33654 (time 1746073819.86 total 403.68 last 77.67) - open/close 34554 (time 1746073829.87 total 413.69 last 89.94) - open/close 35370 (time 1746073839.89 total 423.71 last 81.46) - open/close 36259 (time 1746073849.89 total 433.72 last 88.84) - open/close 37095 (time 1746073859.90 total 443.72 last 83.52) - open/close 37928 (time 1746073869.90 total 453.73 last 83.28) - open/close 38883 (time 1746073879.91 total 463.73 last 95.45) - open/close 39788 (time 1746073889.91 total 473.74 last 90.47) - open/close 40000 (time 1746073892.41 total 476.23 last 84.87) - open/close 40894 (time 1746073902.41 total 486.24 last 89.37) - open/close 41827 (time 1746073912.42 total 496.24 last 93.26) - open/close 42690 (time 1746073922.42 total 506.24 last 86.29) - open/close 43581 (time 1746073932.43 total 516.25 last 89.00) - open/close 44549 (time 1746073942.44 total 526.26 last 96.74) - open/close 45447 (time 1746073952.44 total 536.26 last 89.80) - open/close 46298 (time 1746073962.44 total 546.27 last 85.05) - open/close 47346 (time 1746073972.44 total 556.27 last 104.79) - open/close 48331 (time 1746073982.45 total 566.27 last 98.43) - open/close 49209 (time 1746073992.46 total 576.29 last 87.70) - open/close 50000 (time 1746074000.53 total 584.36 last 98.00) - open/close 50862 (time 1746074010.55 total 594.37 last 86.06) - open/close 51658 (time 1746074020.56 total 604.38 last 79.52) - open/close 52496 (time 1746074030.57 total 614.39 last 83.72) - open/close 53412 (time 1746074040.58 total 624.40 last 91.54) - open/close 54291 (time 1746074050.58 total 634.41 last 87.84) - open/close 55142 (time 1746074060.59 total 644.41 last 85.04) - open/close 56007 (time 1746074070.60 total 654.42 last 86.44) - open/close 56847 (time 1746074080.61 total 664.43 last 83.94) - open/close 57697 (time 1746074090.61 total 674.44 last 84.94) - open/close 58546 (time 1746074100.61 total 684.44 last 84.88) - open/close 59328 (time 1746074110.62 total 694.44 last 78.15) - open/close 60000 (time 1746074118.71 total 702.54 last 83.05) - open/close 60879 (time 1746074128.72 total 712.54 last 87.83) - open/close 61774 (time 1746074138.73 total 722.55 last 89.46) - open/close 62681 (time 1746074148.73 total 732.55 last 90.70) - open/close 63638 (time 1746074158.73 total 742.55 last 95.70) - open/close 64502 (time 1746074168.73 total 752.55 last 86.36) total: 64768 open/close in 755.66 seconds: 85.71 ops/second - /unlink 1017 (time 1746074184.27 total 10.00 last 101.66) - /unlink 2005 (time 1746074194.27 total 20.01 last 98.76) - /unlink 2872 (time 1746074204.28 total 30.02 last 86.62) - /unlink 3820 (time 1746074214.28 total 40.02 last 94.76) - /unlink 4743 (time 1746074224.29 total 50.03 last 92.22) - /unlink 5574 (time 1746074234.30 total 60.04 last 83.05) - /unlink 6343 (time 1746074244.30 total 70.04 last 76.88) - /unlink 7133 (time 1746074254.31 total 80.05 last 78.90) - /unlink 7893 (time 1746074264.31 total 90.05 last 76.00) - /unlink 8713 (time 1746074274.32 total 100.05 last 81.98) - /unlink 9603 (time 1746074284.32 total 110.06 last 88.98) - /unlink 10000 (time 1746074288.79 total 114.53 last 88.77) - /unlink 10875 (time 1746074298.79 total 124.53 last 87.47) - /unlink 11799 (time 1746074308.80 total 134.54 last 92.37) - /unlink 12621 (time 1746074318.80 total 144.54 last 82.15) - /unlink 13416 (time 1746074328.81 total 154.55 last 79.45) - /unlink 14151 (time 1746074338.81 total 164.55 last 73.48) - /unlink 14965 (time 1746074348.82 total 174.56 last 81.36) - /unlink 15705 (time 1746074358.82 total 184.56 last 73.98) - /unlink 16444 (time 1746074368.83 total 194.56 last 73.85) - /unlink 17253 (time 1746074378.84 total 204.57 last 80.83) - /unlink 18087 (time 1746074388.84 total 214.58 last 83.34) - /unlink 18910 (time 1746074398.85 total 224.59 last 82.23) - /unlink 19685 (time 1746074408.86 total 234.59 last 77.47) - /unlink 20000 (time 1746074412.49 total 238.22 last 86.77) - /unlink 20839 (time 1746074422.49 total 248.23 last 83.85) - /unlink 21635 (time 1746074432.50 total 258.24 last 79.53) - /unlink 22325 (time 1746074442.50 total 268.24 last 68.98) - /unlink 23059 (time 1746074452.51 total 278.25 last 73.33) - /unlink 23869 (time 1746074462.51 total 288.25 last 81.00) - /unlink 24760 (time 1746074472.51 total 298.25 last 89.10) - /unlink 25541 (time 1746074482.52 total 308.25 last 78.08) - /unlink 26414 (time 1746074492.52 total 318.25 last 87.30) - /unlink 27282 (time 1746074502.53 total 328.27 last 86.70) - /unlink 28105 (time 1746074512.53 total 338.27 last 82.25) - /unlink 28782 (time 1746074522.54 total 348.28 last 67.68) - /unlink 29465 (time 1746074532.55 total 358.28 last 68.24) - /unlink 30000 (time 1746074538.94 total 364.68 last 83.67) - /unlink 30855 (time 1746074548.94 total 374.68 last 85.46) - /unlink 31727 (time 1746074558.96 total 384.70 last 87.05) - /unlink 32602 (time 1746074568.96 total 394.70 last 87.49) - /unlink 33438 (time 1746074578.96 total 404.70 last 83.58) - /unlink 34316 (time 1746074588.97 total 414.71 last 87.77) - /unlink 35169 (time 1746074598.97 total 424.71 last 85.30) - /unlink 35923 (time 1746074608.97 total 434.71 last 75.39) - /unlink 36697 (time 1746074618.98 total 444.72 last 77.30) - /unlink 37561 (time 1746074628.99 total 454.73 last 86.35) - /unlink 38372 (time 1746074639.00 total 464.74 last 80.99) - /unlink 39256 (time 1746074649.01 total 474.75 last 88.33) - /unlink 40000 (time 1746074658.04 total 483.78 last 82.39) - /unlink 40881 (time 1746074668.05 total 493.78 last 88.03) - /unlink 41666 (time 1746074678.05 total 503.78 last 78.50) - /unlink 42508 (time 1746074688.05 total 513.79 last 84.15) - /unlink 43404 (time 1746074698.06 total 523.80 last 89.50) - /unlink 44165 (time 1746074708.08 total 533.82 last 75.99) - /unlink 44917 (time 1746074718.09 total 543.83 last 75.13) - /unlink 45706 (time 1746074728.10 total 553.83 last 78.83) - /unlink 46577 (time 1746074738.10 total 563.84 last 87.06) - /unlink 47470 (time 1746074748.11 total 573.85 last 89.18) - /unlink 48392 (time 1746074758.13 total 583.87 last 92.06) - /unlink 49180 (time 1746074768.14 total 593.87 last 78.75) - /unlink 50000 (time 1746074778.10 total 603.84 last 82.28) - /unlink 50813 (time 1746074788.11 total 613.85 last 81.24) - /unlink 51662 (time 1746074798.12 total 623.86 last 84.83) - /unlink 52561 (time 1746074808.13 total 633.87 last 89.75) - /unlink 53633 (time 1746074818.14 total 643.88 last 107.17) - /unlink 54641 (time 1746074828.14 total 653.88 last 100.78) - /unlink 55596 (time 1746074838.14 total 663.88 last 95.48) - /unlink 56516 (time 1746074848.16 total 673.89 last 91.87) - /unlink 57578 (time 1746074858.16 total 683.90 last 106.16) - /unlink 58645 (time 1746074868.16 total 693.90 last 106.68) - /unlink 59519 (time 1746074878.16 total 703.90 last 87.38) - /unlink 60000 (time 1746074883.90 total 709.64 last 83.81) - /unlink 60903 (time 1746074893.91 total 719.65 last 90.22) - /unlink 61786 (time 1746074903.91 total 729.65 last 88.29) - /unlink 62795 (time 1746074913.92 total 739.65 last 100.87) - /unlink 63689 (time 1746074923.92 total 749.66 last 89.32) - /unlink 64519 (time 1746074933.93 total 759.66 last 82.98) total: 64768 /unlink in 762.29 seconds: 84.97 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 980 (time 1746074967.33 total 10.00 last 97.97) - open/close 1934 (time 1746074977.35 total 20.02 last 95.22) - open/close 3026 (time 1746074987.36 total 30.03 last 109.10) - open/close 4180 (time 1746074997.36 total 40.03 last 115.38) - open/close 5264 (time 1746075007.37 total 50.04 last 108.33) - open/close 6284 (time 1746075017.37 total 60.05 last 101.91) - open/close 7204 (time 1746075027.38 total 70.05 last 91.94) - open/close 8094 (time 1746075037.38 total 80.06 last 88.98) - open/close 9049 (time 1746075047.40 total 90.08 last 95.33) - open/close 9951 (time 1746075057.41 total 100.08 last 90.14) - open/close 10783 (time 1746075067.41 total 110.08 last 83.20) - open/close 11646 (time 1746075077.42 total 120.09 last 86.22) - open/close 12536 (time 1746075087.43 total 130.10 last 88.93) - open/close 13424 (time 1746075097.43 total 140.11 last 88.73) - open/close 14315 (time 1746075107.44 total 150.11 last 89.08) - open/close 15183 (time 1746075117.44 total 160.11 last 86.78) - open/close 16106 (time 1746075127.44 total 170.11 last 92.29) - open/close 16979 (time 1746075137.45 total 180.12 last 87.23) - open/close 17812 (time 1746075147.45 total 190.12 last 83.29) - open/close 18632 (time 1746075157.45 total 200.13 last 81.97) - open/close 19466 (time 1746075167.46 total 210.13 last 83.34) - open/close 20000 (time 1746075173.97 total 216.64 last 82.03) - open/close 20766 (time 1746075183.98 total 226.66 last 76.49) - open/close 21631 (time 1746075193.99 total 236.66 last 86.47) - open/close 22508 (time 1746075204.00 total 246.68 last 87.57) - open/close 23316 (time 1746075214.01 total 256.68 last 80.73) - open/close 24212 (time 1746075224.01 total 266.69 last 89.58) - open/close 25122 (time 1746075234.01 total 276.69 last 90.99) - open/close 25972 (time 1746075244.02 total 286.69 last 84.94) - open/close 26818 (time 1746075254.03 total 296.70 last 84.53) - open/close 27771 (time 1746075264.03 total 306.70 last 95.30) - open/close 28720 (time 1746075274.03 total 316.71 last 94.86) - open/close 29655 (time 1746075284.05 total 326.72 last 93.35) - open/close 30000 (time 1746075288.39 total 331.07 last 79.43) - open/close 30797 (time 1746075298.42 total 341.09 last 79.51) - open/close 31669 (time 1746075308.42 total 351.10 last 87.14) - open/close 32473 (time 1746075318.43 total 361.10 last 80.38) - open/close 33276 (time 1746075328.43 total 371.10 last 80.30) - open/close 34150 (time 1746075338.43 total 381.11 last 87.35) - open/close 35062 (time 1746075348.44 total 391.11 last 91.15) - open/close 35911 (time 1746075358.44 total 401.11 last 84.88) - open/close 36840 (time 1746075368.45 total 411.12 last 92.83) - open/close 37777 (time 1746075378.45 total 421.12 last 93.68) - open/close 38684 (time 1746075388.45 total 431.12 last 90.69) - open/close 39573 (time 1746075398.46 total 441.13 last 88.84) - open/close 40000 (time 1746075403.11 total 445.78 last 91.75) - open/close 40821 (time 1746075413.13 total 455.80 last 81.97) - open/close 41717 (time 1746075423.13 total 465.80 last 89.57) - open/close 42521 (time 1746075433.13 total 475.81 last 80.36) - open/close 43399 (time 1746075443.16 total 485.83 last 87.61) - open/close 44225 (time 1746075453.17 total 495.84 last 82.49) - open/close 45060 (time 1746075463.17 total 505.84 last 83.49) - open/close 45888 (time 1746075473.18 total 515.85 last 82.72) - open/close 46668 (time 1746075483.19 total 525.86 last 77.95) - open/close 47555 (time 1746075493.20 total 535.87 last 88.59) - open/close 48384 (time 1746075503.20 total 545.88 last 82.87) - open/close 49224 (time 1746075513.21 total 555.89 last 83.92) - open/close 50000 (time 1746075522.32 total 564.99 last 85.20) - open/close 50817 (time 1746075532.36 total 575.03 last 81.40) - open/close 51661 (time 1746075542.37 total 585.04 last 84.33) - open/close 52578 (time 1746075552.37 total 595.05 last 91.63) - open/close 53462 (time 1746075562.37 total 605.05 last 88.39) - open/close 54383 (time 1746075572.38 total 615.05 last 92.05) - open/close 55253 (time 1746075582.39 total 625.06 last 86.95) - open/close 56037 (time 1746075592.39 total 635.06 last 78.38) - open/close 56902 (time 1746075602.39 total 645.06 last 86.50) - open/close 57728 (time 1746075612.39 total 655.07 last 82.55) - open/close 58497 (time 1746075622.40 total 665.07 last 76.86) - open/close 59393 (time 1746075632.40 total 675.07 last 89.59) - open/close 60000 (time 1746075639.55 total 682.22 last 84.89) - open/close 60910 (time 1746075649.55 total 692.23 last 90.99) - open/close 61781 (time 1746075659.57 total 702.24 last 86.99) - open/close 62580 (time 1746075669.59 total 712.26 last 79.73) - open/close 63415 (time 1746075679.59 total 722.26 last 83.50) - open/close 64294 (time 1746075689.59 total 732.26 last 87.87) total: 64768 open/close in 737.73 seconds: 87.79 ops/second - /unlink 935 (time 1746075707.50 total 10.00 last 93.48) - /unlink 1792 (time 1746075717.51 total 20.02 last 85.58) - /unlink 2677 (time 1746075727.51 total 30.02 last 88.50) - /unlink 3548 (time 1746075737.53 total 40.03 last 86.99) - /unlink 4395 (time 1746075747.53 total 50.04 last 84.63) - /unlink 5188 (time 1746075757.54 total 60.04 last 79.28) - /unlink 5955 (time 1746075767.54 total 70.04 last 76.67) - /unlink 6799 (time 1746075777.54 total 80.05 last 84.38) - /unlink 7619 (time 1746075787.55 total 90.05 last 81.94) - /unlink 8352 (time 1746075797.55 total 100.05 last 73.29) - /unlink 9072 (time 1746075807.56 total 110.06 last 71.97) - /unlink 9829 (time 1746075817.56 total 120.06 last 75.66) - /unlink 10000 (time 1746075819.99 total 122.50 last 70.26) - /unlink 10806 (time 1746075830.01 total 132.51 last 80.51) - /unlink 11594 (time 1746075840.01 total 142.52 last 78.73) - /unlink 12436 (time 1746075850.02 total 152.52 last 84.17) - /unlink 13251 (time 1746075860.02 total 162.53 last 81.46) - /unlink 14210 (time 1746075870.02 total 172.53 last 95.89) - /unlink 15107 (time 1746075880.03 total 182.53 last 89.70) - /unlink 15983 (time 1746075890.03 total 192.53 last 87.58) - /unlink 16901 (time 1746075900.03 total 202.53 last 91.79) - /unlink 17824 (time 1746075910.03 total 212.54 last 92.25) - /unlink 18699 (time 1746075920.04 total 222.54 last 87.47) - /unlink 19569 (time 1746075930.04 total 232.54 last 86.97) - /unlink 20000 (time 1746075935.10 total 237.60 last 85.14) - /unlink 20891 (time 1746075945.11 total 247.61 last 89.05) - /unlink 21655 (time 1746075955.12 total 257.62 last 76.33) - /unlink 22422 (time 1746075965.13 total 267.63 last 76.61) - /unlink 23179 (time 1746075975.13 total 277.64 last 75.66) - /unlink 23934 (time 1746075985.15 total 287.65 last 75.41) - /unlink 24595 (time 1746075995.15 total 297.65 last 66.07) - /unlink 25349 (time 1746076005.15 total 307.66 last 75.38) - /unlink 26112 (time 1746076015.16 total 317.66 last 76.26) - /unlink 26814 (time 1746076025.16 total 327.67 last 70.16) - /unlink 27689 (time 1746076035.17 total 337.67 last 87.43) - /unlink 28462 (time 1746076045.17 total 347.68 last 77.27) - /unlink 29222 (time 1746076055.18 total 357.68 last 75.98) - /unlink 29959 (time 1746076065.19 total 367.69 last 73.62) - /unlink 30822 (time 1746076075.19 total 377.70 last 86.24) - /unlink 31639 (time 1746076085.20 total 387.70 last 81.66) - /unlink 32521 (time 1746076095.20 total 397.70 last 88.18) - /unlink 33459 (time 1746076105.21 total 407.71 last 93.71) - /unlink 34581 (time 1746076115.22 total 417.72 last 112.11) - /unlink 35710 (time 1746076125.22 total 427.72 last 112.88) - /unlink 36539 (time 1746076135.22 total 437.72 last 82.89) - /unlink 37357 (time 1746076145.22 total 447.72 last 81.79) - /unlink 38172 (time 1746076155.22 total 457.72 last 81.50) - /unlink 38975 (time 1746076165.22 total 467.72 last 80.30) - /unlink 39744 (time 1746076175.23 total 477.73 last 76.85) - /unlink 40000 (time 1746076178.03 total 480.53 last 91.39) - /unlink 41017 (time 1746076188.04 total 490.54 last 101.63) - /unlink 42177 (time 1746076198.05 total 500.56 last 115.82) - /unlink 43334 (time 1746076208.05 total 510.56 last 115.69) - /unlink 44454 (time 1746076218.06 total 520.56 last 111.91) - /unlink 45735 (time 1746076228.07 total 530.57 last 128.05) - /unlink 46868 (time 1746076238.07 total 540.57 last 113.24) - /unlink 48118 (time 1746076248.08 total 550.58 last 124.93) - /unlink 49313 (time 1746076258.08 total 560.59 last 119.41) - /unlink 50000 (time 1746076265.02 total 567.53 last 99.00) - /unlink 50908 (time 1746076275.03 total 577.53 last 90.78) - /unlink 51675 (time 1746076285.03 total 587.54 last 76.64) - /unlink 52390 (time 1746076295.07 total 597.57 last 71.25) - /unlink 53186 (time 1746076305.07 total 607.57 last 79.57) - /unlink 54116 (time 1746076315.09 total 617.59 last 92.83) - /unlink 55046 (time 1746076325.09 total 627.59 last 92.99) - /unlink 55925 (time 1746076335.09 total 637.60 last 87.88) - /unlink 56742 (time 1746076345.10 total 647.60 last 81.66) - /unlink 57636 (time 1746076355.10 total 657.61 last 89.37) - /unlink 58470 (time 1746076365.10 total 667.61 last 83.39) - /unlink 59326 (time 1746076375.11 total 677.61 last 85.58) - /unlink 60000 (time 1746076383.16 total 685.67 last 83.65) - /unlink 60873 (time 1746076393.17 total 695.67 last 87.25) - /unlink 61791 (time 1746076403.17 total 705.67 last 91.79) - /unlink 62654 (time 1746076413.18 total 715.68 last 86.21) - /unlink 63572 (time 1746076423.18 total 725.69 last 91.76) - /unlink 64552 (time 1746076433.19 total 735.69 last 97.99) total: 64768 /unlink in 738.10 seconds: 87.75 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete