== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 00:28:37 (1708838917) Stopping clients: oleg302-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg302-client.virtnet /mnt/lustre2 (opts:-f) oleg302-server: oleg302-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg302-server' oleg302-server: oleg302-server.virtnet: executing load_modules_local oleg302-server: Loading modules from /home/green/git/lustre-release/lustre oleg302-server: detected 4 online CPUs by sysfs oleg302-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg302-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg302-server: oleg302-server.virtnet: executing set_default_debug -1 all pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg302-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg302-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg302-server: oleg302-server.virtnet: executing set_default_debug -1 all pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg302-client.virtnet: -o user_xattr,flock oleg302-server@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 16134 326 15808 3% /mnt/lustre[OST:0] filesystem_summary: 16137 329 15808 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 4706 (time 1708838949.58 total 10.00 last 470.52) - open/close 8568 (time 1708838959.59 total 20.00 last 386.13) - open/close 10000 (time 1708838963.82 total 24.24 last 338.15) - open/close 12974 (time 1708838973.82 total 34.24 last 297.38) - open/close 15626 (time 1708838983.83 total 44.24 last 265.09) - open/close 17297 (time 1708838993.83 total 54.24 last 167.07) - open/close 18676 (time 1708839003.83 total 64.25 last 137.88) - open/close 20000 (time 1708839013.38 total 73.80 last 138.60) - open/close 21545 (time 1708839023.39 total 83.80 last 154.43) - open/close 23263 (time 1708839033.39 total 93.80 last 171.79) - open/close 24229 (time 1708839043.39 total 103.81 last 96.52) - open/close 25435 (time 1708839053.40 total 113.82 last 120.53) - open/close 26550 (time 1708839063.40 total 123.82 last 111.48) - open/close 27559 (time 1708839073.41 total 133.83 last 100.83) - open/close 28570 (time 1708839083.41 total 143.83 last 101.09) - open/close 29632 (time 1708839093.42 total 153.83 last 106.14) - open/close 30000 (time 1708839096.81 total 157.23 last 108.33) - open/close 31260 (time 1708839106.82 total 167.24 last 125.92) - open/close 32347 (time 1708839116.83 total 177.24 last 108.64) - open/close 33392 (time 1708839126.83 total 187.25 last 104.42) - open/close 34511 (time 1708839136.83 total 197.25 last 111.89) - open/close 35306 (time 1708839146.84 total 207.25 last 79.49) - open/close 36109 (time 1708839156.84 total 217.25 last 80.30) - open/close 37077 (time 1708839166.84 total 227.26 last 96.72) - open/close 37940 (time 1708839176.85 total 237.27 last 86.22) - open/close 38694 (time 1708839186.86 total 247.28 last 75.32) - open/close 39427 (time 1708839196.86 total 257.28 last 73.30) - open/close 40000 (time 1708839205.68 total 266.10 last 65.01) - open/close 40590 (time 1708839215.68 total 276.10 last 58.96) - open/close 41175 (time 1708839225.69 total 286.11 last 58.48) - open/close 41917 (time 1708839235.69 total 296.11 last 74.18) - open/close 42649 (time 1708839245.69 total 306.11 last 73.18) - open/close 43285 (time 1708839255.70 total 316.12 last 63.55) - open/close 43861 (time 1708839265.71 total 326.13 last 57.52) - open/close 44511 (time 1708839275.72 total 336.14 last 64.95) - open/close 45131 (time 1708839285.74 total 346.15 last 61.91) - open/close 45670 (time 1708839295.75 total 356.17 last 53.81) - open/close 46249 (time 1708839305.76 total 366.18 last 57.84) - open/close 46778 (time 1708839315.78 total 376.20 last 52.80) - open/close 47322 (time 1708839325.80 total 386.21 last 54.34) - open/close 47844 (time 1708839335.80 total 396.22 last 52.18) - open/close 48419 (time 1708839345.81 total 406.23 last 57.43) - open/close 49020 (time 1708839355.82 total 416.24 last 60.06) - open/close 49632 (time 1708839365.82 total 426.24 last 61.18) - open/close 50000 (time 1708839371.59 total 432.00 last 63.84) - open/close 50642 (time 1708839381.60 total 442.02 last 64.09) - open/close 51248 (time 1708839391.61 total 452.03 last 60.55) - open/close 51858 (time 1708839401.62 total 462.03 last 60.97) - open/close 52452 (time 1708839411.62 total 472.04 last 59.37) - open/close 53048 (time 1708839421.63 total 482.05 last 59.53) - open/close 53622 (time 1708839431.64 total 492.06 last 57.37) - open/close 54207 (time 1708839441.65 total 502.07 last 58.45) - open/close 54798 (time 1708839451.65 total 512.07 last 59.09) - open/close 55327 (time 1708839461.67 total 522.09 last 52.80) - open/close 55834 (time 1708839471.69 total 532.11 last 50.58) - open/close 56307 (time 1708839481.69 total 542.11 last 47.30) - open/close 56825 (time 1708839491.71 total 552.12 last 51.74) - open/close 57352 (time 1708839501.71 total 562.13 last 52.67) - open/close 57898 (time 1708839511.72 total 572.14 last 54.54) - open/close 58418 (time 1708839521.74 total 582.16 last 51.90) - open/close 58931 (time 1708839531.75 total 592.17 last 51.27) - open/close 59483 (time 1708839541.76 total 602.18 last 55.13) - open/close 59969 (time 1708839551.78 total 612.20 last 48.52) - open/close 60465 (time 1708839561.79 total 622.21 last 49.52) - open/close 60993 (time 1708839571.80 total 632.22 last 52.77) - open/close 61492 (time 1708839581.80 total 642.22 last 49.90) - open/close 62007 (time 1708839591.82 total 652.24 last 51.41) - open/close 62492 (time 1708839601.82 total 662.24 last 48.49) - open/close 63025 (time 1708839611.84 total 672.25 last 53.22) - open/close 63515 (time 1708839621.85 total 682.27 last 48.93) - open/close 63974 (time 1708839631.86 total 692.28 last 45.86) - open/close 64466 (time 1708839641.86 total 702.28 last 49.18) total: 64768 open/close in 708.50 seconds: 91.42 ops/second - /unlink 570 (time 1708839659.20 total 10.02 last 56.91) - /unlink 1110 (time 1708839669.21 total 20.03 last 53.93) - /unlink 1738 (time 1708839679.23 total 30.04 last 62.72) - /unlink 2339 (time 1708839689.24 total 40.06 last 60.02) - /unlink 2924 (time 1708839699.25 total 50.07 last 58.43) - /unlink 3537 (time 1708839709.27 total 60.08 last 61.20) - /unlink 4110 (time 1708839719.27 total 70.09 last 57.28) - /unlink 4722 (time 1708839729.27 total 80.09 last 61.18) - /unlink 5333 (time 1708839739.28 total 90.09 last 61.08) - /unlink 5912 (time 1708839749.28 total 100.10 last 57.86) - /unlink 6502 (time 1708839759.29 total 110.10 last 58.98) - /unlink 7122 (time 1708839769.31 total 120.13 last 61.84) - /unlink 7748 (time 1708839779.32 total 130.13 last 62.56) - /unlink 8381 (time 1708839789.32 total 140.14 last 63.27) - /unlink 9001 (time 1708839799.33 total 150.15 last 61.93) - /unlink 9634 (time 1708839809.33 total 160.15 last 63.30) - /unlink 10000 (time 1708839814.93 total 165.75 last 65.39) - /unlink 10658 (time 1708839824.94 total 175.76 last 65.73) - /unlink 11286 (time 1708839834.95 total 185.76 last 62.76) - /unlink 12015 (time 1708839844.96 total 195.78 last 72.80) - /unlink 12700 (time 1708839854.97 total 205.78 last 68.45) - /unlink 13392 (time 1708839864.98 total 215.79 last 69.12) - /unlink 14079 (time 1708839874.99 total 225.80 last 68.63) - /unlink 14796 (time 1708839885.00 total 235.82 last 71.61) - /unlink 15571 (time 1708839895.01 total 245.83 last 77.42) - /unlink 16357 (time 1708839905.02 total 255.84 last 78.54) - /unlink 17166 (time 1708839915.02 total 265.84 last 80.89) - /unlink 17951 (time 1708839925.03 total 275.85 last 78.40) - /unlink 18624 (time 1708839935.04 total 285.86 last 67.25) - /unlink 19240 (time 1708839945.05 total 295.86 last 61.56) - /unlink 19973 (time 1708839955.06 total 305.87 last 73.23) - /unlink 20791 (time 1708839965.07 total 315.88 last 81.71) - /unlink 21553 (time 1708839975.08 total 325.90 last 76.10) - /unlink 22363 (time 1708839985.10 total 335.91 last 80.89) - /unlink 23162 (time 1708839995.11 total 345.92 last 79.81) - /unlink 24029 (time 1708840005.12 total 355.93 last 86.63) - /unlink 24866 (time 1708840015.12 total 365.93 last 83.68) - /unlink 25718 (time 1708840025.12 total 375.94 last 85.16) - /unlink 26670 (time 1708840035.13 total 385.95 last 95.10) - /unlink 27645 (time 1708840045.14 total 395.95 last 97.44) - /unlink 28535 (time 1708840055.14 total 405.95 last 89.00) - /unlink 29443 (time 1708840065.14 total 415.96 last 90.78) - /unlink 30000 (time 1708840071.40 total 422.21 last 89.05) - /unlink 30987 (time 1708840081.40 total 432.22 last 98.64) - /unlink 31904 (time 1708840091.40 total 442.22 last 91.69) - /unlink 32843 (time 1708840101.41 total 452.23 last 93.83) - /unlink 33886 (time 1708840111.41 total 462.23 last 104.29) - /unlink 34921 (time 1708840121.42 total 472.23 last 103.43) - /unlink 35957 (time 1708840131.43 total 482.24 last 103.52) - /unlink 37131 (time 1708840141.43 total 492.25 last 117.34) - /unlink 38450 (time 1708840151.44 total 502.25 last 131.82) - /unlink 39829 (time 1708840161.44 total 512.26 last 137.82) - /unlink 41055 (time 1708840171.44 total 522.26 last 122.59) - /unlink 42335 (time 1708840181.45 total 532.27 last 127.92) - /unlink 43720 (time 1708840191.45 total 542.27 last 138.44) - /unlink 45127 (time 1708840201.46 total 552.27 last 140.68) - /unlink 46598 (time 1708840211.46 total 562.28 last 147.02) - /unlink 48307 (time 1708840221.46 total 572.28 last 170.87) - /unlink 50000 (time 1708840230.72 total 581.54 last 182.84) - /unlink 51889 (time 1708840240.73 total 591.54 last 188.83) - /unlink 53712 (time 1708840250.73 total 601.54 last 182.29) - /unlink 55819 (time 1708840260.73 total 611.54 last 210.66) - /unlink 59077 (time 1708840270.73 total 621.54 last 325.78) - /unlink 60000 (time 1708840273.21 total 624.03 last 371.41) - /unlink 64649 (time 1708840283.22 total 634.03 last 464.84) total: 64768 /unlink in 634.26 seconds: 102.12 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete - open/close 3142 (time 1708840311.07 total 10.00 last 314.16) - open/close 5611 (time 1708840321.07 total 20.00 last 246.89) - open/close 8079 (time 1708840331.07 total 30.00 last 246.77) - open/close 10000 (time 1708840340.47 total 39.40 last 204.37) - open/close 11817 (time 1708840350.47 total 49.40 last 181.70) - open/close 13403 (time 1708840360.47 total 59.41 last 158.51) - open/close 14873 (time 1708840370.47 total 69.41 last 146.99) - open/close 16485 (time 1708840380.47 total 79.41 last 161.19) - open/close 17846 (time 1708840390.47 total 89.41 last 136.09) - open/close 19154 (time 1708840400.48 total 99.41 last 130.78) - open/close 20000 (time 1708840406.76 total 105.69 last 134.66) - open/close 21225 (time 1708840416.76 total 115.70 last 122.43) - open/close 22429 (time 1708840426.77 total 125.71 last 120.34) - open/close 23608 (time 1708840436.78 total 135.71 last 117.82) - open/close 24843 (time 1708840446.78 total 145.72 last 123.40) - open/close 25978 (time 1708840456.79 total 155.73 last 113.42) - open/close 27375 (time 1708840466.80 total 165.73 last 139.63) - open/close 28879 (time 1708840476.80 total 175.74 last 150.34) - open/close 30000 (time 1708840486.48 total 185.41 last 115.83) - open/close 31227 (time 1708840496.49 total 195.42 last 122.57) - open/close 32365 (time 1708840506.49 total 205.43 last 113.75) - open/close 33718 (time 1708840516.50 total 215.43 last 135.27) - open/close 34845 (time 1708840526.50 total 225.43 last 112.67) - open/close 35794 (time 1708840536.50 total 235.44 last 94.87) - open/close 36766 (time 1708840546.51 total 245.45 last 97.12) - open/close 37881 (time 1708840556.51 total 255.45 last 111.46) - open/close 39213 (time 1708840566.52 total 265.45 last 133.14) - open/close 40000 (time 1708840572.67 total 271.60 last 128.01) - open/close 40968 (time 1708840582.67 total 281.61 last 96.77) - open/close 41809 (time 1708840592.67 total 291.61 last 84.08) - open/close 42792 (time 1708840602.67 total 301.61 last 98.28) - open/close 43678 (time 1708840612.68 total 311.62 last 88.54) - open/close 44442 (time 1708840622.68 total 321.62 last 76.37) - open/close 45295 (time 1708840632.69 total 331.62 last 85.28) - open/close 45923 (time 1708840642.70 total 341.63 last 62.72) - open/close 46557 (time 1708840652.71 total 351.64 last 63.35) - open/close 47254 (time 1708840662.72 total 361.65 last 69.62) - open/close 47965 (time 1708840672.72 total 371.66 last 71.08) - open/close 48668 (time 1708840682.72 total 381.66 last 70.28) - open/close 49362 (time 1708840692.74 total 391.68 last 69.28) - open/close 49879 (time 1708840702.76 total 401.69 last 51.63) - open/close 50000 (time 1708840704.91 total 403.84 last 56.23) - open/close 50616 (time 1708840714.91 total 413.85 last 61.58) - open/close 51285 (time 1708840724.93 total 423.86 last 66.80) - open/close 51930 (time 1708840734.93 total 433.87 last 64.44) - open/close 52712 (time 1708840744.94 total 443.87 last 78.17) - open/close 53427 (time 1708840754.94 total 453.88 last 71.46) - open/close 54089 (time 1708840764.95 total 463.89 last 66.14) - open/close 54726 (time 1708840774.96 total 473.89 last 63.67) - open/close 55499 (time 1708840784.96 total 483.90 last 77.29) - open/close 56178 (time 1708840794.97 total 493.90 last 67.85) - open/close 56727 (time 1708840804.97 total 503.90 last 54.89) - open/close 57266 (time 1708840814.97 total 513.91 last 53.89) - open/close 57924 (time 1708840824.98 total 523.92 last 65.72) - open/close 58511 (time 1708840835.00 total 533.93 last 58.62) - open/close 59100 (time 1708840845.00 total 543.93 last 58.90) - open/close 59641 (time 1708840855.00 total 553.94 last 54.07) - open/close 60000 (time 1708840860.61 total 559.55 last 64.01) - open/close 60617 (time 1708840870.61 total 569.55 last 61.69) - open/close 61202 (time 1708840880.63 total 579.57 last 58.39) - open/close 61794 (time 1708840890.63 total 589.57 last 59.20) - open/close 62382 (time 1708840900.64 total 599.58 last 58.76) - open/close 63061 (time 1708840910.65 total 609.59 last 67.84) - open/close 63731 (time 1708840920.65 total 619.59 last 66.99) - open/close 64410 (time 1708840930.65 total 629.59 last 67.88) total: 64768 open/close in 635.16 seconds: 101.97 ops/second - /unlink 718 (time 1708840947.31 total 10.00 last 71.79) - /unlink 1554 (time 1708840957.32 total 20.01 last 83.56) - /unlink 2291 (time 1708840967.32 total 30.01 last 73.66) - /unlink 2984 (time 1708840977.33 total 40.02 last 69.26) - /unlink 3697 (time 1708840987.34 total 50.03 last 71.23) - /unlink 4366 (time 1708840997.34 total 60.03 last 66.89) - /unlink 5120 (time 1708841007.35 total 70.04 last 75.33) - /unlink 6013 (time 1708841017.35 total 80.04 last 89.25) - /unlink 6858 (time 1708841027.36 total 90.06 last 84.41) - /unlink 7720 (time 1708841037.37 total 100.06 last 86.19) - /unlink 8638 (time 1708841047.38 total 110.07 last 91.68) - /unlink 9530 (time 1708841057.39 total 120.08 last 89.08) - /unlink 10000 (time 1708841062.96 total 125.65 last 84.44) - /unlink 10867 (time 1708841072.97 total 135.66 last 86.62) - /unlink 11761 (time 1708841082.98 total 145.67 last 89.32) - /unlink 12633 (time 1708841092.98 total 155.67 last 87.19) - /unlink 13689 (time 1708841102.98 total 165.67 last 105.54) - /unlink 14538 (time 1708841112.99 total 175.68 last 84.86) - /unlink 15555 (time 1708841122.99 total 185.68 last 101.69) - /unlink 16590 (time 1708841133.00 total 195.69 last 103.37) - /unlink 17542 (time 1708841143.00 total 205.69 last 95.19) - /unlink 18544 (time 1708841153.00 total 215.69 last 100.19) - /unlink 19551 (time 1708841163.00 total 225.70 last 100.68) - /unlink 20000 (time 1708841167.26 total 229.95 last 105.48) - /unlink 21136 (time 1708841177.27 total 239.96 last 113.49) - /unlink 21998 (time 1708841187.28 total 249.97 last 86.13) - /unlink 22893 (time 1708841197.28 total 259.98 last 89.45) - /unlink 23739 (time 1708841207.28 total 269.98 last 84.60) - /unlink 24789 (time 1708841217.29 total 279.98 last 104.91) - /unlink 25652 (time 1708841227.30 total 289.99 last 86.25) - /unlink 26760 (time 1708841237.30 total 299.99 last 110.76) - /unlink 27947 (time 1708841247.31 total 310.00 last 118.64) - /unlink 29084 (time 1708841257.31 total 320.00 last 113.67) - /unlink 30000 (time 1708841264.67 total 327.36 last 124.47) - /unlink 31425 (time 1708841274.67 total 337.37 last 142.43) - /unlink 32789 (time 1708841284.68 total 347.37 last 136.36) - /unlink 34292 (time 1708841294.68 total 357.37 last 150.22) - /unlink 35726 (time 1708841304.69 total 367.38 last 143.32) - /unlink 37386 (time 1708841314.69 total 377.38 last 165.99) - /unlink 38969 (time 1708841324.69 total 387.38 last 158.29) - /unlink 40000 (time 1708841330.50 total 393.19 last 177.43) - /unlink 41861 (time 1708841340.50 total 403.19 last 186.09) - /unlink 44008 (time 1708841350.50 total 413.19 last 214.67) - /unlink 45832 (time 1708841360.50 total 423.19 last 182.38) - /unlink 48192 (time 1708841370.50 total 433.20 last 235.97) - /unlink 50000 (time 1708841377.43 total 440.12 last 260.98) - /unlink 52846 (time 1708841387.43 total 450.12 last 284.59) - /unlink 55910 (time 1708841397.43 total 460.13 last 306.36) - /unlink 59354 (time 1708841407.44 total 470.13 last 344.34) - /unlink 63169 (time 1708841417.44 total 480.13 last 381.48) total: 64768 /unlink in 484.05 seconds: 133.80 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete - open/close 3052 (time 1708841452.12 total 10.00 last 305.16) - open/close 5665 (time 1708841462.13 total 20.00 last 261.24) - open/close 8611 (time 1708841472.13 total 30.00 last 294.59) - open/close 10000 (time 1708841476.95 total 34.83 last 287.85) - open/close 12213 (time 1708841486.95 total 44.83 last 221.25) - open/close 14333 (time 1708841496.95 total 54.83 last 211.98) - open/close 16246 (time 1708841506.96 total 64.83 last 191.29) - open/close 17664 (time 1708841516.96 total 74.84 last 141.76) - open/close 18957 (time 1708841526.96 total 84.84 last 129.25) - open/close 20000 (time 1708841535.30 total 93.18 last 125.13) - open/close 21575 (time 1708841545.30 total 103.18 last 157.47) - open/close 23180 (time 1708841555.30 total 113.18 last 160.49) - open/close 24625 (time 1708841565.30 total 123.18 last 144.47) - open/close 26060 (time 1708841575.31 total 133.19 last 143.41) - open/close 27467 (time 1708841585.31 total 143.19 last 140.70) - open/close 28626 (time 1708841595.31 total 153.19 last 115.84) - open/close 29994 (time 1708841605.31 total 163.19 last 136.80) - open/close 31278 (time 1708841615.32 total 173.19 last 128.37) - open/close 32422 (time 1708841625.32 total 183.20 last 114.35) - open/close 33928 (time 1708841635.33 total 193.20 last 150.52) - open/close 35355 (time 1708841645.33 total 203.21 last 142.65) - open/close 36784 (time 1708841655.33 total 213.21 last 142.87) - open/close 38001 (time 1708841665.33 total 223.21 last 121.67) - open/close 39117 (time 1708841675.35 total 233.23 last 111.46) - open/close 40000 (time 1708841683.06 total 240.94 last 114.53) - open/close 40954 (time 1708841693.07 total 250.95 last 95.30) - open/close 41987 (time 1708841703.07 total 260.95 last 103.26) - open/close 43097 (time 1708841713.07 total 270.95 last 110.97) - open/close 44006 (time 1708841723.08 total 280.95 last 90.89) - open/close 45010 (time 1708841733.08 total 290.96 last 100.35) - open/close 46051 (time 1708841743.09 total 300.96 last 104.06) - open/close 47061 (time 1708841753.09 total 310.97 last 100.92) - open/close 48040 (time 1708841763.10 total 320.97 last 97.88) - open/close 49014 (time 1708841773.10 total 330.98 last 97.35) - open/close 49900 (time 1708841783.11 total 340.99 last 88.52) - open/close 50832 (time 1708841793.12 total 351.00 last 93.06) - open/close 51740 (time 1708841803.14 total 361.01 last 90.70) - open/close 52668 (time 1708841813.14 total 371.02 last 92.77) - open/close 53636 (time 1708841823.14 total 381.02 last 96.74) - open/close 54469 (time 1708841833.15 total 391.02 last 83.29) - open/close 55264 (time 1708841843.16 total 401.04 last 79.40) - open/close 55905 (time 1708841853.17 total 411.05 last 64.03) - open/close 56558 (time 1708841863.18 total 421.06 last 65.23) - open/close 57275 (time 1708841873.19 total 431.07 last 71.59) - open/close 57901 (time 1708841883.20 total 441.08 last 62.57) - open/close 58487 (time 1708841893.20 total 451.08 last 58.58) - open/close 59132 (time 1708841903.21 total 461.09 last 64.42) - open/close 59701 (time 1708841913.23 total 471.10 last 56.84) - open/close 60000 (time 1708841918.05 total 475.93 last 61.98) - open/close 60610 (time 1708841928.06 total 485.94 last 60.95) - open/close 61169 (time 1708841938.08 total 495.96 last 55.78) - open/close 61866 (time 1708841948.09 total 505.97 last 69.64) - open/close 62549 (time 1708841958.09 total 515.97 last 68.26) - open/close 63188 (time 1708841968.10 total 525.98 last 63.83) - open/close 63828 (time 1708841978.11 total 535.99 last 63.98) - open/close 64438 (time 1708841988.11 total 545.99 last 60.97) total: 64768 open/close in 551.25 seconds: 117.49 ops/second - /unlink 630 (time 1708842004.64 total 10.01 last 62.93) - /unlink 1303 (time 1708842014.65 total 20.02 last 67.23) - /unlink 1982 (time 1708842024.65 total 30.03 last 67.86) - /unlink 2643 (time 1708842034.66 total 40.04 last 66.02) - /unlink 3344 (time 1708842044.67 total 50.04 last 70.08) - /unlink 4087 (time 1708842054.68 total 60.05 last 74.23) - /unlink 4789 (time 1708842064.69 total 70.06 last 70.13) - /unlink 5550 (time 1708842074.69 total 80.06 last 76.09) - /unlink 6263 (time 1708842084.70 total 90.07 last 71.23) - /unlink 6995 (time 1708842094.70 total 100.08 last 73.17) - /unlink 7749 (time 1708842104.71 total 110.08 last 75.34) - /unlink 8438 (time 1708842114.72 total 120.10 last 68.82) - /unlink 9178 (time 1708842124.73 total 130.11 last 73.93) - /unlink 9933 (time 1708842134.74 total 140.11 last 75.43) - /unlink 10650 (time 1708842144.74 total 150.12 last 71.69) - /unlink 11494 (time 1708842154.74 total 160.12 last 84.39) - /unlink 12244 (time 1708842164.74 total 170.12 last 74.98) - /unlink 13307 (time 1708842174.75 total 180.12 last 106.28) - /unlink 14282 (time 1708842184.75 total 190.13 last 97.41) - /unlink 15031 (time 1708842194.76 total 200.14 last 74.86) - /unlink 15826 (time 1708842204.77 total 210.14 last 79.43) - /unlink 16640 (time 1708842214.78 total 220.15 last 81.31) - /unlink 17518 (time 1708842224.78 total 230.16 last 87.78) - /unlink 18380 (time 1708842234.79 total 240.16 last 86.13) - /unlink 19211 (time 1708842244.79 total 250.17 last 83.05) - /unlink 20000 (time 1708842254.05 total 259.42 last 85.26) - /unlink 20874 (time 1708842264.05 total 269.43 last 87.39) - /unlink 21722 (time 1708842274.06 total 279.44 last 84.72) - /unlink 22577 (time 1708842284.06 total 289.44 last 85.48) - /unlink 23464 (time 1708842294.07 total 299.44 last 88.65) - /unlink 24344 (time 1708842304.07 total 309.45 last 87.98) - /unlink 25298 (time 1708842314.08 total 319.45 last 95.32) - /unlink 26227 (time 1708842324.08 total 329.46 last 92.84) - /unlink 27179 (time 1708842334.09 total 339.46 last 95.18) - /unlink 28090 (time 1708842344.09 total 349.47 last 91.06) - /unlink 29107 (time 1708842354.10 total 359.48 last 101.62) - /unlink 30000 (time 1708842362.66 total 368.03 last 104.35) - /unlink 31049 (time 1708842372.66 total 378.04 last 104.84) - /unlink 32130 (time 1708842382.67 total 388.05 last 108.00) - /unlink 33194 (time 1708842392.68 total 398.06 last 106.31) - /unlink 34267 (time 1708842402.69 total 408.06 last 107.21) - /unlink 35376 (time 1708842412.69 total 418.06 last 110.90) - /unlink 36490 (time 1708842422.69 total 428.07 last 111.34) - /unlink 37659 (time 1708842432.70 total 438.07 last 116.86) - /unlink 38826 (time 1708842442.70 total 448.08 last 116.61) - /unlink 40000 (time 1708842452.37 total 457.75 last 121.46) - /unlink 41197 (time 1708842462.37 total 467.75 last 119.69) - /unlink 42453 (time 1708842472.38 total 477.75 last 125.51) - /unlink 43755 (time 1708842482.38 total 487.76 last 130.12) - /unlink 45113 (time 1708842492.38 total 497.76 last 135.78) - /unlink 46570 (time 1708842502.39 total 507.76 last 145.70) - /unlink 48088 (time 1708842512.39 total 517.77 last 151.73) - /unlink 49730 (time 1708842522.39 total 527.77 last 164.18) - /unlink 51527 (time 1708842532.39 total 537.77 last 179.67) - /unlink 53449 (time 1708842542.40 total 547.77 last 192.16) - /unlink 55526 (time 1708842552.40 total 557.78 last 207.62) - /unlink 57895 (time 1708842562.40 total 567.78 last 236.81) - /unlink 60000 (time 1708842570.29 total 575.67 last 266.73) - /unlink 63270 (time 1708842580.29 total 585.67 last 327.00) total: 64768 /unlink in 589.23 seconds: 109.92 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete - open/close 2469 (time 1708842608.56 total 10.00 last 246.88) - open/close 4496 (time 1708842618.57 total 20.01 last 202.60) - open/close 6411 (time 1708842628.57 total 30.01 last 191.42) - open/close 8192 (time 1708842638.57 total 40.01 last 178.06) - open/close 9825 (time 1708842648.58 total 50.02 last 163.20) - open/close 11447 (time 1708842658.58 total 60.02 last 162.16) - open/close 12907 (time 1708842668.58 total 70.02 last 145.97) - open/close 14349 (time 1708842678.59 total 80.03 last 144.12) - open/close 15839 (time 1708842688.59 total 90.03 last 148.97) - open/close 17216 (time 1708842698.59 total 100.03 last 137.66) - open/close 18559 (time 1708842708.60 total 110.03 last 134.29) - open/close 19967 (time 1708842718.60 total 120.04 last 140.69) - open/close 21226 (time 1708842728.61 total 130.04 last 125.88) - open/close 22436 (time 1708842738.61 total 140.04 last 120.99) - open/close 23717 (time 1708842748.61 total 150.05 last 128.08) - open/close 25589 (time 1708842758.61 total 160.05 last 187.13) - open/close 27127 (time 1708842768.62 total 170.06 last 153.70) - open/close 28318 (time 1708842778.62 total 180.06 last 119.07) - open/close 29912 (time 1708842788.62 total 190.06 last 159.39) - open/close 31232 (time 1708842798.63 total 200.07 last 131.91) - open/close 32466 (time 1708842808.63 total 210.07 last 123.31) - open/close 33440 (time 1708842818.64 total 220.08 last 97.31) - open/close 34341 (time 1708842828.65 total 230.09 last 90.06) - open/close 35245 (time 1708842838.66 total 240.10 last 90.33) - open/close 36372 (time 1708842848.66 total 250.10 last 112.69) - open/close 37492 (time 1708842858.66 total 260.10 last 111.98) - open/close 38550 (time 1708842868.66 total 270.10 last 105.78) - open/close 39518 (time 1708842878.67 total 280.11 last 96.75) - open/close 40000 (time 1708842883.71 total 285.15 last 95.59) - open/close 40956 (time 1708842893.71 total 295.15 last 95.58) - open/close 41890 (time 1708842903.71 total 305.15 last 93.39) - open/close 42786 (time 1708842913.72 total 315.16 last 89.55) - open/close 43665 (time 1708842923.73 total 325.17 last 87.80) - open/close 44535 (time 1708842933.73 total 335.17 last 86.99) - open/close 45436 (time 1708842943.74 total 345.18 last 90.01) - open/close 46267 (time 1708842953.74 total 355.18 last 83.08) - open/close 47171 (time 1708842963.75 total 365.19 last 90.35) - open/close 48076 (time 1708842973.75 total 375.19 last 90.47) - open/close 49447 (time 1708842983.76 total 385.19 last 137.04) - open/close 50000 (time 1708842988.87 total 390.31 last 108.13) - open/close 51113 (time 1708842998.87 total 400.31 last 111.25) - open/close 52217 (time 1708843008.88 total 410.32 last 110.36) - open/close 53517 (time 1708843018.89 total 420.32 last 129.90) - open/close 54642 (time 1708843028.89 total 430.33 last 112.42) - open/close 55656 (time 1708843038.89 total 440.33 last 101.38) - open/close 56521 (time 1708843048.90 total 450.34 last 86.43) - open/close 57342 (time 1708843058.91 total 460.35 last 82.05) - open/close 58211 (time 1708843068.92 total 470.35 last 86.83) - open/close 58740 (time 1708843078.94 total 480.38 last 52.79) - open/close 59320 (time 1708843088.94 total 490.38 last 57.98) - open/close 59990 (time 1708843098.94 total 500.38 last 66.98) - open/close 60593 (time 1708843108.95 total 510.39 last 60.24) - open/close 61131 (time 1708843118.96 total 520.40 last 53.75) - open/close 61715 (time 1708843128.97 total 530.41 last 58.35) - open/close 62317 (time 1708843138.97 total 540.41 last 60.18) - open/close 62831 (time 1708843148.99 total 550.43 last 51.33) - open/close 63324 (time 1708843159.00 total 560.44 last 49.22) - open/close 63791 (time 1708843169.02 total 570.46 last 46.63) - open/close 64271 (time 1708843179.04 total 580.48 last 47.91) total: 64768 open/close in 590.43 seconds: 109.70 ops/second - /unlink 556 (time 1708843200.25 total 10.02 last 55.46) - /unlink 1113 (time 1708843210.26 total 20.03 last 55.66) - /unlink 1695 (time 1708843220.27 total 30.04 last 58.17) - /unlink 2258 (time 1708843230.28 total 40.05 last 56.22) - /unlink 2827 (time 1708843240.29 total 50.06 last 56.86) - /unlink 3385 (time 1708843250.29 total 60.07 last 55.76) - /unlink 3992 (time 1708843260.30 total 70.07 last 60.65) - /unlink 4565 (time 1708843270.31 total 80.08 last 57.26) - /unlink 5168 (time 1708843280.31 total 90.08 last 60.29) - /unlink 5844 (time 1708843290.32 total 100.09 last 67.55) - /unlink 6556 (time 1708843300.32 total 110.09 last 71.17) - /unlink 7119 (time 1708843310.33 total 120.11 last 56.24) - /unlink 7730 (time 1708843320.34 total 130.11 last 61.04) - /unlink 8349 (time 1708843330.36 total 140.13 last 61.82) - /unlink 9056 (time 1708843340.37 total 150.14 last 70.62) - /unlink 9690 (time 1708843350.38 total 160.15 last 63.35) - /unlink 10000 (time 1708843354.93 total 164.70 last 68.09) - /unlink 10624 (time 1708843364.94 total 174.71 last 62.30) - /unlink 11293 (time 1708843374.95 total 184.72 last 66.87) - /unlink 11948 (time 1708843384.96 total 194.73 last 65.44) - /unlink 12732 (time 1708843394.96 total 204.73 last 78.35) - /unlink 13409 (time 1708843404.98 total 214.75 last 67.60) - /unlink 14039 (time 1708843414.99 total 224.76 last 62.94) - /unlink 14719 (time 1708843425.00 total 234.78 last 67.88) - /unlink 15461 (time 1708843435.01 total 244.78 last 74.15) - /unlink 16496 (time 1708843445.02 total 254.79 last 103.41) - /unlink 17228 (time 1708843455.02 total 264.79 last 73.18) - /unlink 17962 (time 1708843465.03 total 274.80 last 73.35) - /unlink 18647 (time 1708843475.03 total 284.81 last 68.46) - /unlink 19445 (time 1708843485.04 total 294.81 last 79.79) - /unlink 20000 (time 1708843492.25 total 302.02 last 76.91) - /unlink 20813 (time 1708843502.26 total 312.03 last 81.24) - /unlink 21959 (time 1708843512.26 total 322.04 last 114.55) - /unlink 22831 (time 1708843522.26 total 332.04 last 87.20) - /unlink 23597 (time 1708843532.28 total 342.05 last 76.50) - /unlink 24363 (time 1708843542.28 total 352.05 last 76.57) - /unlink 25162 (time 1708843552.29 total 362.06 last 79.82) - /unlink 25979 (time 1708843562.29 total 372.07 last 81.67) - /unlink 26871 (time 1708843572.30 total 382.07 last 89.13) - /unlink 27775 (time 1708843582.30 total 392.08 last 90.38) - /unlink 28705 (time 1708843592.31 total 402.09 last 92.91) - /unlink 29686 (time 1708843602.32 total 412.09 last 98.02) - /unlink 30000 (time 1708843605.79 total 415.56 last 90.67) - /unlink 31214 (time 1708843615.79 total 425.56 last 121.38) - /unlink 32298 (time 1708843625.79 total 435.56 last 108.37) - /unlink 33485 (time 1708843635.79 total 445.56 last 118.70) - /unlink 34990 (time 1708843645.79 total 455.56 last 150.46) - /unlink 36647 (time 1708843655.80 total 465.57 last 165.61) - /unlink 37825 (time 1708843665.80 total 475.57 last 117.77) - /unlink 39167 (time 1708843675.81 total 485.58 last 134.11) - /unlink 40000 (time 1708843681.79 total 491.56 last 139.24) - /unlink 41319 (time 1708843691.80 total 501.57 last 131.84) - /unlink 42698 (time 1708843701.80 total 511.57 last 137.84) - /unlink 44073 (time 1708843711.80 total 521.58 last 137.45) - /unlink 45518 (time 1708843721.80 total 531.58 last 144.49) - /unlink 47151 (time 1708843731.81 total 541.58 last 163.20) - /unlink 48874 (time 1708843741.82 total 551.59 last 172.20) - /unlink 50000 (time 1708843747.97 total 557.74 last 183.00) - /unlink 51918 (time 1708843757.97 total 567.75 last 191.72) - /unlink 54021 (time 1708843767.98 total 577.75 last 210.26) - /unlink 57158 (time 1708843777.98 total 587.75 last 313.64) - /unlink 60000 (time 1708843786.06 total 595.83 last 351.76) - /unlink 63871 (time 1708843796.06 total 605.83 last 387.04) total: 64768 /unlink in 607.94 seconds: 106.54 ops/second sleep 5 for ZFS zfs