== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 09:13:45 (1761311625) Stopping clients: oleg244-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg244-client.virtnet /mnt/lustre2 (opts:-f) oleg244-server: oleg244-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg244-server' oleg244-server: oleg244-server.virtnet: executing load_modules_local oleg244-server: Loading modules from /home/green/git/lustre-release/lustre oleg244-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg244-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg244-server: detected 4 online CPUs by sysfs oleg244-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg244-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg244-server: oleg244-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg244-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg244-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg244-server: oleg244-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg244-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg244-client.virtnet: -o user_xattr,flock oleg244-server@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 16166 358 15808 3% /mnt/lustre[OST:0] filesystem_summary: 16137 329 15808 3% /mnt/lustre fail_loc=0x1312 fail_val=5 - open/close 760 (time 1761311732.31 total 10.00 last 75.99) - open/close 1489 (time 1761311742.32 total 20.01 last 72.82) - open/close 2171 (time 1761311752.32 total 30.01 last 68.19) - open/close 2903 (time 1761311762.33 total 40.02 last 73.13) - open/close 3709 (time 1761311772.33 total 50.02 last 80.59) - open/close 4442 (time 1761311782.34 total 60.04 last 73.22) - open/close 5209 (time 1761311792.35 total 70.04 last 76.66) - open/close 5951 (time 1761311802.35 total 80.05 last 74.17) - open/close 6817 (time 1761311812.35 total 90.05 last 86.58) - open/close 7529 (time 1761311822.36 total 100.05 last 71.15) - open/close 8179 (time 1761311832.37 total 110.06 last 64.97) - open/close 8804 (time 1761311842.39 total 120.08 last 62.37) - open/close 9416 (time 1761311852.39 total 130.08 last 61.19) - open/close 10000 (time 1761311861.27 total 138.96 last 65.79) - open/close 10653 (time 1761311871.28 total 148.97 last 65.22) - open/close 11303 (time 1761311881.28 total 158.98 last 64.96) - open/close 11920 (time 1761311891.29 total 168.98 last 61.67) - open/close 12642 (time 1761311901.30 total 178.99 last 72.13) - open/close 13360 (time 1761311911.31 total 189.00 last 71.73) - open/close 14064 (time 1761311921.31 total 199.01 last 70.36) - open/close 14744 (time 1761311931.32 total 209.01 last 67.98) - open/close 15442 (time 1761311941.32 total 219.01 last 69.78) - open/close 16124 (time 1761311951.32 total 229.01 last 68.18) - open/close 16841 (time 1761311961.32 total 239.02 last 71.69) - open/close 17518 (time 1761311971.33 total 249.03 last 67.63) - open/close 18153 (time 1761311981.35 total 259.04 last 63.41) - open/close 18780 (time 1761311991.35 total 269.05 last 62.66) - open/close 19464 (time 1761312001.37 total 279.06 last 68.30) - open/close 20000 (time 1761312009.01 total 286.71 last 70.12) - open/close 20722 (time 1761312019.02 total 296.72 last 72.13) - open/close 21491 (time 1761312029.04 total 306.73 last 76.78) - open/close 22182 (time 1761312039.04 total 316.74 last 69.06) - open/close 22928 (time 1761312049.06 total 326.75 last 74.47) - open/close 23660 (time 1761312059.07 total 336.76 last 73.15) - open/close 24302 (time 1761312069.08 total 346.77 last 64.14) - open/close 25056 (time 1761312079.08 total 356.77 last 75.37) - open/close 25746 (time 1761312089.10 total 366.79 last 68.90) - open/close 26534 (time 1761312099.10 total 376.80 last 78.74) - open/close 27288 (time 1761312109.11 total 386.80 last 75.38) - open/close 28011 (time 1761312119.11 total 396.81 last 72.25) - open/close 28860 (time 1761312129.12 total 406.82 last 84.79) - open/close 29618 (time 1761312139.13 total 416.83 last 75.73) - open/close 30000 (time 1761312143.81 total 421.51 last 81.62) - open/close 30742 (time 1761312153.82 total 431.51 last 74.18) - open/close 31479 (time 1761312163.83 total 441.52 last 73.63) - open/close 32176 (time 1761312173.84 total 451.53 last 69.62) - open/close 33035 (time 1761312183.84 total 461.53 last 85.90) - open/close 33798 (time 1761312193.84 total 471.53 last 76.30) - open/close 34515 (time 1761312203.84 total 481.53 last 71.67) - open/close 35304 (time 1761312213.85 total 491.54 last 78.82) - open/close 35972 (time 1761312223.86 total 501.55 last 66.73) - open/close 36722 (time 1761312233.86 total 511.56 last 74.99) - open/close 37508 (time 1761312243.87 total 521.56 last 78.54) - open/close 38195 (time 1761312253.88 total 531.57 last 68.66) - open/close 38826 (time 1761312263.88 total 541.57 last 63.07) - open/close 39556 (time 1761312273.89 total 551.58 last 72.93) - open/close 40000 (time 1761312279.65 total 557.34 last 77.07) - open/close 40835 (time 1761312289.67 total 567.36 last 83.38) - open/close 41557 (time 1761312299.68 total 577.37 last 72.13) - open/close 42279 (time 1761312309.68 total 587.38 last 72.16) - open/close 42948 (time 1761312319.69 total 597.38 last 66.86) - open/close 43561 (time 1761312329.71 total 607.40 last 61.16) - open/close 44200 (time 1761312339.72 total 617.42 last 63.83) - open/close 45020 (time 1761312349.73 total 627.42 last 81.95) - open/close 45803 (time 1761312359.73 total 637.42 last 78.27) - open/close 46626 (time 1761312369.74 total 647.43 last 82.23) - open/close 47344 (time 1761312379.75 total 657.45 last 71.72) - open/close 48025 (time 1761312389.76 total 667.45 last 68.08) - open/close 48748 (time 1761312399.77 total 677.46 last 72.22) - open/close 49484 (time 1761312409.77 total 687.46 last 73.58) - open/close 50000 (time 1761312417.36 total 695.05 last 68.02) - open/close 50722 (time 1761312427.36 total 705.05 last 72.18) - open/close 51612 (time 1761312437.36 total 715.06 last 88.94) - open/close 52333 (time 1761312447.39 total 725.08 last 71.92) - open/close 53064 (time 1761312457.39 total 735.09 last 73.06) - open/close 53807 (time 1761312467.41 total 745.10 last 74.19) - open/close 54546 (time 1761312477.42 total 755.12 last 73.80) - open/close 55324 (time 1761312487.48 total 765.17 last 77.37) - open/close 56084 (time 1761312497.49 total 775.18 last 75.95) - open/close 56878 (time 1761312507.49 total 785.18 last 79.37) - open/close 57702 (time 1761312517.50 total 795.19 last 82.34) - open/close 58481 (time 1761312527.50 total 805.19 last 77.89) - open/close 59301 (time 1761312537.50 total 815.19 last 81.99) - open/close 60000 (time 1761312546.73 total 824.42 last 75.76) - open/close 60744 (time 1761312556.75 total 834.44 last 74.24) - open/close 61510 (time 1761312566.75 total 844.45 last 76.58) - open/close 62223 (time 1761312576.75 total 854.45 last 71.28) - open/close 62896 (time 1761312586.77 total 864.46 last 67.21) - open/close 63620 (time 1761312596.77 total 874.46 last 72.39) - open/close 64310 (time 1761312606.77 total 884.46 last 69.00) total: 64768 open/close in 890.22 seconds: 72.76 ops/second - /unlink 1382 (time 1761312625.89 total 10.00 last 138.19) - /unlink 2813 (time 1761312635.90 total 20.01 last 142.96) - /unlink 4055 (time 1761312645.91 total 30.02 last 124.11) - /unlink 5314 (time 1761312655.92 total 40.02 last 125.84) - /unlink 6696 (time 1761312665.92 total 50.03 last 138.15) - /unlink 8096 (time 1761312675.93 total 60.03 last 139.93) - /unlink 9445 (time 1761312685.94 total 70.04 last 134.73) - /unlink 10000 (time 1761312690.29 total 74.40 last 127.39) - /unlink 11103 (time 1761312700.30 total 84.40 last 110.28) - /unlink 12390 (time 1761312710.30 total 94.41 last 128.63) - /unlink 13880 (time 1761312720.31 total 104.42 last 148.90) - /unlink 15279 (time 1761312730.31 total 114.42 last 139.83) - /unlink 16643 (time 1761312740.31 total 124.42 last 136.39) - /unlink 18016 (time 1761312750.32 total 134.43 last 137.24) - /unlink 19350 (time 1761312760.34 total 144.44 last 133.17) - /unlink 20000 (time 1761312765.47 total 149.58 last 126.53) - /unlink 21536 (time 1761312775.47 total 159.58 last 153.57) - /unlink 23290 (time 1761312785.48 total 169.58 last 175.35) - /unlink 24670 (time 1761312795.48 total 179.59 last 137.94) - /unlink 26108 (time 1761312805.48 total 189.59 last 143.75) - /unlink 27641 (time 1761312815.48 total 199.59 last 153.29) - /unlink 29225 (time 1761312825.49 total 209.59 last 158.38) - /unlink 30000 (time 1761312831.05 total 215.16 last 139.26) - /unlink 31312 (time 1761312841.05 total 225.16 last 131.18) - /unlink 32638 (time 1761312851.06 total 235.16 last 132.54) - /unlink 33955 (time 1761312861.06 total 245.17 last 131.67) - /unlink 35259 (time 1761312871.06 total 255.17 last 130.37) - /unlink 36596 (time 1761312881.07 total 265.18 last 133.56) - /unlink 37820 (time 1761312891.07 total 275.18 last 122.38) - /unlink 39315 (time 1761312901.08 total 285.18 last 149.44) - /unlink 40000 (time 1761312905.75 total 289.86 last 146.48) - /unlink 41663 (time 1761312915.76 total 299.87 last 166.16) - /unlink 43507 (time 1761312925.77 total 309.87 last 184.33) - /unlink 45252 (time 1761312935.77 total 319.88 last 174.44) - /unlink 46808 (time 1761312945.78 total 329.89 last 155.46) - /unlink 48326 (time 1761312955.78 total 339.89 last 151.74) - /unlink 49883 (time 1761312965.79 total 349.89 last 155.63) - /unlink 51343 (time 1761312975.79 total 359.90 last 145.96) - /unlink 52625 (time 1761312985.79 total 369.90 last 128.18) - /unlink 53921 (time 1761312995.79 total 379.90 last 129.57) - /unlink 55081 (time 1761313005.80 total 389.90 last 115.97) - /unlink 56612 (time 1761313015.80 total 399.91 last 153.02) - /unlink 57948 (time 1761313025.80 total 409.91 last 133.58) - /unlink 59789 (time 1761313035.81 total 419.91 last 184.01) - /unlink 61382 (time 1761313045.84 total 429.94 last 158.83) - /unlink 62665 (time 1761313055.84 total 439.94 last 128.29) - /unlink 63984 (time 1761313065.84 total 449.94 last 131.90) total: 64768 /unlink in 454.95 seconds: 142.36 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 970 (time 1761313101.90 total 10.01 last 96.94) - open/close 1893 (time 1761313111.91 total 20.01 last 92.27) - open/close 2719 (time 1761313121.91 total 30.01 last 82.59) - open/close 3526 (time 1761313131.91 total 40.02 last 80.65) - open/close 4298 (time 1761313141.92 total 50.03 last 77.12) - open/close 5074 (time 1761313151.93 total 60.04 last 77.52) - open/close 5908 (time 1761313161.94 total 70.05 last 83.31) - open/close 6768 (time 1761313171.95 total 80.06 last 85.91) - open/close 7481 (time 1761313181.96 total 90.06 last 71.28) - open/close 8185 (time 1761313191.96 total 100.06 last 70.39) - open/close 8934 (time 1761313201.96 total 110.07 last 74.87) - open/close 9715 (time 1761313211.97 total 120.07 last 78.04) - open/close 10000 (time 1761313215.58 total 123.68 last 78.98) - open/close 10832 (time 1761313225.59 total 133.69 last 83.12) - open/close 11645 (time 1761313235.59 total 143.69 last 81.28) - open/close 12443 (time 1761313245.59 total 153.70 last 79.78) - open/close 13242 (time 1761313255.61 total 163.71 last 79.80) - open/close 13927 (time 1761313265.62 total 173.72 last 68.43) - open/close 14657 (time 1761313275.62 total 183.73 last 72.96) - open/close 15371 (time 1761313285.64 total 193.74 last 71.27) - open/close 16187 (time 1761313295.64 total 203.75 last 81.58) - open/close 16946 (time 1761313305.65 total 213.75 last 75.88) - open/close 17673 (time 1761313315.65 total 223.76 last 72.66) - open/close 18489 (time 1761313325.66 total 233.76 last 81.53) - open/close 19310 (time 1761313335.67 total 243.77 last 82.06) - open/close 20000 (time 1761313343.86 total 251.97 last 84.18) - open/close 20831 (time 1761313353.87 total 261.97 last 83.07) - open/close 21614 (time 1761313363.87 total 271.97 last 78.27) - open/close 22397 (time 1761313373.87 total 281.97 last 78.29) - open/close 23161 (time 1761313383.89 total 291.99 last 76.28) - open/close 23946 (time 1761313393.89 total 301.99 last 78.50) - open/close 24738 (time 1761313403.89 total 311.99 last 79.19) - open/close 25539 (time 1761313413.89 total 321.99 last 80.10) - open/close 26316 (time 1761313423.89 total 331.99 last 77.68) - open/close 27171 (time 1761313433.90 total 342.00 last 85.44) - open/close 27973 (time 1761313443.90 total 352.01 last 80.14) - open/close 28704 (time 1761313453.91 total 362.01 last 73.06) - open/close 29494 (time 1761313463.92 total 372.02 last 78.96) - open/close 30000 (time 1761313470.14 total 378.25 last 81.23) - open/close 30851 (time 1761313480.16 total 388.26 last 85.01) - open/close 31705 (time 1761313490.16 total 398.27 last 85.33) - open/close 32479 (time 1761313500.18 total 408.28 last 77.27) - open/close 33285 (time 1761313510.19 total 418.29 last 80.54) - open/close 34069 (time 1761313520.20 total 428.30 last 78.34) - open/close 34767 (time 1761313530.21 total 438.31 last 69.72) - open/close 35533 (time 1761313540.21 total 448.31 last 76.59) - open/close 36322 (time 1761313550.22 total 458.33 last 78.80) - open/close 37155 (time 1761313560.23 total 468.33 last 83.27) - open/close 37967 (time 1761313570.23 total 478.33 last 81.16) - open/close 38808 (time 1761313580.24 total 488.34 last 84.01) - open/close 39644 (time 1761313590.24 total 498.35 last 83.57) - open/close 40000 (time 1761313595.25 total 503.35 last 71.12) - open/close 40764 (time 1761313605.26 total 513.36 last 76.35) - open/close 41521 (time 1761313615.26 total 523.37 last 75.65) - open/close 42244 (time 1761313625.28 total 533.38 last 72.21) - open/close 43044 (time 1761313635.29 total 543.40 last 79.86) - open/close 43764 (time 1761313645.30 total 553.41 last 71.91) - open/close 44415 (time 1761313655.31 total 563.42 last 65.05) - open/close 45179 (time 1761313665.32 total 573.42 last 76.36) - open/close 45946 (time 1761313675.32 total 583.42 last 76.68) - open/close 46701 (time 1761313685.33 total 593.43 last 75.42) - open/close 47477 (time 1761313695.34 total 603.44 last 77.55) - open/close 48328 (time 1761313705.34 total 613.44 last 85.05) - open/close 49309 (time 1761313715.35 total 623.45 last 98.02) - open/close 50000 (time 1761313723.04 total 631.14 last 89.90) - open/close 50849 (time 1761313733.05 total 641.15 last 84.78) - open/close 51585 (time 1761313743.05 total 651.16 last 73.56) - open/close 52373 (time 1761313753.06 total 661.16 last 78.79) - open/close 53158 (time 1761313763.06 total 671.16 last 78.49) - open/close 53949 (time 1761313773.07 total 681.17 last 79.01) - open/close 54667 (time 1761313783.08 total 691.18 last 71.70) - open/close 55343 (time 1761313793.08 total 701.19 last 67.58) - open/close 56054 (time 1761313803.10 total 711.20 last 71.00) - open/close 56780 (time 1761313813.10 total 721.21 last 72.56) - open/close 57503 (time 1761313823.10 total 731.21 last 72.29) - open/close 58273 (time 1761313833.10 total 741.21 last 76.99) - open/close 59032 (time 1761313843.11 total 751.21 last 75.87) - open/close 59808 (time 1761313853.11 total 761.21 last 77.59) - open/close 60000 (time 1761313855.41 total 763.51 last 83.51) - open/close 60712 (time 1761313865.41 total 773.51 last 71.19) - open/close 61382 (time 1761313875.42 total 783.52 last 66.94) - open/close 62011 (time 1761313885.43 total 793.53 last 62.82) - open/close 62738 (time 1761313895.44 total 803.54 last 72.67) - open/close 63498 (time 1761313905.44 total 813.54 last 75.97) - open/close 64263 (time 1761313915.44 total 823.54 last 76.49) total: 64768 open/close in 830.16 seconds: 78.02 ops/second - /unlink 1244 (time 1761313935.57 total 10.01 last 124.33) - /unlink 2467 (time 1761313945.58 total 20.01 last 122.28) - /unlink 3716 (time 1761313955.58 total 30.01 last 124.86) - /unlink 4996 (time 1761313965.58 total 40.01 last 127.99) - /unlink 6162 (time 1761313975.58 total 50.02 last 116.55) - /unlink 7470 (time 1761313985.58 total 60.02 last 130.79) - /unlink 8680 (time 1761313995.59 total 70.02 last 120.91) - /unlink 9945 (time 1761314005.60 total 80.03 last 126.45) - /unlink 11193 (time 1761314015.60 total 90.03 last 124.75) - /unlink 12361 (time 1761314025.60 total 100.04 last 116.77) - /unlink 13606 (time 1761314035.61 total 110.04 last 124.44) - /unlink 14918 (time 1761314045.62 total 120.05 last 131.10) - /unlink 16178 (time 1761314055.62 total 130.05 last 125.98) - /unlink 17431 (time 1761314065.62 total 140.06 last 125.22) - /unlink 18772 (time 1761314075.63 total 150.06 last 134.01) - /unlink 20000 (time 1761314085.45 total 159.88 last 125.08) - /unlink 21108 (time 1761314095.45 total 169.89 last 110.72) - /unlink 22277 (time 1761314105.46 total 179.89 last 116.82) - /unlink 23507 (time 1761314115.47 total 189.90 last 122.94) - /unlink 24759 (time 1761314125.47 total 199.90 last 125.19) - /unlink 25997 (time 1761314135.47 total 209.90 last 123.77) - /unlink 27195 (time 1761314145.47 total 219.90 last 119.78) - /unlink 28296 (time 1761314155.48 total 229.91 last 110.06) - /unlink 29503 (time 1761314165.48 total 239.91 last 120.61) - /unlink 30000 (time 1761314169.03 total 243.46 last 140.29) - /unlink 31241 (time 1761314179.03 total 253.46 last 124.03) - /unlink 32456 (time 1761314189.03 total 263.46 last 121.50) - /unlink 33702 (time 1761314199.04 total 273.47 last 124.53) - /unlink 35147 (time 1761314209.04 total 283.47 last 144.47) - /unlink 36330 (time 1761314219.04 total 293.47 last 118.27) - /unlink 37500 (time 1761314229.05 total 303.48 last 116.94) - /unlink 38666 (time 1761314239.05 total 313.48 last 116.59) - /unlink 39843 (time 1761314249.05 total 323.49 last 117.63) - /unlink 40898 (time 1761314259.06 total 333.50 last 105.40) - /unlink 42054 (time 1761314269.06 total 343.50 last 115.60) - /unlink 43131 (time 1761314279.07 total 353.50 last 107.66) - /unlink 44270 (time 1761314289.07 total 363.51 last 113.83) - /unlink 45436 (time 1761314299.08 total 373.51 last 116.57) - /unlink 46614 (time 1761314309.08 total 383.51 last 117.75) - /unlink 47798 (time 1761314319.08 total 393.51 last 118.40) - /unlink 48989 (time 1761314329.09 total 403.52 last 119.04) - /unlink 50000 (time 1761314337.12 total 411.55 last 125.91) - /unlink 51240 (time 1761314347.12 total 421.55 last 123.98) - /unlink 52482 (time 1761314357.12 total 431.55 last 124.15) - /unlink 53757 (time 1761314367.12 total 441.56 last 127.47) - /unlink 55008 (time 1761314377.13 total 451.56 last 125.04) - /unlink 56224 (time 1761314387.13 total 461.56 last 121.56) - /unlink 57605 (time 1761314397.13 total 471.56 last 138.09) - /unlink 58797 (time 1761314407.14 total 481.57 last 119.09) - /unlink 60000 (time 1761314417.02 total 491.46 last 121.73) - /unlink 61220 (time 1761314427.03 total 501.46 last 121.98) - /unlink 62479 (time 1761314437.03 total 511.46 last 125.84) - /unlink 63782 (time 1761314447.03 total 521.46 last 130.29) total: 64768 /unlink in 529.44 seconds: 122.33 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 777 (time 1761314489.66 total 10.00 last 77.70) - open/close 1567 (time 1761314499.68 total 20.01 last 78.92) - open/close 2384 (time 1761314509.68 total 30.01 last 81.67) - open/close 3123 (time 1761314519.68 total 40.02 last 73.86) - open/close 3784 (time 1761314529.69 total 50.02 last 66.08) - open/close 4471 (time 1761314539.71 total 60.05 last 68.52) - open/close 5205 (time 1761314549.72 total 70.05 last 73.38) - open/close 5957 (time 1761314559.72 total 80.05 last 75.19) - open/close 6509 (time 1761314569.72 total 90.05 last 55.19) - open/close 7158 (time 1761314579.72 total 100.06 last 64.87) - open/close 7897 (time 1761314589.73 total 110.06 last 73.89) - open/close 8704 (time 1761314599.73 total 120.06 last 80.68) - open/close 9583 (time 1761314609.74 total 130.07 last 87.82) - open/close 10000 (time 1761314614.68 total 135.01 last 84.44) - open/close 10827 (time 1761314624.68 total 145.02 last 82.64) - open/close 11595 (time 1761314634.69 total 155.03 last 76.74) - open/close 12357 (time 1761314644.70 total 165.04 last 76.11) - open/close 13131 (time 1761314654.71 total 175.04 last 77.37) - open/close 13895 (time 1761314664.71 total 185.05 last 76.37) - open/close 14634 (time 1761314674.72 total 195.05 last 73.83) - open/close 15403 (time 1761314684.75 total 205.09 last 76.64) - open/close 16161 (time 1761314694.76 total 215.10 last 75.74) - open/close 16906 (time 1761314704.77 total 225.10 last 74.44) - open/close 17676 (time 1761314714.77 total 235.11 last 76.95) - open/close 18411 (time 1761314724.79 total 245.12 last 73.41) - open/close 19156 (time 1761314734.79 total 255.12 last 74.50) - open/close 19992 (time 1761314744.81 total 265.14 last 83.41) - open/close 20821 (time 1761314754.82 total 275.16 last 82.80) - open/close 21620 (time 1761314764.82 total 285.16 last 79.87) - open/close 22376 (time 1761314774.83 total 295.17 last 75.53) - open/close 23161 (time 1761314784.84 total 305.18 last 78.42) - open/close 23940 (time 1761314794.85 total 315.19 last 77.82) - open/close 24678 (time 1761314804.86 total 325.20 last 73.76) - open/close 25422 (time 1761314814.88 total 335.21 last 74.28) - open/close 26189 (time 1761314824.88 total 345.22 last 76.67) - open/close 26949 (time 1761314834.89 total 355.23 last 75.90) - open/close 27696 (time 1761314844.89 total 365.23 last 74.69) - open/close 28470 (time 1761314854.90 total 375.24 last 77.34) - open/close 29286 (time 1761314864.92 total 385.26 last 81.45) - open/close 30000 (time 1761314874.37 total 394.71 last 75.51) - open/close 30779 (time 1761314884.39 total 404.73 last 77.78) - open/close 31503 (time 1761314894.42 total 414.76 last 72.17) - open/close 32218 (time 1761314904.44 total 424.78 last 71.36) - open/close 32995 (time 1761314914.44 total 434.78 last 77.69) - open/close 33746 (time 1761314924.45 total 444.78 last 75.08) - open/close 34518 (time 1761314934.46 total 454.80 last 77.08) - open/close 35288 (time 1761314944.47 total 464.81 last 76.93) - open/close 36029 (time 1761314954.47 total 474.81 last 74.08) - open/close 36791 (time 1761314964.48 total 484.81 last 76.16) - open/close 37580 (time 1761314974.49 total 494.82 last 78.84) - open/close 38344 (time 1761314984.49 total 504.83 last 76.36) - open/close 39121 (time 1761314994.49 total 514.83 last 77.67) - open/close 39874 (time 1761315004.50 total 524.84 last 75.23) - open/close 40652 (time 1761315014.51 total 534.85 last 77.75) - open/close 41369 (time 1761315024.51 total 544.85 last 71.68) - open/close 42104 (time 1761315034.52 total 554.86 last 73.43) - open/close 42728 (time 1761315044.55 total 564.89 last 62.23) - open/close 43411 (time 1761315054.57 total 574.91 last 68.16) - open/close 44112 (time 1761315064.58 total 584.91 last 70.06) - open/close 44866 (time 1761315074.59 total 594.92 last 75.32) - open/close 45635 (time 1761315084.59 total 604.93 last 76.87) - open/close 46399 (time 1761315094.59 total 614.93 last 76.38) - open/close 47114 (time 1761315104.60 total 624.94 last 71.44) - open/close 47787 (time 1761315114.61 total 634.94 last 67.25) - open/close 48538 (time 1761315124.61 total 644.95 last 75.08) - open/close 49270 (time 1761315134.61 total 654.95 last 73.18) - open/close 49988 (time 1761315144.62 total 664.96 last 71.73) - open/close 50750 (time 1761315154.64 total 674.98 last 76.07) - open/close 51485 (time 1761315164.65 total 684.98 last 73.45) - open/close 52204 (time 1761315174.65 total 694.99 last 71.88) - open/close 52933 (time 1761315184.65 total 704.99 last 72.89) - open/close 53683 (time 1761315194.65 total 714.99 last 74.99) - open/close 54380 (time 1761315204.68 total 725.01 last 69.53) - open/close 55054 (time 1761315214.68 total 735.02 last 67.37) - open/close 55748 (time 1761315224.69 total 745.02 last 69.38) - open/close 56380 (time 1761315234.69 total 755.03 last 63.15) - open/close 57100 (time 1761315244.70 total 765.04 last 71.92) - open/close 57823 (time 1761315254.73 total 775.06 last 72.15) - open/close 58591 (time 1761315264.73 total 785.06 last 76.77) - open/close 59267 (time 1761315274.73 total 795.07 last 67.56) - open/close 59825 (time 1761315284.77 total 805.10 last 55.61) - open/close 60000 (time 1761315288.03 total 808.36 last 53.69) - open/close 60630 (time 1761315298.04 total 818.37 last 62.93) - open/close 61293 (time 1761315308.05 total 828.39 last 66.19) - open/close 61992 (time 1761315318.06 total 838.40 last 69.86) - open/close 62616 (time 1761315328.06 total 848.40 last 62.38) - open/close 63242 (time 1761315338.08 total 858.41 last 62.51) - open/close 63987 (time 1761315348.08 total 868.42 last 74.45) - open/close 64633 (time 1761315358.09 total 878.42 last 64.58) total: 64768 open/close in 880.51 seconds: 73.56 ops/second - /unlink 1215 (time 1761315373.61 total 10.01 last 121.37) - /unlink 2431 (time 1761315383.61 total 20.01 last 121.55) - /unlink 3630 (time 1761315393.61 total 30.02 last 119.90) - /unlink 4822 (time 1761315403.61 total 40.02 last 119.20) - /unlink 6068 (time 1761315413.62 total 50.02 last 124.54) - /unlink 7336 (time 1761315423.62 total 60.03 last 126.74) - /unlink 8500 (time 1761315433.63 total 70.03 last 116.34) - /unlink 9723 (time 1761315443.63 total 80.03 last 122.29) - /unlink 10000 (time 1761315445.70 total 82.11 last 133.52) - /unlink 11234 (time 1761315455.70 total 92.11 last 123.36) - /unlink 12399 (time 1761315465.71 total 102.11 last 116.44) - /unlink 13605 (time 1761315475.71 total 112.12 last 120.56) - /unlink 14732 (time 1761315485.72 total 122.13 last 112.60) - /unlink 16025 (time 1761315495.73 total 132.13 last 129.24) - /unlink 17290 (time 1761315505.73 total 142.13 last 126.48) - /unlink 18536 (time 1761315515.73 total 152.13 last 124.57) - /unlink 19755 (time 1761315525.73 total 162.14 last 121.85) - /unlink 20926 (time 1761315535.74 total 172.14 last 117.08) - /unlink 22042 (time 1761315545.74 total 182.14 last 111.56) - /unlink 23199 (time 1761315555.75 total 192.15 last 115.61) - /unlink 24407 (time 1761315565.75 total 202.16 last 120.75) - /unlink 25638 (time 1761315575.77 total 212.17 last 122.91) - /unlink 26698 (time 1761315585.77 total 222.17 last 105.96) - /unlink 27931 (time 1761315595.77 total 232.18 last 123.27) - /unlink 29188 (time 1761315605.78 total 242.18 last 125.66) - /unlink 30000 (time 1761315612.18 total 248.59 last 126.78) - /unlink 31296 (time 1761315622.18 total 258.59 last 129.59) - /unlink 32472 (time 1761315632.19 total 268.60 last 117.49) - /unlink 33611 (time 1761315642.19 total 278.60 last 113.88) - /unlink 34861 (time 1761315652.20 total 288.61 last 124.88) - /unlink 36097 (time 1761315662.21 total 298.61 last 123.56) - /unlink 37398 (time 1761315672.21 total 308.62 last 130.00) - /unlink 38622 (time 1761315682.22 total 318.62 last 122.32) - /unlink 39916 (time 1761315692.23 total 328.63 last 129.33) - /unlink 41202 (time 1761315702.23 total 338.63 last 128.55) - /unlink 42434 (time 1761315712.24 total 348.64 last 123.10) - /unlink 43694 (time 1761315722.24 total 358.64 last 125.99) - /unlink 45005 (time 1761315732.25 total 368.65 last 130.98) - /unlink 46224 (time 1761315742.25 total 378.66 last 121.83) - /unlink 47519 (time 1761315752.26 total 388.66 last 129.44) - /unlink 48848 (time 1761315762.26 total 398.66 last 132.88) - /unlink 50000 (time 1761315771.18 total 407.59 last 129.09) - /unlink 51334 (time 1761315781.19 total 417.60 last 133.26) - /unlink 52490 (time 1761315791.20 total 427.61 last 115.50) - /unlink 53637 (time 1761315801.21 total 437.61 last 114.64) - /unlink 54846 (time 1761315811.21 total 447.61 last 120.88) - /unlink 56038 (time 1761315821.21 total 457.62 last 119.14) - /unlink 57283 (time 1761315831.22 total 467.62 last 124.49) - /unlink 58509 (time 1761315841.22 total 477.63 last 122.49) - /unlink 59761 (time 1761315851.23 total 487.63 last 125.14) - /unlink 61042 (time 1761315861.23 total 497.63 last 128.09) - /unlink 62292 (time 1761315871.25 total 507.65 last 124.75) - /unlink 63545 (time 1761315881.25 total 517.66 last 125.27) - /unlink 64727 (time 1761315891.25 total 527.66 last 118.17) total: 64768 /unlink in 527.98 seconds: 122.67 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 798 (time 1761315923.54 total 10.00 last 79.77) - open/close 1583 (time 1761315933.55 total 20.01 last 78.45) - open/close 2344 (time 1761315943.55 total 30.02 last 76.06) - open/close 3185 (time 1761315953.56 total 40.02 last 84.03) - open/close 3970 (time 1761315963.57 total 50.03 last 78.44) - open/close 4750 (time 1761315973.58 total 60.04 last 77.90) - open/close 5483 (time 1761315983.60 total 70.06 last 73.17) - open/close 6188 (time 1761315993.60 total 80.07 last 70.47) - open/close 6986 (time 1761316003.61 total 90.07 last 79.78) - open/close 7766 (time 1761316013.61 total 100.07 last 77.98) - open/close 8559 (time 1761316023.62 total 110.08 last 79.21) - open/close 9336 (time 1761316033.65 total 120.11 last 77.49) - open/close 10000 (time 1761316042.06 total 128.52 last 78.94) - open/close 10753 (time 1761316052.06 total 138.52 last 75.27) - open/close 11515 (time 1761316062.08 total 148.54 last 76.07) - open/close 12196 (time 1761316072.09 total 158.55 last 68.03) - open/close 12938 (time 1761316082.10 total 168.56 last 74.15) - open/close 13757 (time 1761316092.10 total 178.56 last 81.87) - open/close 14498 (time 1761316102.10 total 188.56 last 74.08) - open/close 15287 (time 1761316112.11 total 198.57 last 78.86) - open/close 16017 (time 1761316122.12 total 208.59 last 72.88) - open/close 16686 (time 1761316132.14 total 218.60 last 66.78) - open/close 17267 (time 1761316142.14 total 228.60 last 58.09) - open/close 17982 (time 1761316152.15 total 238.61 last 71.46) - open/close 18712 (time 1761316162.15 total 248.61 last 72.97) - open/close 19431 (time 1761316172.15 total 258.62 last 71.90) - open/close 20000 (time 1761316180.23 total 266.70 last 70.42) - open/close 20813 (time 1761316190.24 total 276.71 last 81.21) - open/close 21544 (time 1761316200.25 total 286.71 last 73.08) - open/close 22310 (time 1761316210.26 total 296.72 last 76.51) - open/close 23107 (time 1761316220.26 total 306.72 last 79.68) - open/close 23886 (time 1761316230.27 total 316.73 last 77.83) - open/close 24700 (time 1761316240.28 total 326.74 last 81.33) - open/close 25455 (time 1761316250.28 total 336.74 last 75.48) - open/close 26252 (time 1761316260.29 total 346.75 last 79.65) - open/close 26995 (time 1761316270.33 total 356.80 last 73.96) - open/close 27769 (time 1761316280.34 total 366.80 last 77.36) - open/close 28556 (time 1761316290.36 total 376.82 last 78.56) - open/close 29282 (time 1761316300.36 total 386.82 last 72.59) - open/close 30000 (time 1761316309.62 total 396.08 last 77.52) - open/close 30670 (time 1761316319.62 total 406.09 last 66.97) - open/close 31380 (time 1761316329.63 total 416.09 last 70.98) - open/close 32081 (time 1761316339.63 total 426.09 last 70.08) - open/close 32813 (time 1761316349.63 total 436.09 last 73.19) - open/close 33567 (time 1761316359.65 total 446.11 last 75.25) - open/close 34355 (time 1761316369.66 total 456.12 last 78.73) - open/close 35160 (time 1761316379.66 total 466.13 last 80.46) - open/close 35862 (time 1761316389.67 total 476.13 last 70.18) - open/close 36592 (time 1761316399.67 total 486.13 last 72.96) - open/close 37322 (time 1761316409.68 total 496.14 last 72.97) - open/close 38035 (time 1761316419.68 total 506.14 last 71.29) - open/close 38782 (time 1761316429.68 total 516.15 last 74.67) - open/close 39543 (time 1761316439.70 total 526.17 last 75.94) - open/close 40000 (time 1761316446.17 total 532.63 last 70.71) - open/close 40746 (time 1761316456.17 total 542.64 last 74.56) - open/close 41514 (time 1761316466.18 total 552.64 last 76.76) - open/close 42294 (time 1761316476.19 total 562.65 last 77.95) - open/close 43078 (time 1761316486.19 total 572.65 last 78.36) - open/close 43850 (time 1761316496.19 total 582.66 last 77.17) - open/close 44622 (time 1761316506.20 total 592.67 last 77.13) - open/close 45410 (time 1761316516.21 total 602.68 last 78.72) - open/close 46155 (time 1761316526.22 total 612.68 last 74.44) - open/close 46858 (time 1761316536.23 total 622.69 last 70.25) - open/close 47613 (time 1761316546.24 total 632.71 last 75.39) - open/close 48393 (time 1761316556.24 total 642.71 last 77.99) - open/close 49189 (time 1761316566.25 total 652.71 last 79.57) - open/close 50000 (time 1761316575.89 total 662.35 last 84.10) - open/close 50808 (time 1761316585.89 total 672.36 last 80.79) - open/close 51653 (time 1761316595.90 total 682.36 last 84.45) - open/close 52432 (time 1761316605.90 total 692.37 last 77.87) - open/close 53253 (time 1761316615.90 total 702.37 last 82.09) - open/close 54102 (time 1761316625.91 total 712.37 last 84.85) - open/close 54932 (time 1761316635.92 total 722.39 last 82.88) - open/close 55834 (time 1761316645.93 total 732.39 last 90.18) - open/close 56644 (time 1761316655.93 total 742.40 last 80.95) - open/close 57443 (time 1761316665.94 total 752.40 last 79.88) - open/close 58224 (time 1761316675.96 total 762.42 last 77.92) - open/close 59044 (time 1761316685.96 total 772.42 last 81.97) - open/close 59863 (time 1761316695.97 total 782.43 last 81.83) - open/close 60000 (time 1761316698.05 total 784.51 last 65.99) - open/close 60754 (time 1761316708.05 total 794.51 last 75.36) - open/close 61537 (time 1761316718.07 total 804.53 last 78.16) - open/close 62321 (time 1761316728.08 total 814.54 last 78.31) - open/close 62968 (time 1761316738.09 total 824.56 last 64.62) - open/close 63745 (time 1761316748.10 total 834.56 last 77.66) - open/close 64570 (time 1761316758.10 total 844.57 last 82.47) total: 64768 open/close in 846.74 seconds: 76.49 ops/second - /unlink 1374 (time 1761316773.24 total 10.00 last 137.34) - /unlink 2809 (time 1761316783.25 total 20.01 last 143.46) - /unlink 4253 (time 1761316793.25 total 30.01 last 144.37) - /unlink 5672 (time 1761316803.26 total 40.02 last 141.81) - /unlink 6932 (time 1761316813.26 total 50.02 last 125.97) - /unlink 8298 (time 1761316823.27 total 60.03 last 136.50) - /unlink 9570 (time 1761316833.27 total 70.03 last 127.14) - /unlink 10000 (time 1761316836.54 total 73.30 last 131.38) - /unlink 11152 (time 1761316846.54 total 83.30 last 115.20) - /unlink 12363 (time 1761316856.55 total 93.31 last 121.00) - /unlink 13504 (time 1761316866.55 total 103.31 last 114.09) - /unlink 14698 (time 1761316876.55 total 113.31 last 119.37) - /unlink 15955 (time 1761316886.56 total 123.32 last 125.65) - /unlink 17263 (time 1761316896.57 total 133.33 last 130.70) - /unlink 18439 (time 1761316906.58 total 143.34 last 117.46) - /unlink 19624 (time 1761316916.58 total 153.34 last 118.50) - /unlink 20000 (time 1761316919.25 total 156.01 last 140.89) - /unlink 21314 (time 1761316929.25 total 166.01 last 131.36) - /unlink 22667 (time 1761316939.26 total 176.02 last 135.21) - /unlink 24058 (time 1761316949.26 total 186.02 last 139.01) - /unlink 25427 (time 1761316959.27 total 196.02 last 136.87) - /unlink 26656 (time 1761316969.27 total 206.03 last 122.80) - /unlink 27714 (time 1761316979.29 total 216.05 last 105.59) - /unlink 28869 (time 1761316989.31 total 226.07 last 115.32) - /unlink 29888 (time 1761316999.31 total 236.07 last 101.88) - /unlink 31124 (time 1761317009.32 total 246.07 last 123.55) - /unlink 32340 (time 1761317019.33 total 256.09 last 121.40) - /unlink 33553 (time 1761317029.34 total 266.10 last 121.22) - /unlink 34835 (time 1761317039.35 total 276.11 last 128.09) - /unlink 36032 (time 1761317049.36 total 286.12 last 119.51) - /unlink 37246 (time 1761317059.37 total 296.13 last 121.34) - /unlink 38511 (time 1761317069.39 total 306.15 last 126.18) - /unlink 39806 (time 1761317079.40 total 316.16 last 129.42) - /unlink 41117 (time 1761317089.40 total 326.16 last 131.05) - /unlink 42454 (time 1761317099.40 total 336.16 last 133.69) - /unlink 43742 (time 1761317109.41 total 346.17 last 128.78) - /unlink 45082 (time 1761317119.41 total 356.17 last 133.99) - /unlink 46387 (time 1761317129.41 total 366.17 last 130.42) - /unlink 47764 (time 1761317139.42 total 376.18 last 137.62) - /unlink 49184 (time 1761317149.42 total 386.18 last 141.98) - /unlink 50000 (time 1761317154.76 total 391.52 last 152.71) - /unlink 51398 (time 1761317164.77 total 401.53 last 139.76) - /unlink 52684 (time 1761317174.77 total 411.53 last 128.50) - /unlink 53982 (time 1761317184.78 total 421.54 last 129.72) - /unlink 55333 (time 1761317194.79 total 431.55 last 135.02) - /unlink 56573 (time 1761317204.79 total 441.55 last 123.99) - /unlink 57862 (time 1761317214.80 total 451.56 last 128.79) - /unlink 59200 (time 1761317224.80 total 461.56 last 133.70) - /unlink 60000 (time 1761317230.61 total 467.37 last 137.66) - /unlink 61325 (time 1761317240.62 total 477.38 last 132.45) - /unlink 62623 (time 1761317250.62 total 487.38 last 129.73) - /unlink 63990 (time 1761317260.63 total 497.39 last 136.65) total: 64768 /unlink in 503.15 seconds: 128.72 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 839 (time 1761317295.16 total 10.01 last 83.84) - open/close 1723 (time 1761317305.16 total 20.01 last 88.36) - open/close 2654 (time 1761317315.17 total 30.02 last 93.06) - open/close 3495 (time 1761317325.18 total 40.03 last 83.99) - open/close 4382 (time 1761317335.19 total 50.04 last 88.60) - open/close 5122 (time 1761317345.21 total 60.05 last 73.90) - open/close 5761 (time 1761317355.22 total 70.06 last 63.82) - open/close 6545 (time 1761317365.23 total 80.07 last 78.31) - open/close 7307 (time 1761317375.24 total 90.08 last 76.15) - open/close 8092 (time 1761317385.24 total 100.09 last 78.44) - open/close 8917 (time 1761317395.25 total 110.09 last 82.48) - open/close 9751 (time 1761317405.26 total 120.10 last 83.30) - open/close 10000 (time 1761317408.60 total 123.45 last 74.40) - open/close 10728 (time 1761317418.61 total 133.46 last 72.72) - open/close 11488 (time 1761317428.62 total 143.47 last 75.96) - open/close 12222 (time 1761317438.62 total 153.47 last 73.39) - open/close 12969 (time 1761317448.63 total 163.47 last 74.64) - open/close 13764 (time 1761317458.64 total 173.49 last 79.40) - open/close 14550 (time 1761317468.64 total 183.49 last 78.59) - open/close 15490 (time 1761317478.65 total 193.49 last 93.95) - open/close 16379 (time 1761317488.65 total 203.50 last 88.86) - open/close 17266 (time 1761317498.66 total 213.51 last 88.62) - open/close 18102 (time 1761317508.67 total 223.51 last 83.54) - open/close 18888 (time 1761317518.68 total 233.52 last 78.53) - open/close 19651 (time 1761317528.68 total 243.53 last 76.24) - open/close 20000 (time 1761317533.06 total 247.91 last 79.77) - open/close 20756 (time 1761317543.08 total 257.92 last 75.46) - open/close 21532 (time 1761317553.08 total 267.93 last 77.56) - open/close 22331 (time 1761317563.08 total 277.93 last 79.90) - open/close 23091 (time 1761317573.09 total 287.94 last 75.95) - open/close 23923 (time 1761317583.09 total 297.94 last 83.19) - open/close 24695 (time 1761317593.09 total 307.94 last 77.20) - open/close 25453 (time 1761317603.09 total 317.94 last 75.77) - open/close 26198 (time 1761317613.12 total 327.97 last 74.30) - open/close 27030 (time 1761317623.13 total 337.98 last 83.09) - open/close 27794 (time 1761317633.14 total 347.98 last 76.39) - open/close 28456 (time 1761317643.14 total 357.98 last 66.19) - open/close 29179 (time 1761317653.14 total 367.99 last 72.27) - open/close 29912 (time 1761317663.16 total 378.00 last 73.18) - open/close 30654 (time 1761317673.16 total 388.01 last 74.18) - open/close 31423 (time 1761317683.16 total 398.01 last 76.87) - open/close 32222 (time 1761317693.17 total 408.01 last 79.88) - open/close 32990 (time 1761317703.17 total 418.01 last 76.80) - open/close 33757 (time 1761317713.17 total 428.02 last 76.67) - open/close 34535 (time 1761317723.18 total 438.03 last 77.69) - open/close 35306 (time 1761317733.19 total 448.04 last 77.05) - open/close 36095 (time 1761317743.20 total 458.04 last 78.86) - open/close 36846 (time 1761317753.20 total 468.05 last 75.07) - open/close 37631 (time 1761317763.20 total 478.05 last 78.48) - open/close 38438 (time 1761317773.21 total 488.05 last 80.68) - open/close 39263 (time 1761317783.22 total 498.07 last 82.37) - open/close 40000 (time 1761317793.21 total 508.05 last 73.83) - open/close 40762 (time 1761317803.21 total 518.05 last 76.18) - open/close 41519 (time 1761317813.21 total 528.06 last 75.66) - open/close 42336 (time 1761317823.22 total 538.07 last 81.62) - open/close 43093 (time 1761317833.25 total 548.09 last 75.52) - open/close 43905 (time 1761317843.26 total 558.11 last 81.08) - open/close 44716 (time 1761317853.26 total 568.11 last 81.09) - open/close 45560 (time 1761317863.27 total 578.12 last 84.33) - open/close 46383 (time 1761317873.28 total 588.13 last 82.20) - open/close 47216 (time 1761317883.29 total 598.13 last 83.28) - open/close 47999 (time 1761317893.29 total 608.14 last 78.26) - open/close 48838 (time 1761317903.30 total 618.14 last 83.87) - open/close 49674 (time 1761317913.30 total 628.15 last 83.54) - open/close 50000 (time 1761317916.97 total 631.81 last 89.02) - open/close 50876 (time 1761317926.97 total 641.81 last 87.59) - open/close 51934 (time 1761317936.97 total 651.82 last 105.74) - open/close 53062 (time 1761317946.97 total 661.82 last 112.78) - open/close 53980 (time 1761317956.98 total 671.82 last 91.77) - open/close 54812 (time 1761317966.99 total 681.84 last 83.09) - open/close 55838 (time 1761317977.00 total 691.85 last 102.52) - open/close 56731 (time 1761317987.00 total 701.85 last 89.29) - open/close 57657 (time 1761317997.00 total 711.85 last 92.58) - open/close 58566 (time 1761318007.01 total 721.86 last 90.81) - open/close 59511 (time 1761318017.01 total 731.86 last 94.49) - open/close 60000 (time 1761318022.59 total 737.44 last 87.68) - open/close 60848 (time 1761318032.60 total 747.45 last 84.69) - open/close 61682 (time 1761318042.60 total 757.45 last 83.40) - open/close 62553 (time 1761318052.62 total 767.46 last 86.98) - open/close 63458 (time 1761318062.63 total 777.48 last 90.34) - open/close 64211 (time 1761318072.64 total 787.49 last 75.23) total: 64768 open/close in 793.47 seconds: 81.63 ops/second - /unlink 1390 (time 1761318091.53 total 10.01 last 138.91) - /unlink 2821 (time 1761318101.53 total 20.01 last 143.07) - /unlink 4463 (time 1761318111.53 total 30.01 last 164.17) - /unlink 5888 (time 1761318121.54 total 40.01 last 142.44) - /unlink 7261 (time 1761318131.54 total 50.02 last 137.25) - /unlink 8857 (time 1761318141.55 total 60.02 last 159.53) - /unlink 10000 (time 1761318148.77 total 67.24 last 158.31) - /unlink 11601 (time 1761318158.77 total 77.25 last 159.97) - /unlink 13128 (time 1761318168.78 total 87.26 last 152.61) - /unlink 14525 (time 1761318178.78 total 97.26 last 139.68) - /unlink 16009 (time 1761318188.78 total 107.26 last 148.35) - /unlink 17662 (time 1761318198.79 total 117.27 last 165.21) - /unlink 19010 (time 1761318208.80 total 127.27 last 134.71) - /unlink 20000 (time 1761318215.62 total 134.10 last 145.02) - /unlink 21483 (time 1761318225.63 total 144.11 last 148.21) - /unlink 23093 (time 1761318235.63 total 154.11 last 161.00) - /unlink 24401 (time 1761318245.63 total 164.11 last 130.78) - /unlink 25794 (time 1761318255.64 total 174.11 last 139.23) - /unlink 27267 (time 1761318265.64 total 184.11 last 147.29) - /unlink 28910 (time 1761318275.64 total 194.11 last 164.29) - /unlink 30000 (time 1761318282.29 total 200.77 last 163.79) - /unlink 31426 (time 1761318292.30 total 210.78 last 142.50) - /unlink 32839 (time 1761318302.31 total 220.78 last 141.19) - /unlink 34326 (time 1761318312.31 total 230.78 last 148.70) - /unlink 35951 (time 1761318322.31 total 240.79 last 162.49) - /unlink 37737 (time 1761318332.31 total 250.79 last 178.54) - /unlink 39517 (time 1761318342.31 total 260.79 last 178.00) - /unlink 40000 (time 1761318345.07 total 263.54 last 175.34) - /unlink 41543 (time 1761318355.07 total 273.54 last 154.29) - /unlink 43311 (time 1761318365.07 total 283.55 last 176.75) - /unlink 44781 (time 1761318375.07 total 293.55 last 146.97) - /unlink 46247 (time 1761318385.07 total 303.55 last 146.58) - /unlink 47746 (time 1761318395.08 total 313.56 last 149.80) - /unlink 49208 (time 1761318405.09 total 323.56 last 146.11) - /unlink 50000 (time 1761318410.35 total 328.83 last 150.34) - /unlink 51305 (time 1761318420.36 total 338.84 last 130.44) - /unlink 52938 (time 1761318430.36 total 348.84 last 163.21) - /unlink 54469 (time 1761318440.37 total 358.85 last 153.01) - /unlink 56042 (time 1761318450.37 total 368.85 last 157.29) - /unlink 57474 (time 1761318460.37 total 378.85 last 143.18) - /unlink 59181 (time 1761318470.38 total 388.85 last 170.63) - /unlink 60000 (time 1761318475.90 total 394.38 last 148.27) - /unlink 61720 (time 1761318485.91 total 404.38 last 171.92) - /unlink 63414 (time 1761318495.91 total 414.39 last 169.26) total: 64768 /unlink in 423.50 seconds: 152.93 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg244-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg244-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg244-server stop mds service on oleg244-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg244-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy unloading modules on: 'oleg244-server' oleg244-server: oleg244-server.virtnet: executing unload_modules_local oleg244-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy oleg244-server: LNET ready to unload oleg244-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy modules unloaded. pdsh@oleg244-client: oleg244-client: ssh exited with exit code 2 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 2 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 2 pdsh@oleg244-client: oleg244-client: ssh exited with exit code 2