-----============= acceptance-small: conf-sanity ============----- Fri Oct 24 09:11:29 EDT 2025 oleg244-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball 110 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg244-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg244-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg244-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg244-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg244-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg244-server oleg244-server: oleg244-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg244-server' oleg244-server: oleg244-server.virtnet: executing load_modules_local oleg244-server: Loading modules from /home/green/git/lustre-release/lustre oleg244-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg244-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg244-server: detected 4 online CPUs by sysfs oleg244-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg244-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg244-server: oleg244-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg244-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg244-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg244-server: oleg244-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg244-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg244-server: oleg244-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 40 oleg244-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg244-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg244-server stop mds service on oleg244-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg244-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 09:13:45 (1761311625) Stopping clients: oleg244-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg244-client.virtnet /mnt/lustre2 (opts:-f) oleg244-server: oleg244-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg244-server' oleg244-server: oleg244-server.virtnet: executing load_modules_local oleg244-server: Loading modules from /home/green/git/lustre-release/lustre oleg244-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg244-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg244-server: detected 4 online CPUs by sysfs oleg244-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg244-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg244-server: oleg244-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg244-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg244-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg244-server: oleg244-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg244-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg244-client.virtnet: -o user_xattr,flock oleg244-server@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 16166 358 15808 3% /mnt/lustre[OST:0] filesystem_summary: 16137 329 15808 3% /mnt/lustre fail_loc=0x1312 fail_val=5 - open/close 760 (time 1761311732.31 total 10.00 last 75.99) - open/close 1489 (time 1761311742.32 total 20.01 last 72.82) - open/close 2171 (time 1761311752.32 total 30.01 last 68.19) - open/close 2903 (time 1761311762.33 total 40.02 last 73.13) - open/close 3709 (time 1761311772.33 total 50.02 last 80.59) - open/close 4442 (time 1761311782.34 total 60.04 last 73.22) - open/close 5209 (time 1761311792.35 total 70.04 last 76.66) - open/close 5951 (time 1761311802.35 total 80.05 last 74.17) - open/close 6817 (time 1761311812.35 total 90.05 last 86.58) - open/close 7529 (time 1761311822.36 total 100.05 last 71.15) - open/close 8179 (time 1761311832.37 total 110.06 last 64.97) - open/close 8804 (time 1761311842.39 total 120.08 last 62.37) - open/close 9416 (time 1761311852.39 total 130.08 last 61.19) - open/close 10000 (time 1761311861.27 total 138.96 last 65.79) - open/close 10653 (time 1761311871.28 total 148.97 last 65.22) - open/close 11303 (time 1761311881.28 total 158.98 last 64.96) - open/close 11920 (time 1761311891.29 total 168.98 last 61.67) - open/close 12642 (time 1761311901.30 total 178.99 last 72.13) - open/close 13360 (time 1761311911.31 total 189.00 last 71.73) - open/close 14064 (time 1761311921.31 total 199.01 last 70.36) - open/close 14744 (time 1761311931.32 total 209.01 last 67.98) - open/close 15442 (time 1761311941.32 total 219.01 last 69.78) - open/close 16124 (time 1761311951.32 total 229.01 last 68.18) - open/close 16841 (time 1761311961.32 total 239.02 last 71.69) - open/close 17518 (time 1761311971.33 total 249.03 last 67.63) - open/close 18153 (time 1761311981.35 total 259.04 last 63.41) - open/close 18780 (time 1761311991.35 total 269.05 last 62.66) - open/close 19464 (time 1761312001.37 total 279.06 last 68.30) - open/close 20000 (time 1761312009.01 total 286.71 last 70.12) - open/close 20722 (time 1761312019.02 total 296.72 last 72.13) - open/close 21491 (time 1761312029.04 total 306.73 last 76.78) - open/close 22182 (time 1761312039.04 total 316.74 last 69.06) - open/close 22928 (time 1761312049.06 total 326.75 last 74.47) - open/close 23660 (time 1761312059.07 total 336.76 last 73.15) - open/close 24302 (time 1761312069.08 total 346.77 last 64.14) - open/close 25056 (time 1761312079.08 total 356.77 last 75.37) - open/close 25746 (time 1761312089.10 total 366.79 last 68.90) - open/close 26534 (time 1761312099.10 total 376.80 last 78.74) - open/close 27288 (time 1761312109.11 total 386.80 last 75.38) - open/close 28011 (time 1761312119.11 total 396.81 last 72.25) - open/close 28860 (time 1761312129.12 total 406.82 last 84.79) - open/close 29618 (time 1761312139.13 total 416.83 last 75.73) - open/close 30000 (time 1761312143.81 total 421.51 last 81.62) - open/close 30742 (time 1761312153.82 total 431.51 last 74.18) - open/close 31479 (time 1761312163.83 total 441.52 last 73.63) - open/close 32176 (time 1761312173.84 total 451.53 last 69.62) - open/close 33035 (time 1761312183.84 total 461.53 last 85.90) - open/close 33798 (time 1761312193.84 total 471.53 last 76.30) - open/close 34515 (time 1761312203.84 total 481.53 last 71.67) - open/close 35304 (time 1761312213.85 total 491.54 last 78.82) - open/close 35972 (time 1761312223.86 total 501.55 last 66.73) - open/close 36722 (time 1761312233.86 total 511.56 last 74.99) - open/close 37508 (time 1761312243.87 total 521.56 last 78.54) - open/close 38195 (time 1761312253.88 total 531.57 last 68.66) - open/close 38826 (time 1761312263.88 total 541.57 last 63.07) - open/close 39556 (time 1761312273.89 total 551.58 last 72.93) - open/close 40000 (time 1761312279.65 total 557.34 last 77.07) - open/close 40835 (time 1761312289.67 total 567.36 last 83.38) - open/close 41557 (time 1761312299.68 total 577.37 last 72.13) - open/close 42279 (time 1761312309.68 total 587.38 last 72.16) - open/close 42948 (time 1761312319.69 total 597.38 last 66.86) - open/close 43561 (time 1761312329.71 total 607.40 last 61.16) - open/close 44200 (time 1761312339.72 total 617.42 last 63.83) - open/close 45020 (time 1761312349.73 total 627.42 last 81.95) - open/close 45803 (time 1761312359.73 total 637.42 last 78.27) - open/close 46626 (time 1761312369.74 total 647.43 last 82.23) - open/close 47344 (time 1761312379.75 total 657.45 last 71.72) - open/close 48025 (time 1761312389.76 total 667.45 last 68.08) - open/close 48748 (time 1761312399.77 total 677.46 last 72.22) - open/close 49484 (time 1761312409.77 total 687.46 last 73.58) - open/close 50000 (time 1761312417.36 total 695.05 last 68.02) - open/close 50722 (time 1761312427.36 total 705.05 last 72.18) - open/close 51612 (time 1761312437.36 total 715.06 last 88.94) - open/close 52333 (time 1761312447.39 total 725.08 last 71.92) - open/close 53064 (time 1761312457.39 total 735.09 last 73.06) - open/close 53807 (time 1761312467.41 total 745.10 last 74.19) - open/close 54546 (time 1761312477.42 total 755.12 last 73.80) - open/close 55324 (time 1761312487.48 total 765.17 last 77.37) - open/close 56084 (time 1761312497.49 total 775.18 last 75.95) - open/close 56878 (time 1761312507.49 total 785.18 last 79.37) - open/close 57702 (time 1761312517.50 total 795.19 last 82.34) - open/close 58481 (time 1761312527.50 total 805.19 last 77.89) - open/close 59301 (time 1761312537.50 total 815.19 last 81.99) - open/close 60000 (time 1761312546.73 total 824.42 last 75.76) - open/close 60744 (time 1761312556.75 total 834.44 last 74.24) - open/close 61510 (time 1761312566.75 total 844.45 last 76.58) - open/close 62223 (time 1761312576.75 total 854.45 last 71.28) - open/close 62896 (time 1761312586.77 total 864.46 last 67.21) - open/close 63620 (time 1761312596.77 total 874.46 last 72.39) - open/close 64310 (time 1761312606.77 total 884.46 last 69.00) total: 64768 open/close in 890.22 seconds: 72.76 ops/second - /unlink 1382 (time 1761312625.89 total 10.00 last 138.19) - /unlink 2813 (time 1761312635.90 total 20.01 last 142.96) - /unlink 4055 (time 1761312645.91 total 30.02 last 124.11) - /unlink 5314 (time 1761312655.92 total 40.02 last 125.84) - /unlink 6696 (time 1761312665.92 total 50.03 last 138.15) - /unlink 8096 (time 1761312675.93 total 60.03 last 139.93) - /unlink 9445 (time 1761312685.94 total 70.04 last 134.73) - /unlink 10000 (time 1761312690.29 total 74.40 last 127.39) - /unlink 11103 (time 1761312700.30 total 84.40 last 110.28) - /unlink 12390 (time 1761312710.30 total 94.41 last 128.63) - /unlink 13880 (time 1761312720.31 total 104.42 last 148.90) - /unlink 15279 (time 1761312730.31 total 114.42 last 139.83) - /unlink 16643 (time 1761312740.31 total 124.42 last 136.39) - /unlink 18016 (time 1761312750.32 total 134.43 last 137.24) - /unlink 19350 (time 1761312760.34 total 144.44 last 133.17) - /unlink 20000 (time 1761312765.47 total 149.58 last 126.53) - /unlink 21536 (time 1761312775.47 total 159.58 last 153.57) - /unlink 23290 (time 1761312785.48 total 169.58 last 175.35) - /unlink 24670 (time 1761312795.48 total 179.59 last 137.94) - /unlink 26108 (time 1761312805.48 total 189.59 last 143.75) - /unlink 27641 (time 1761312815.48 total 199.59 last 153.29) - /unlink 29225 (time 1761312825.49 total 209.59 last 158.38) - /unlink 30000 (time 1761312831.05 total 215.16 last 139.26) - /unlink 31312 (time 1761312841.05 total 225.16 last 131.18) - /unlink 32638 (time 1761312851.06 total 235.16 last 132.54) - /unlink 33955 (time 1761312861.06 total 245.17 last 131.67) - /unlink 35259 (time 1761312871.06 total 255.17 last 130.37) - /unlink 36596 (time 1761312881.07 total 265.18 last 133.56) - /unlink 37820 (time 1761312891.07 total 275.18 last 122.38) - /unlink 39315 (time 1761312901.08 total 285.18 last 149.44) - /unlink 40000 (time 1761312905.75 total 289.86 last 146.48) - /unlink 41663 (time 1761312915.76 total 299.87 last 166.16) - /unlink 43507 (time 1761312925.77 total 309.87 last 184.33) - /unlink 45252 (time 1761312935.77 total 319.88 last 174.44) - /unlink 46808 (time 1761312945.78 total 329.89 last 155.46) - /unlink 48326 (time 1761312955.78 total 339.89 last 151.74) - /unlink 49883 (time 1761312965.79 total 349.89 last 155.63) - /unlink 51343 (time 1761312975.79 total 359.90 last 145.96) - /unlink 52625 (time 1761312985.79 total 369.90 last 128.18) - /unlink 53921 (time 1761312995.79 total 379.90 last 129.57) - /unlink 55081 (time 1761313005.80 total 389.90 last 115.97) - /unlink 56612 (time 1761313015.80 total 399.91 last 153.02) - /unlink 57948 (time 1761313025.80 total 409.91 last 133.58) - /unlink 59789 (time 1761313035.81 total 419.91 last 184.01) - /unlink 61382 (time 1761313045.84 total 429.94 last 158.83) - /unlink 62665 (time 1761313055.84 total 439.94 last 128.29) - /unlink 63984 (time 1761313065.84 total 449.94 last 131.90) total: 64768 /unlink in 454.95 seconds: 142.36 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 970 (time 1761313101.90 total 10.01 last 96.94) - open/close 1893 (time 1761313111.91 total 20.01 last 92.27) - open/close 2719 (time 1761313121.91 total 30.01 last 82.59) - open/close 3526 (time 1761313131.91 total 40.02 last 80.65) - open/close 4298 (time 1761313141.92 total 50.03 last 77.12) - open/close 5074 (time 1761313151.93 total 60.04 last 77.52) - open/close 5908 (time 1761313161.94 total 70.05 last 83.31) - open/close 6768 (time 1761313171.95 total 80.06 last 85.91) - open/close 7481 (time 1761313181.96 total 90.06 last 71.28) - open/close 8185 (time 1761313191.96 total 100.06 last 70.39) - open/close 8934 (time 1761313201.96 total 110.07 last 74.87) - open/close 9715 (time 1761313211.97 total 120.07 last 78.04) - open/close 10000 (time 1761313215.58 total 123.68 last 78.98) - open/close 10832 (time 1761313225.59 total 133.69 last 83.12) - open/close 11645 (time 1761313235.59 total 143.69 last 81.28) - open/close 12443 (time 1761313245.59 total 153.70 last 79.78) - open/close 13242 (time 1761313255.61 total 163.71 last 79.80) - open/close 13927 (time 1761313265.62 total 173.72 last 68.43) - open/close 14657 (time 1761313275.62 total 183.73 last 72.96) - open/close 15371 (time 1761313285.64 total 193.74 last 71.27) - open/close 16187 (time 1761313295.64 total 203.75 last 81.58) - open/close 16946 (time 1761313305.65 total 213.75 last 75.88) - open/close 17673 (time 1761313315.65 total 223.76 last 72.66) - open/close 18489 (time 1761313325.66 total 233.76 last 81.53) - open/close 19310 (time 1761313335.67 total 243.77 last 82.06) - open/close 20000 (time 1761313343.86 total 251.97 last 84.18) - open/close 20831 (time 1761313353.87 total 261.97 last 83.07) - open/close 21614 (time 1761313363.87 total 271.97 last 78.27) - open/close 22397 (time 1761313373.87 total 281.97 last 78.29) - open/close 23161 (time 1761313383.89 total 291.99 last 76.28) - open/close 23946 (time 1761313393.89 total 301.99 last 78.50) - open/close 24738 (time 1761313403.89 total 311.99 last 79.19) - open/close 25539 (time 1761313413.89 total 321.99 last 80.10) - open/close 26316 (time 1761313423.89 total 331.99 last 77.68) - open/close 27171 (time 1761313433.90 total 342.00 last 85.44) - open/close 27973 (time 1761313443.90 total 352.01 last 80.14) - open/close 28704 (time 1761313453.91 total 362.01 last 73.06) - open/close 29494 (time 1761313463.92 total 372.02 last 78.96) - open/close 30000 (time 1761313470.14 total 378.25 last 81.23) - open/close 30851 (time 1761313480.16 total 388.26 last 85.01) - open/close 31705 (time 1761313490.16 total 398.27 last 85.33) - open/close 32479 (time 1761313500.18 total 408.28 last 77.27) - open/close 33285 (time 1761313510.19 total 418.29 last 80.54) - open/close 34069 (time 1761313520.20 total 428.30 last 78.34) - open/close 34767 (time 1761313530.21 total 438.31 last 69.72) - open/close 35533 (time 1761313540.21 total 448.31 last 76.59) - open/close 36322 (time 1761313550.22 total 458.33 last 78.80) - open/close 37155 (time 1761313560.23 total 468.33 last 83.27) - open/close 37967 (time 1761313570.23 total 478.33 last 81.16) - open/close 38808 (time 1761313580.24 total 488.34 last 84.01) - open/close 39644 (time 1761313590.24 total 498.35 last 83.57) - open/close 40000 (time 1761313595.25 total 503.35 last 71.12) - open/close 40764 (time 1761313605.26 total 513.36 last 76.35) - open/close 41521 (time 1761313615.26 total 523.37 last 75.65) - open/close 42244 (time 1761313625.28 total 533.38 last 72.21) - open/close 43044 (time 1761313635.29 total 543.40 last 79.86) - open/close 43764 (time 1761313645.30 total 553.41 last 71.91) - open/close 44415 (time 1761313655.31 total 563.42 last 65.05) - open/close 45179 (time 1761313665.32 total 573.42 last 76.36) - open/close 45946 (time 1761313675.32 total 583.42 last 76.68) - open/close 46701 (time 1761313685.33 total 593.43 last 75.42) - open/close 47477 (time 1761313695.34 total 603.44 last 77.55) - open/close 48328 (time 1761313705.34 total 613.44 last 85.05) - open/close 49309 (time 1761313715.35 total 623.45 last 98.02) - open/close 50000 (time 1761313723.04 total 631.14 last 89.90) - open/close 50849 (time 1761313733.05 total 641.15 last 84.78) - open/close 51585 (time 1761313743.05 total 651.16 last 73.56) - open/close 52373 (time 1761313753.06 total 661.16 last 78.79) - open/close 53158 (time 1761313763.06 total 671.16 last 78.49) - open/close 53949 (time 1761313773.07 total 681.17 last 79.01) - open/close 54667 (time 1761313783.08 total 691.18 last 71.70) - open/close 55343 (time 1761313793.08 total 701.19 last 67.58) - open/close 56054 (time 1761313803.10 total 711.20 last 71.00) - open/close 56780 (time 1761313813.10 total 721.21 last 72.56) - open/close 57503 (time 1761313823.10 total 731.21 last 72.29) - open/close 58273 (time 1761313833.10 total 741.21 last 76.99) - open/close 59032 (time 1761313843.11 total 751.21 last 75.87) - open/close 59808 (time 1761313853.11 total 761.21 last 77.59) - open/close 60000 (time 1761313855.41 total 763.51 last 83.51) - open/close 60712 (time 1761313865.41 total 773.51 last 71.19) - open/close 61382 (time 1761313875.42 total 783.52 last 66.94) - open/close 62011 (time 1761313885.43 total 793.53 last 62.82) - open/close 62738 (time 1761313895.44 total 803.54 last 72.67) - open/close 63498 (time 1761313905.44 total 813.54 last 75.97) - open/close 64263 (time 1761313915.44 total 823.54 last 76.49) total: 64768 open/close in 830.16 seconds: 78.02 ops/second - /unlink 1244 (time 1761313935.57 total 10.01 last 124.33) - /unlink 2467 (time 1761313945.58 total 20.01 last 122.28) - /unlink 3716 (time 1761313955.58 total 30.01 last 124.86) - /unlink 4996 (time 1761313965.58 total 40.01 last 127.99) - /unlink 6162 (time 1761313975.58 total 50.02 last 116.55) - /unlink 7470 (time 1761313985.58 total 60.02 last 130.79) - /unlink 8680 (time 1761313995.59 total 70.02 last 120.91) - /unlink 9945 (time 1761314005.60 total 80.03 last 126.45) - /unlink 11193 (time 1761314015.60 total 90.03 last 124.75) - /unlink 12361 (time 1761314025.60 total 100.04 last 116.77) - /unlink 13606 (time 1761314035.61 total 110.04 last 124.44) - /unlink 14918 (time 1761314045.62 total 120.05 last 131.10) - /unlink 16178 (time 1761314055.62 total 130.05 last 125.98) - /unlink 17431 (time 1761314065.62 total 140.06 last 125.22) - /unlink 18772 (time 1761314075.63 total 150.06 last 134.01) - /unlink 20000 (time 1761314085.45 total 159.88 last 125.08) - /unlink 21108 (time 1761314095.45 total 169.89 last 110.72) - /unlink 22277 (time 1761314105.46 total 179.89 last 116.82) - /unlink 23507 (time 1761314115.47 total 189.90 last 122.94) - /unlink 24759 (time 1761314125.47 total 199.90 last 125.19) - /unlink 25997 (time 1761314135.47 total 209.90 last 123.77) - /unlink 27195 (time 1761314145.47 total 219.90 last 119.78) - /unlink 28296 (time 1761314155.48 total 229.91 last 110.06) - /unlink 29503 (time 1761314165.48 total 239.91 last 120.61) - /unlink 30000 (time 1761314169.03 total 243.46 last 140.29) - /unlink 31241 (time 1761314179.03 total 253.46 last 124.03) - /unlink 32456 (time 1761314189.03 total 263.46 last 121.50) - /unlink 33702 (time 1761314199.04 total 273.47 last 124.53) - /unlink 35147 (time 1761314209.04 total 283.47 last 144.47) - /unlink 36330 (time 1761314219.04 total 293.47 last 118.27) - /unlink 37500 (time 1761314229.05 total 303.48 last 116.94) - /unlink 38666 (time 1761314239.05 total 313.48 last 116.59) - /unlink 39843 (time 1761314249.05 total 323.49 last 117.63) - /unlink 40898 (time 1761314259.06 total 333.50 last 105.40) - /unlink 42054 (time 1761314269.06 total 343.50 last 115.60) - /unlink 43131 (time 1761314279.07 total 353.50 last 107.66) - /unlink 44270 (time 1761314289.07 total 363.51 last 113.83) - /unlink 45436 (time 1761314299.08 total 373.51 last 116.57) - /unlink 46614 (time 1761314309.08 total 383.51 last 117.75) - /unlink 47798 (time 1761314319.08 total 393.51 last 118.40) - /unlink 48989 (time 1761314329.09 total 403.52 last 119.04) - /unlink 50000 (time 1761314337.12 total 411.55 last 125.91) - /unlink 51240 (time 1761314347.12 total 421.55 last 123.98) - /unlink 52482 (time 1761314357.12 total 431.55 last 124.15) - /unlink 53757 (time 1761314367.12 total 441.56 last 127.47) - /unlink 55008 (time 1761314377.13 total 451.56 last 125.04) - /unlink 56224 (time 1761314387.13 total 461.56 last 121.56) - /unlink 57605 (time 1761314397.13 total 471.56 last 138.09) - /unlink 58797 (time 1761314407.14 total 481.57 last 119.09) - /unlink 60000 (time 1761314417.02 total 491.46 last 121.73) - /unlink 61220 (time 1761314427.03 total 501.46 last 121.98) - /unlink 62479 (time 1761314437.03 total 511.46 last 125.84) - /unlink 63782 (time 1761314447.03 total 521.46 last 130.29) total: 64768 /unlink in 529.44 seconds: 122.33 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 777 (time 1761314489.66 total 10.00 last 77.70) - open/close 1567 (time 1761314499.68 total 20.01 last 78.92) - open/close 2384 (time 1761314509.68 total 30.01 last 81.67) - open/close 3123 (time 1761314519.68 total 40.02 last 73.86) - open/close 3784 (time 1761314529.69 total 50.02 last 66.08) - open/close 4471 (time 1761314539.71 total 60.05 last 68.52) - open/close 5205 (time 1761314549.72 total 70.05 last 73.38) - open/close 5957 (time 1761314559.72 total 80.05 last 75.19) - open/close 6509 (time 1761314569.72 total 90.05 last 55.19) - open/close 7158 (time 1761314579.72 total 100.06 last 64.87) - open/close 7897 (time 1761314589.73 total 110.06 last 73.89) - open/close 8704 (time 1761314599.73 total 120.06 last 80.68) - open/close 9583 (time 1761314609.74 total 130.07 last 87.82) - open/close 10000 (time 1761314614.68 total 135.01 last 84.44) - open/close 10827 (time 1761314624.68 total 145.02 last 82.64) - open/close 11595 (time 1761314634.69 total 155.03 last 76.74) - open/close 12357 (time 1761314644.70 total 165.04 last 76.11) - open/close 13131 (time 1761314654.71 total 175.04 last 77.37) - open/close 13895 (time 1761314664.71 total 185.05 last 76.37) - open/close 14634 (time 1761314674.72 total 195.05 last 73.83) - open/close 15403 (time 1761314684.75 total 205.09 last 76.64) - open/close 16161 (time 1761314694.76 total 215.10 last 75.74) - open/close 16906 (time 1761314704.77 total 225.10 last 74.44) - open/close 17676 (time 1761314714.77 total 235.11 last 76.95) - open/close 18411 (time 1761314724.79 total 245.12 last 73.41) - open/close 19156 (time 1761314734.79 total 255.12 last 74.50) - open/close 19992 (time 1761314744.81 total 265.14 last 83.41) - open/close 20821 (time 1761314754.82 total 275.16 last 82.80) - open/close 21620 (time 1761314764.82 total 285.16 last 79.87) - open/close 22376 (time 1761314774.83 total 295.17 last 75.53) - open/close 23161 (time 1761314784.84 total 305.18 last 78.42) - open/close 23940 (time 1761314794.85 total 315.19 last 77.82) - open/close 24678 (time 1761314804.86 total 325.20 last 73.76) - open/close 25422 (time 1761314814.88 total 335.21 last 74.28) - open/close 26189 (time 1761314824.88 total 345.22 last 76.67) - open/close 26949 (time 1761314834.89 total 355.23 last 75.90) - open/close 27696 (time 1761314844.89 total 365.23 last 74.69) - open/close 28470 (time 1761314854.90 total 375.24 last 77.34) - open/close 29286 (time 1761314864.92 total 385.26 last 81.45) - open/close 30000 (time 1761314874.37 total 394.71 last 75.51) - open/close 30779 (time 1761314884.39 total 404.73 last 77.78) - open/close 31503 (time 1761314894.42 total 414.76 last 72.17) - open/close 32218 (time 1761314904.44 total 424.78 last 71.36) - open/close 32995 (time 1761314914.44 total 434.78 last 77.69) - open/close 33746 (time 1761314924.45 total 444.78 last 75.08) - open/close 34518 (time 1761314934.46 total 454.80 last 77.08) - open/close 35288 (time 1761314944.47 total 464.81 last 76.93) - open/close 36029 (time 1761314954.47 total 474.81 last 74.08) - open/close 36791 (time 1761314964.48 total 484.81 last 76.16) - open/close 37580 (time 1761314974.49 total 494.82 last 78.84) - open/close 38344 (time 1761314984.49 total 504.83 last 76.36) - open/close 39121 (time 1761314994.49 total 514.83 last 77.67) - open/close 39874 (time 1761315004.50 total 524.84 last 75.23) - open/close 40652 (time 1761315014.51 total 534.85 last 77.75) - open/close 41369 (time 1761315024.51 total 544.85 last 71.68) - open/close 42104 (time 1761315034.52 total 554.86 last 73.43) - open/close 42728 (time 1761315044.55 total 564.89 last 62.23) - open/close 43411 (time 1761315054.57 total 574.91 last 68.16) - open/close 44112 (time 1761315064.58 total 584.91 last 70.06) - open/close 44866 (time 1761315074.59 total 594.92 last 75.32) - open/close 45635 (time 1761315084.59 total 604.93 last 76.87) - open/close 46399 (time 1761315094.59 total 614.93 last 76.38) - open/close 47114 (time 1761315104.60 total 624.94 last 71.44) - open/close 47787 (time 1761315114.61 total 634.94 last 67.25) - open/close 48538 (time 1761315124.61 total 644.95 last 75.08) - open/close 49270 (time 1761315134.61 total 654.95 last 73.18) - open/close 49988 (time 1761315144.62 total 664.96 last 71.73) - open/close 50750 (time 1761315154.64 total 674.98 last 76.07) - open/close 51485 (time 1761315164.65 total 684.98 last 73.45) - open/close 52204 (time 1761315174.65 total 694.99 last 71.88) - open/close 52933 (time 1761315184.65 total 704.99 last 72.89) - open/close 53683 (time 1761315194.65 total 714.99 last 74.99) - open/close 54380 (time 1761315204.68 total 725.01 last 69.53) - open/close 55054 (time 1761315214.68 total 735.02 last 67.37) - open/close 55748 (time 1761315224.69 total 745.02 last 69.38) - open/close 56380 (time 1761315234.69 total 755.03 last 63.15) - open/close 57100 (time 1761315244.70 total 765.04 last 71.92) - open/close 57823 (time 1761315254.73 total 775.06 last 72.15) - open/close 58591 (time 1761315264.73 total 785.06 last 76.77) - open/close 59267 (time 1761315274.73 total 795.07 last 67.56) - open/close 59825 (time 1761315284.77 total 805.10 last 55.61) - open/close 60000 (time 1761315288.03 total 808.36 last 53.69) - open/close 60630 (time 1761315298.04 total 818.37 last 62.93) - open/close 61293 (time 1761315308.05 total 828.39 last 66.19) - open/close 61992 (time 1761315318.06 total 838.40 last 69.86) - open/close 62616 (time 1761315328.06 total 848.40 last 62.38) - open/close 63242 (time 1761315338.08 total 858.41 last 62.51) - open/close 63987 (time 1761315348.08 total 868.42 last 74.45) - open/close 64633 (time 1761315358.09 total 878.42 last 64.58) total: 64768 open/close in 880.51 seconds: 73.56 ops/second - /unlink 1215 (time 1761315373.61 total 10.01 last 121.37) - /unlink 2431 (time 1761315383.61 total 20.01 last 121.55) - /unlink 3630 (time 1761315393.61 total 30.02 last 119.90) - /unlink 4822 (time 1761315403.61 total 40.02 last 119.20) - /unlink 6068 (time 1761315413.62 total 50.02 last 124.54) - /unlink 7336 (time 1761315423.62 total 60.03 last 126.74) - /unlink 8500 (time 1761315433.63 total 70.03 last 116.34) - /unlink 9723 (time 1761315443.63 total 80.03 last 122.29) - /unlink 10000 (time 1761315445.70 total 82.11 last 133.52) - /unlink 11234 (time 1761315455.70 total 92.11 last 123.36) - /unlink 12399 (time 1761315465.71 total 102.11 last 116.44) - /unlink 13605 (time 1761315475.71 total 112.12 last 120.56) - /unlink 14732 (time 1761315485.72 total 122.13 last 112.60) - /unlink 16025 (time 1761315495.73 total 132.13 last 129.24) - /unlink 17290 (time 1761315505.73 total 142.13 last 126.48) - /unlink 18536 (time 1761315515.73 total 152.13 last 124.57) - /unlink 19755 (time 1761315525.73 total 162.14 last 121.85) - /unlink 20926 (time 1761315535.74 total 172.14 last 117.08) - /unlink 22042 (time 1761315545.74 total 182.14 last 111.56) - /unlink 23199 (time 1761315555.75 total 192.15 last 115.61) - /unlink 24407 (time 1761315565.75 total 202.16 last 120.75) - /unlink 25638 (time 1761315575.77 total 212.17 last 122.91) - /unlink 26698 (time 1761315585.77 total 222.17 last 105.96) - /unlink 27931 (time 1761315595.77 total 232.18 last 123.27) - /unlink 29188 (time 1761315605.78 total 242.18 last 125.66) - /unlink 30000 (time 1761315612.18 total 248.59 last 126.78) - /unlink 31296 (time 1761315622.18 total 258.59 last 129.59) - /unlink 32472 (time 1761315632.19 total 268.60 last 117.49) - /unlink 33611 (time 1761315642.19 total 278.60 last 113.88) - /unlink 34861 (time 1761315652.20 total 288.61 last 124.88) - /unlink 36097 (time 1761315662.21 total 298.61 last 123.56) - /unlink 37398 (time 1761315672.21 total 308.62 last 130.00) - /unlink 38622 (time 1761315682.22 total 318.62 last 122.32) - /unlink 39916 (time 1761315692.23 total 328.63 last 129.33) - /unlink 41202 (time 1761315702.23 total 338.63 last 128.55) - /unlink 42434 (time 1761315712.24 total 348.64 last 123.10) - /unlink 43694 (time 1761315722.24 total 358.64 last 125.99) - /unlink 45005 (time 1761315732.25 total 368.65 last 130.98) - /unlink 46224 (time 1761315742.25 total 378.66 last 121.83) - /unlink 47519 (time 1761315752.26 total 388.66 last 129.44) - /unlink 48848 (time 1761315762.26 total 398.66 last 132.88) - /unlink 50000 (time 1761315771.18 total 407.59 last 129.09) - /unlink 51334 (time 1761315781.19 total 417.60 last 133.26) - /unlink 52490 (time 1761315791.20 total 427.61 last 115.50) - /unlink 53637 (time 1761315801.21 total 437.61 last 114.64) - /unlink 54846 (time 1761315811.21 total 447.61 last 120.88) - /unlink 56038 (time 1761315821.21 total 457.62 last 119.14) - /unlink 57283 (time 1761315831.22 total 467.62 last 124.49) - /unlink 58509 (time 1761315841.22 total 477.63 last 122.49) - /unlink 59761 (time 1761315851.23 total 487.63 last 125.14) - /unlink 61042 (time 1761315861.23 total 497.63 last 128.09) - /unlink 62292 (time 1761315871.25 total 507.65 last 124.75) - /unlink 63545 (time 1761315881.25 total 517.66 last 125.27) - /unlink 64727 (time 1761315891.25 total 527.66 last 118.17) total: 64768 /unlink in 527.98 seconds: 122.67 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 798 (time 1761315923.54 total 10.00 last 79.77) - open/close 1583 (time 1761315933.55 total 20.01 last 78.45) - open/close 2344 (time 1761315943.55 total 30.02 last 76.06) - open/close 3185 (time 1761315953.56 total 40.02 last 84.03) - open/close 3970 (time 1761315963.57 total 50.03 last 78.44) - open/close 4750 (time 1761315973.58 total 60.04 last 77.90) - open/close 5483 (time 1761315983.60 total 70.06 last 73.17) - open/close 6188 (time 1761315993.60 total 80.07 last 70.47) - open/close 6986 (time 1761316003.61 total 90.07 last 79.78) - open/close 7766 (time 1761316013.61 total 100.07 last 77.98) - open/close 8559 (time 1761316023.62 total 110.08 last 79.21) - open/close 9336 (time 1761316033.65 total 120.11 last 77.49) - open/close 10000 (time 1761316042.06 total 128.52 last 78.94) - open/close 10753 (time 1761316052.06 total 138.52 last 75.27) - open/close 11515 (time 1761316062.08 total 148.54 last 76.07) - open/close 12196 (time 1761316072.09 total 158.55 last 68.03) - open/close 12938 (time 1761316082.10 total 168.56 last 74.15) - open/close 13757 (time 1761316092.10 total 178.56 last 81.87) - open/close 14498 (time 1761316102.10 total 188.56 last 74.08) - open/close 15287 (time 1761316112.11 total 198.57 last 78.86) - open/close 16017 (time 1761316122.12 total 208.59 last 72.88) - open/close 16686 (time 1761316132.14 total 218.60 last 66.78) - open/close 17267 (time 1761316142.14 total 228.60 last 58.09) - open/close 17982 (time 1761316152.15 total 238.61 last 71.46) - open/close 18712 (time 1761316162.15 total 248.61 last 72.97) - open/close 19431 (time 1761316172.15 total 258.62 last 71.90) - open/close 20000 (time 1761316180.23 total 266.70 last 70.42) - open/close 20813 (time 1761316190.24 total 276.71 last 81.21) - open/close 21544 (time 1761316200.25 total 286.71 last 73.08) - open/close 22310 (time 1761316210.26 total 296.72 last 76.51) - open/close 23107 (time 1761316220.26 total 306.72 last 79.68) - open/close 23886 (time 1761316230.27 total 316.73 last 77.83) - open/close 24700 (time 1761316240.28 total 326.74 last 81.33) - open/close 25455 (time 1761316250.28 total 336.74 last 75.48) - open/close 26252 (time 1761316260.29 total 346.75 last 79.65) - open/close 26995 (time 1761316270.33 total 356.80 last 73.96) - open/close 27769 (time 1761316280.34 total 366.80 last 77.36) - open/close 28556 (time 1761316290.36 total 376.82 last 78.56) - open/close 29282 (time 1761316300.36 total 386.82 last 72.59) - open/close 30000 (time 1761316309.62 total 396.08 last 77.52) - open/close 30670 (time 1761316319.62 total 406.09 last 66.97) - open/close 31380 (time 1761316329.63 total 416.09 last 70.98) - open/close 32081 (time 1761316339.63 total 426.09 last 70.08) - open/close 32813 (time 1761316349.63 total 436.09 last 73.19) - open/close 33567 (time 1761316359.65 total 446.11 last 75.25) - open/close 34355 (time 1761316369.66 total 456.12 last 78.73) - open/close 35160 (time 1761316379.66 total 466.13 last 80.46) - open/close 35862 (time 1761316389.67 total 476.13 last 70.18) - open/close 36592 (time 1761316399.67 total 486.13 last 72.96) - open/close 37322 (time 1761316409.68 total 496.14 last 72.97) - open/close 38035 (time 1761316419.68 total 506.14 last 71.29) - open/close 38782 (time 1761316429.68 total 516.15 last 74.67) - open/close 39543 (time 1761316439.70 total 526.17 last 75.94) - open/close 40000 (time 1761316446.17 total 532.63 last 70.71) - open/close 40746 (time 1761316456.17 total 542.64 last 74.56) - open/close 41514 (time 1761316466.18 total 552.64 last 76.76) - open/close 42294 (time 1761316476.19 total 562.65 last 77.95) - open/close 43078 (time 1761316486.19 total 572.65 last 78.36) - open/close 43850 (time 1761316496.19 total 582.66 last 77.17) - open/close 44622 (time 1761316506.20 total 592.67 last 77.13) - open/close 45410 (time 1761316516.21 total 602.68 last 78.72) - open/close 46155 (time 1761316526.22 total 612.68 last 74.44) - open/close 46858 (time 1761316536.23 total 622.69 last 70.25) - open/close 47613 (time 1761316546.24 total 632.71 last 75.39) - open/close 48393 (time 1761316556.24 total 642.71 last 77.99) - open/close 49189 (time 1761316566.25 total 652.71 last 79.57) - open/close 50000 (time 1761316575.89 total 662.35 last 84.10) - open/close 50808 (time 1761316585.89 total 672.36 last 80.79) - open/close 51653 (time 1761316595.90 total 682.36 last 84.45) - open/close 52432 (time 1761316605.90 total 692.37 last 77.87) - open/close 53253 (time 1761316615.90 total 702.37 last 82.09) - open/close 54102 (time 1761316625.91 total 712.37 last 84.85) - open/close 54932 (time 1761316635.92 total 722.39 last 82.88) - open/close 55834 (time 1761316645.93 total 732.39 last 90.18) - open/close 56644 (time 1761316655.93 total 742.40 last 80.95) - open/close 57443 (time 1761316665.94 total 752.40 last 79.88) - open/close 58224 (time 1761316675.96 total 762.42 last 77.92) - open/close 59044 (time 1761316685.96 total 772.42 last 81.97) - open/close 59863 (time 1761316695.97 total 782.43 last 81.83) - open/close 60000 (time 1761316698.05 total 784.51 last 65.99) - open/close 60754 (time 1761316708.05 total 794.51 last 75.36) - open/close 61537 (time 1761316718.07 total 804.53 last 78.16) - open/close 62321 (time 1761316728.08 total 814.54 last 78.31) - open/close 62968 (time 1761316738.09 total 824.56 last 64.62) - open/close 63745 (time 1761316748.10 total 834.56 last 77.66) - open/close 64570 (time 1761316758.10 total 844.57 last 82.47) total: 64768 open/close in 846.74 seconds: 76.49 ops/second - /unlink 1374 (time 1761316773.24 total 10.00 last 137.34) - /unlink 2809 (time 1761316783.25 total 20.01 last 143.46) - /unlink 4253 (time 1761316793.25 total 30.01 last 144.37) - /unlink 5672 (time 1761316803.26 total 40.02 last 141.81) - /unlink 6932 (time 1761316813.26 total 50.02 last 125.97) - /unlink 8298 (time 1761316823.27 total 60.03 last 136.50) - /unlink 9570 (time 1761316833.27 total 70.03 last 127.14) - /unlink 10000 (time 1761316836.54 total 73.30 last 131.38) - /unlink 11152 (time 1761316846.54 total 83.30 last 115.20) - /unlink 12363 (time 1761316856.55 total 93.31 last 121.00) - /unlink 13504 (time 1761316866.55 total 103.31 last 114.09) - /unlink 14698 (time 1761316876.55 total 113.31 last 119.37) - /unlink 15955 (time 1761316886.56 total 123.32 last 125.65) - /unlink 17263 (time 1761316896.57 total 133.33 last 130.70) - /unlink 18439 (time 1761316906.58 total 143.34 last 117.46) - /unlink 19624 (time 1761316916.58 total 153.34 last 118.50) - /unlink 20000 (time 1761316919.25 total 156.01 last 140.89) - /unlink 21314 (time 1761316929.25 total 166.01 last 131.36) - /unlink 22667 (time 1761316939.26 total 176.02 last 135.21) - /unlink 24058 (time 1761316949.26 total 186.02 last 139.01) - /unlink 25427 (time 1761316959.27 total 196.02 last 136.87) - /unlink 26656 (time 1761316969.27 total 206.03 last 122.80) - /unlink 27714 (time 1761316979.29 total 216.05 last 105.59) - /unlink 28869 (time 1761316989.31 total 226.07 last 115.32) - /unlink 29888 (time 1761316999.31 total 236.07 last 101.88) - /unlink 31124 (time 1761317009.32 total 246.07 last 123.55) - /unlink 32340 (time 1761317019.33 total 256.09 last 121.40) - /unlink 33553 (time 1761317029.34 total 266.10 last 121.22) - /unlink 34835 (time 1761317039.35 total 276.11 last 128.09) - /unlink 36032 (time 1761317049.36 total 286.12 last 119.51) - /unlink 37246 (time 1761317059.37 total 296.13 last 121.34) - /unlink 38511 (time 1761317069.39 total 306.15 last 126.18) - /unlink 39806 (time 1761317079.40 total 316.16 last 129.42) - /unlink 41117 (time 1761317089.40 total 326.16 last 131.05) - /unlink 42454 (time 1761317099.40 total 336.16 last 133.69) - /unlink 43742 (time 1761317109.41 total 346.17 last 128.78) - /unlink 45082 (time 1761317119.41 total 356.17 last 133.99) - /unlink 46387 (time 1761317129.41 total 366.17 last 130.42) - /unlink 47764 (time 1761317139.42 total 376.18 last 137.62) - /unlink 49184 (time 1761317149.42 total 386.18 last 141.98) - /unlink 50000 (time 1761317154.76 total 391.52 last 152.71) - /unlink 51398 (time 1761317164.77 total 401.53 last 139.76) - /unlink 52684 (time 1761317174.77 total 411.53 last 128.50) - /unlink 53982 (time 1761317184.78 total 421.54 last 129.72) - /unlink 55333 (time 1761317194.79 total 431.55 last 135.02) - /unlink 56573 (time 1761317204.79 total 441.55 last 123.99) - /unlink 57862 (time 1761317214.80 total 451.56 last 128.79) - /unlink 59200 (time 1761317224.80 total 461.56 last 133.70) - /unlink 60000 (time 1761317230.61 total 467.37 last 137.66) - /unlink 61325 (time 1761317240.62 total 477.38 last 132.45) - /unlink 62623 (time 1761317250.62 total 487.38 last 129.73) - /unlink 63990 (time 1761317260.63 total 497.39 last 136.65) total: 64768 /unlink in 503.15 seconds: 128.72 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 839 (time 1761317295.16 total 10.01 last 83.84) - open/close 1723 (time 1761317305.16 total 20.01 last 88.36) - open/close 2654 (time 1761317315.17 total 30.02 last 93.06) - open/close 3495 (time 1761317325.18 total 40.03 last 83.99) - open/close 4382 (time 1761317335.19 total 50.04 last 88.60) - open/close 5122 (time 1761317345.21 total 60.05 last 73.90) - open/close 5761 (time 1761317355.22 total 70.06 last 63.82) - open/close 6545 (time 1761317365.23 total 80.07 last 78.31) - open/close 7307 (time 1761317375.24 total 90.08 last 76.15) - open/close 8092 (time 1761317385.24 total 100.09 last 78.44) - open/close 8917 (time 1761317395.25 total 110.09 last 82.48) - open/close 9751 (time 1761317405.26 total 120.10 last 83.30) - open/close 10000 (time 1761317408.60 total 123.45 last 74.40) - open/close 10728 (time 1761317418.61 total 133.46 last 72.72) - open/close 11488 (time 1761317428.62 total 143.47 last 75.96) - open/close 12222 (time 1761317438.62 total 153.47 last 73.39) - open/close 12969 (time 1761317448.63 total 163.47 last 74.64) - open/close 13764 (time 1761317458.64 total 173.49 last 79.40) - open/close 14550 (time 1761317468.64 total 183.49 last 78.59) - open/close 15490 (time 1761317478.65 total 193.49 last 93.95) - open/close 16379 (time 1761317488.65 total 203.50 last 88.86) - open/close 17266 (time 1761317498.66 total 213.51 last 88.62) - open/close 18102 (time 1761317508.67 total 223.51 last 83.54) - open/close 18888 (time 1761317518.68 total 233.52 last 78.53) - open/close 19651 (time 1761317528.68 total 243.53 last 76.24) - open/close 20000 (time 1761317533.06 total 247.91 last 79.77) - open/close 20756 (time 1761317543.08 total 257.92 last 75.46) - open/close 21532 (time 1761317553.08 total 267.93 last 77.56) - open/close 22331 (time 1761317563.08 total 277.93 last 79.90) - open/close 23091 (time 1761317573.09 total 287.94 last 75.95) - open/close 23923 (time 1761317583.09 total 297.94 last 83.19) - open/close 24695 (time 1761317593.09 total 307.94 last 77.20) - open/close 25453 (time 1761317603.09 total 317.94 last 75.77) - open/close 26198 (time 1761317613.12 total 327.97 last 74.30) - open/close 27030 (time 1761317623.13 total 337.98 last 83.09) - open/close 27794 (time 1761317633.14 total 347.98 last 76.39) - open/close 28456 (time 1761317643.14 total 357.98 last 66.19) - open/close 29179 (time 1761317653.14 total 367.99 last 72.27) - open/close 29912 (time 1761317663.16 total 378.00 last 73.18) - open/close 30654 (time 1761317673.16 total 388.01 last 74.18) - open/close 31423 (time 1761317683.16 total 398.01 last 76.87) - open/close 32222 (time 1761317693.17 total 408.01 last 79.88) - open/close 32990 (time 1761317703.17 total 418.01 last 76.80) - open/close 33757 (time 1761317713.17 total 428.02 last 76.67) - open/close 34535 (time 1761317723.18 total 438.03 last 77.69) - open/close 35306 (time 1761317733.19 total 448.04 last 77.05) - open/close 36095 (time 1761317743.20 total 458.04 last 78.86) - open/close 36846 (time 1761317753.20 total 468.05 last 75.07) - open/close 37631 (time 1761317763.20 total 478.05 last 78.48) - open/close 38438 (time 1761317773.21 total 488.05 last 80.68) - open/close 39263 (time 1761317783.22 total 498.07 last 82.37) - open/close 40000 (time 1761317793.21 total 508.05 last 73.83) - open/close 40762 (time 1761317803.21 total 518.05 last 76.18) - open/close 41519 (time 1761317813.21 total 528.06 last 75.66) - open/close 42336 (time 1761317823.22 total 538.07 last 81.62) - open/close 43093 (time 1761317833.25 total 548.09 last 75.52) - open/close 43905 (time 1761317843.26 total 558.11 last 81.08) - open/close 44716 (time 1761317853.26 total 568.11 last 81.09) - open/close 45560 (time 1761317863.27 total 578.12 last 84.33) - open/close 46383 (time 1761317873.28 total 588.13 last 82.20) - open/close 47216 (time 1761317883.29 total 598.13 last 83.28) - open/close 47999 (time 1761317893.29 total 608.14 last 78.26) - open/close 48838 (time 1761317903.30 total 618.14 last 83.87) - open/close 49674 (time 1761317913.30 total 628.15 last 83.54) - open/close 50000 (time 1761317916.97 total 631.81 last 89.02) - open/close 50876 (time 1761317926.97 total 641.81 last 87.59) - open/close 51934 (time 1761317936.97 total 651.82 last 105.74) - open/close 53062 (time 1761317946.97 total 661.82 last 112.78) - open/close 53980 (time 1761317956.98 total 671.82 last 91.77) - open/close 54812 (time 1761317966.99 total 681.84 last 83.09) - open/close 55838 (time 1761317977.00 total 691.85 last 102.52) - open/close 56731 (time 1761317987.00 total 701.85 last 89.29) - open/close 57657 (time 1761317997.00 total 711.85 last 92.58) - open/close 58566 (time 1761318007.01 total 721.86 last 90.81) - open/close 59511 (time 1761318017.01 total 731.86 last 94.49) - open/close 60000 (time 1761318022.59 total 737.44 last 87.68) - open/close 60848 (time 1761318032.60 total 747.45 last 84.69) - open/close 61682 (time 1761318042.60 total 757.45 last 83.40) - open/close 62553 (time 1761318052.62 total 767.46 last 86.98) - open/close 63458 (time 1761318062.63 total 777.48 last 90.34) - open/close 64211 (time 1761318072.64 total 787.49 last 75.23) total: 64768 open/close in 793.47 seconds: 81.63 ops/second - /unlink 1390 (time 1761318091.53 total 10.01 last 138.91) - /unlink 2821 (time 1761318101.53 total 20.01 last 143.07) - /unlink 4463 (time 1761318111.53 total 30.01 last 164.17) - /unlink 5888 (time 1761318121.54 total 40.01 last 142.44) - /unlink 7261 (time 1761318131.54 total 50.02 last 137.25) - /unlink 8857 (time 1761318141.55 total 60.02 last 159.53) - /unlink 10000 (time 1761318148.77 total 67.24 last 158.31) - /unlink 11601 (time 1761318158.77 total 77.25 last 159.97) - /unlink 13128 (time 1761318168.78 total 87.26 last 152.61) - /unlink 14525 (time 1761318178.78 total 97.26 last 139.68) - /unlink 16009 (time 1761318188.78 total 107.26 last 148.35) - /unlink 17662 (time 1761318198.79 total 117.27 last 165.21) - /unlink 19010 (time 1761318208.80 total 127.27 last 134.71) - /unlink 20000 (time 1761318215.62 total 134.10 last 145.02) - /unlink 21483 (time 1761318225.63 total 144.11 last 148.21) - /unlink 23093 (time 1761318235.63 total 154.11 last 161.00) - /unlink 24401 (time 1761318245.63 total 164.11 last 130.78) - /unlink 25794 (time 1761318255.64 total 174.11 last 139.23) - /unlink 27267 (time 1761318265.64 total 184.11 last 147.29) - /unlink 28910 (time 1761318275.64 total 194.11 last 164.29) - /unlink 30000 (time 1761318282.29 total 200.77 last 163.79) - /unlink 31426 (time 1761318292.30 total 210.78 last 142.50) - /unlink 32839 (time 1761318302.31 total 220.78 last 141.19) - /unlink 34326 (time 1761318312.31 total 230.78 last 148.70) - /unlink 35951 (time 1761318322.31 total 240.79 last 162.49) - /unlink 37737 (time 1761318332.31 total 250.79 last 178.54) - /unlink 39517 (time 1761318342.31 total 260.79 last 178.00) - /unlink 40000 (time 1761318345.07 total 263.54 last 175.34) - /unlink 41543 (time 1761318355.07 total 273.54 last 154.29) - /unlink 43311 (time 1761318365.07 total 283.55 last 176.75) - /unlink 44781 (time 1761318375.07 total 293.55 last 146.97) - /unlink 46247 (time 1761318385.07 total 303.55 last 146.58) - /unlink 47746 (time 1761318395.08 total 313.56 last 149.80) - /unlink 49208 (time 1761318405.09 total 323.56 last 146.11) - /unlink 50000 (time 1761318410.35 total 328.83 last 150.34) - /unlink 51305 (time 1761318420.36 total 338.84 last 130.44) - /unlink 52938 (time 1761318430.36 total 348.84 last 163.21) - /unlink 54469 (time 1761318440.37 total 358.85 last 153.01) - /unlink 56042 (time 1761318450.37 total 368.85 last 157.29) - /unlink 57474 (time 1761318460.37 total 378.85 last 143.18) - /unlink 59181 (time 1761318470.38 total 388.85 last 170.63) - /unlink 60000 (time 1761318475.90 total 394.38 last 148.27) - /unlink 61720 (time 1761318485.91 total 404.38 last 171.92) - /unlink 63414 (time 1761318495.91 total 414.39 last 169.26) total: 64768 /unlink in 423.50 seconds: 152.93 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg244-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg244-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg244-server stop mds service on oleg244-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg244-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy unloading modules on: 'oleg244-server' oleg244-server: oleg244-server.virtnet: executing unload_modules_local oleg244-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy oleg244-server: LNET ready to unload oleg244-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy modules unloaded. pdsh@oleg244-client: oleg244-client: ssh exited with exit code 2 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 2 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 2 pdsh@oleg244-client: oleg244-client: ssh exited with exit code 2 PASS 106 (6929s) Stopping clients: oleg244-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg244-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg244-client: oleg244-server: ssh exited with exit code 2 oleg244-server: oleg244-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg244-server' oleg244-server: oleg244-server.virtnet: executing load_modules_local oleg244-server: Loading modules from /home/green/git/lustre-release/lustre oleg244-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg244-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg244-server: detected 4 online CPUs by sysfs oleg244-server: Force libcfs to create 2 CPU partitions oleg244-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg244-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 7108 sec ========== 11:09:58 (1761318598)