== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 01:41:13 (1761284473) Stopping clients: oleg244-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg244-client.virtnet /mnt/lustre2 (opts:-f) oleg244-server: oleg244-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg244-server' oleg244-server: oleg244-server.virtnet: executing load_modules_local oleg244-server: Loading modules from /home/green/git/lustre-release/lustre oleg244-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg244-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg244-server: detected 4 online CPUs by sysfs oleg244-server: MODOPTS_LIBCFS= oleg244-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg244-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg244-server: oleg244-server.virtnet: executing set_default_debug -1 all pdsh@oleg244-client: oleg244-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg244-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg244-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg244-server: oleg244-server.virtnet: executing set_default_debug -1 all pdsh@oleg244-client: oleg244-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg244-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg244-client.virtnet: -o user_xattr,flock 192.168.202.144@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86890 331 86559 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 32582 326 32256 2% /mnt/lustre[OST:0] filesystem_summary: 32587 331 32256 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 3138 (time 1761284517.59 total 10.00 last 313.70) - open/close 4114 (time 1761284527.60 total 20.01 last 97.54) - open/close 5065 (time 1761284537.60 total 30.02 last 95.03) - open/close 6143 (time 1761284547.61 total 40.02 last 107.72) - open/close 7050 (time 1761284557.62 total 50.03 last 90.66) - open/close 7782 (time 1761284567.62 total 60.03 last 73.19) - open/close 8463 (time 1761284577.62 total 70.03 last 68.09) - open/close 9242 (time 1761284587.62 total 80.03 last 77.88) - open/close 10000 (time 1761284595.63 total 88.04 last 94.67) - open/close 11032 (time 1761284605.63 total 98.04 last 103.15) - open/close 12088 (time 1761284615.64 total 108.05 last 105.54) - open/close 13178 (time 1761284625.64 total 118.05 last 108.98) - open/close 14334 (time 1761284635.65 total 128.06 last 115.48) - open/close 15351 (time 1761284645.65 total 138.07 last 101.66) - open/close 16324 (time 1761284655.66 total 148.07 last 97.24) - open/close 17242 (time 1761284665.67 total 158.08 last 91.75) - open/close 18282 (time 1761284675.67 total 168.08 last 103.94) - open/close 19261 (time 1761284685.67 total 178.09 last 97.89) - open/close 20000 (time 1761284692.71 total 185.12 last 105.08) - open/close 21078 (time 1761284702.71 total 195.12 last 107.77) - open/close 22118 (time 1761284712.71 total 205.12 last 103.99) - open/close 22957 (time 1761284722.71 total 215.12 last 83.88) - open/close 23808 (time 1761284732.72 total 225.13 last 85.07) - open/close 24410 (time 1761284742.74 total 235.15 last 60.04) - open/close 24905 (time 1761284752.75 total 245.16 last 49.45) - open/close 25287 (time 1761284762.76 total 255.17 last 38.16) - open/close 25672 (time 1761284772.77 total 265.18 last 38.47) - open/close 26057 (time 1761284782.80 total 275.21 last 38.37) - open/close 26600 (time 1761284792.90 total 285.31 last 53.80) - open/close 27269 (time 1761284802.90 total 295.31 last 66.86) - open/close 28076 (time 1761284812.91 total 305.32 last 80.63) - open/close 28818 (time 1761284822.92 total 315.33 last 74.15) - open/close 29482 (time 1761284832.93 total 325.34 last 66.35) - open/close 30000 (time 1761284840.95 total 333.36 last 64.58) - open/close 30693 (time 1761284850.95 total 343.36 last 69.29) - open/close 31421 (time 1761284860.95 total 353.36 last 72.79) - open/close 32146 (time 1761284870.96 total 363.37 last 72.42) - open/close 32837 (time 1761284880.97 total 373.38 last 69.02) - open/close 33584 (time 1761284890.97 total 383.39 last 74.70) - open/close 34277 (time 1761284900.98 total 393.39 last 69.26) - open/close 34946 (time 1761284911.00 total 403.42 last 66.72) - open/close 35630 (time 1761284921.02 total 413.43 last 68.29) - open/close 36350 (time 1761284931.04 total 423.45 last 71.87) - open/close 37052 (time 1761284941.05 total 433.46 last 70.13) - open/close 37786 (time 1761284951.07 total 443.48 last 73.29) - open/close 38499 (time 1761284961.07 total 453.49 last 71.25) - open/close 39219 (time 1761284971.08 total 463.49 last 71.95) - open/close 39885 (time 1761284981.11 total 473.52 last 66.42) - open/close 40523 (time 1761284991.12 total 483.53 last 63.72) - open/close 41164 (time 1761285001.14 total 493.55 last 64.01) - open/close 41843 (time 1761285011.15 total 503.56 last 67.81) - open/close 42525 (time 1761285021.15 total 513.56 last 68.19) - open/close 43105 (time 1761285031.15 total 523.57 last 57.98) - open/close 43789 (time 1761285041.17 total 533.58 last 68.33) - open/close 44397 (time 1761285051.18 total 543.59 last 60.73) - open/close 45065 (time 1761285061.20 total 553.62 last 66.62) - open/close 45694 (time 1761285071.22 total 563.63 last 62.83) - open/close 46278 (time 1761285081.25 total 573.66 last 58.22) - open/close 46926 (time 1761285091.25 total 583.66 last 64.77) - open/close 47665 (time 1761285101.26 total 593.67 last 73.84) - open/close 48390 (time 1761285111.26 total 603.68 last 72.47) - open/close 49131 (time 1761285121.27 total 613.68 last 74.07) - open/close 49861 (time 1761285131.27 total 623.68 last 72.97) - open/close 50546 (time 1761285141.27 total 633.68 last 68.49) - open/close 51096 (time 1761285151.31 total 643.72 last 54.80) - open/close 51680 (time 1761285161.32 total 653.73 last 58.36) - open/close 52405 (time 1761285171.32 total 663.73 last 72.46) - open/close 53131 (time 1761285181.34 total 673.75 last 72.50) - open/close 53831 (time 1761285191.34 total 683.75 last 69.96) - open/close 54509 (time 1761285201.35 total 693.76 last 67.73) - open/close 55147 (time 1761285211.38 total 703.79 last 63.64) - open/close 55799 (time 1761285221.38 total 713.79 last 65.18) - open/close 56530 (time 1761285231.39 total 723.80 last 73.04) - open/close 57279 (time 1761285241.39 total 733.81 last 74.86) - open/close 58031 (time 1761285251.40 total 743.81 last 75.18) - open/close 58746 (time 1761285261.41 total 753.82 last 71.39) - open/close 59468 (time 1761285271.44 total 763.85 last 71.97) - open/close 60000 (time 1761285279.22 total 771.64 last 68.38) - open/close 60742 (time 1761285289.23 total 781.64 last 74.16) - open/close 61484 (time 1761285299.24 total 791.65 last 74.15) - open/close 62245 (time 1761285309.24 total 801.65 last 76.09) - open/close 62969 (time 1761285319.24 total 811.65 last 72.38) - open/close 63659 (time 1761285329.25 total 821.66 last 68.91) - open/close 64367 (time 1761285339.26 total 831.67 last 70.74) total: 64768 open/close in 837.22 seconds: 77.36 ops/second - /unlink 703 (time 1761285359.61 total 10.01 last 70.24) - /unlink 1436 (time 1761285369.61 total 20.01 last 73.27) - /unlink 2191 (time 1761285379.62 total 30.02 last 75.47) - /unlink 2910 (time 1761285389.63 total 40.03 last 71.84) - /unlink 3605 (time 1761285399.63 total 50.03 last 69.47) - /unlink 4326 (time 1761285409.63 total 60.03 last 72.09) - /unlink 5025 (time 1761285419.66 total 70.06 last 69.70) - /unlink 5719 (time 1761285429.68 total 80.08 last 69.28) - /unlink 6417 (time 1761285439.69 total 90.08 last 69.76) - /unlink 7156 (time 1761285449.69 total 100.09 last 73.85) - /unlink 7846 (time 1761285459.70 total 110.10 last 68.95) - /unlink 8555 (time 1761285469.70 total 120.10 last 70.87) - /unlink 9286 (time 1761285479.72 total 130.11 last 73.01) - /unlink 10000 (time 1761285488.92 total 139.32 last 77.54) - /unlink 10709 (time 1761285498.92 total 149.32 last 70.89) - /unlink 11447 (time 1761285508.93 total 159.32 last 73.78) - /unlink 12226 (time 1761285518.94 total 169.33 last 77.84) - /unlink 12951 (time 1761285528.95 total 179.34 last 72.43) - /unlink 13737 (time 1761285538.95 total 189.35 last 78.56) - /unlink 14465 (time 1761285548.99 total 199.39 last 72.51) - /unlink 15198 (time 1761285558.99 total 209.39 last 73.28) - /unlink 15957 (time 1761285568.99 total 219.39 last 75.90) - /unlink 16668 (time 1761285579.02 total 229.42 last 70.89) - /unlink 17409 (time 1761285589.03 total 239.43 last 74.01) - /unlink 18139 (time 1761285599.04 total 249.43 last 72.98) - /unlink 18792 (time 1761285609.04 total 259.44 last 65.26) - /unlink 19472 (time 1761285619.05 total 269.45 last 67.95) - /unlink 20000 (time 1761285626.61 total 277.01 last 69.82) - /unlink 20749 (time 1761285636.62 total 287.02 last 74.86) - /unlink 21481 (time 1761285646.63 total 297.02 last 73.15) - /unlink 22226 (time 1761285656.63 total 307.03 last 74.49) - /unlink 22960 (time 1761285666.63 total 317.03 last 73.39) - /unlink 23619 (time 1761285676.67 total 327.07 last 65.62) - /unlink 24271 (time 1761285686.67 total 337.07 last 65.19) - /unlink 24933 (time 1761285696.69 total 347.09 last 66.09) - /unlink 25545 (time 1761285706.72 total 357.12 last 61.01) - /unlink 26197 (time 1761285716.72 total 367.12 last 65.19) - /unlink 26878 (time 1761285726.75 total 377.15 last 67.90) - /unlink 27573 (time 1761285736.76 total 387.15 last 69.48) - /unlink 28305 (time 1761285746.76 total 397.16 last 73.15) - /unlink 28996 (time 1761285756.77 total 407.17 last 69.05) - /unlink 29674 (time 1761285766.78 total 417.18 last 67.74) - /unlink 30000 (time 1761285771.28 total 421.68 last 72.39) - /unlink 30756 (time 1761285781.29 total 431.69 last 75.54) - /unlink 31502 (time 1761285791.30 total 441.70 last 74.50) - /unlink 32262 (time 1761285801.31 total 451.70 last 75.98) - /unlink 32982 (time 1761285811.32 total 461.71 last 71.93) - /unlink 33700 (time 1761285821.32 total 471.72 last 71.74) - /unlink 34430 (time 1761285831.34 total 481.74 last 72.90) - /unlink 35137 (time 1761285841.35 total 491.74 last 70.65) - /unlink 35838 (time 1761285851.35 total 501.75 last 70.06) - /unlink 36513 (time 1761285861.36 total 511.76 last 67.45) - /unlink 37127 (time 1761285871.37 total 521.77 last 61.32) - /unlink 37819 (time 1761285881.38 total 531.77 last 69.17) - /unlink 38556 (time 1761285891.39 total 541.79 last 73.59) - /unlink 39278 (time 1761285901.40 total 551.80 last 72.10) - /unlink 40000 (time 1761285910.76 total 561.15 last 77.21) - /unlink 40784 (time 1761285920.77 total 571.16 last 78.32) - /unlink 41565 (time 1761285930.78 total 581.18 last 77.99) - /unlink 42272 (time 1761285940.79 total 591.19 last 70.60) - /unlink 42953 (time 1761285950.81 total 601.21 last 67.97) - /unlink 43688 (time 1761285960.82 total 611.22 last 73.46) - /unlink 44500 (time 1761285970.83 total 621.22 last 81.14) - /unlink 45235 (time 1761285980.83 total 631.23 last 73.45) - /unlink 45971 (time 1761285990.86 total 641.25 last 73.43) - /unlink 46696 (time 1761286000.87 total 651.27 last 72.38) - /unlink 47343 (time 1761286010.87 total 661.27 last 64.70) - /unlink 47930 (time 1761286020.87 total 671.27 last 58.69) - /unlink 48566 (time 1761286030.88 total 681.28 last 63.58) - /unlink 49209 (time 1761286040.88 total 691.28 last 64.29) - /unlink 49866 (time 1761286050.89 total 701.29 last 65.61) - /unlink 50000 (time 1761286053.00 total 703.40 last 63.53) - /unlink 50671 (time 1761286063.01 total 713.40 last 67.08) - /unlink 51428 (time 1761286073.01 total 723.41 last 75.67) - /unlink 52175 (time 1761286083.01 total 733.41 last 74.69) - /unlink 52941 (time 1761286093.02 total 743.42 last 76.51) - /unlink 53662 (time 1761286103.04 total 753.44 last 71.99) - /unlink 54382 (time 1761286113.05 total 763.45 last 71.92) - /unlink 55143 (time 1761286123.05 total 773.45 last 76.07) - /unlink 55903 (time 1761286133.05 total 783.45 last 76.00) - /unlink 56673 (time 1761286143.07 total 793.47 last 76.89) - /unlink 57403 (time 1761286153.08 total 803.48 last 72.89) - /unlink 58140 (time 1761286163.09 total 813.49 last 73.63) - /unlink 58958 (time 1761286173.10 total 823.50 last 81.76) - /unlink 59765 (time 1761286183.10 total 833.50 last 80.70) - /unlink 60000 (time 1761286185.89 total 836.28 last 84.29) - /unlink 60867 (time 1761286195.91 total 846.31 last 86.45) - /unlink 61646 (time 1761286205.92 total 856.32 last 77.86) - /unlink 62501 (time 1761286215.93 total 866.33 last 85.38) - /unlink 63323 (time 1761286225.94 total 876.34 last 82.17) - /unlink 64073 (time 1761286235.95 total 886.35 last 74.89) total: 64768 /unlink in 895.31 seconds: 72.34 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 732 (time 1761286278.61 total 10.01 last 73.15) - open/close 1530 (time 1761286288.61 total 20.01 last 79.76) - open/close 2352 (time 1761286298.62 total 30.02 last 82.17) - open/close 3240 (time 1761286308.62 total 40.02 last 88.78) - open/close 4081 (time 1761286318.62 total 50.02 last 84.08) - open/close 4893 (time 1761286328.63 total 60.03 last 81.11) - open/close 5725 (time 1761286338.63 total 70.03 last 83.20) - open/close 6560 (time 1761286348.65 total 80.04 last 83.41) - open/close 7325 (time 1761286358.67 total 90.07 last 76.29) - open/close 8092 (time 1761286368.68 total 100.07 last 76.67) - open/close 8910 (time 1761286378.69 total 110.09 last 81.69) - open/close 9642 (time 1761286388.70 total 120.09 last 73.14) - open/close 10000 (time 1761286392.96 total 124.36 last 83.99) - open/close 10867 (time 1761286402.97 total 134.37 last 86.62) - open/close 11696 (time 1761286412.98 total 144.37 last 82.83) - open/close 12543 (time 1761286422.98 total 154.38 last 84.68) - open/close 13394 (time 1761286432.99 total 164.38 last 85.03) - open/close 14244 (time 1761286443.00 total 174.40 last 84.88) - open/close 15087 (time 1761286453.00 total 184.40 last 84.30) - open/close 15856 (time 1761286463.02 total 194.41 last 76.79) - open/close 16680 (time 1761286473.03 total 204.43 last 82.28) - open/close 17452 (time 1761286483.04 total 214.44 last 77.13) - open/close 18279 (time 1761286493.04 total 224.44 last 82.65) - open/close 19126 (time 1761286503.05 total 234.45 last 84.64) - open/close 19971 (time 1761286513.06 total 244.46 last 84.42) - open/close 20791 (time 1761286523.06 total 254.46 last 81.98) - open/close 21627 (time 1761286533.06 total 264.46 last 83.59) - open/close 22437 (time 1761286543.07 total 274.47 last 80.91) - open/close 23250 (time 1761286553.08 total 284.47 last 81.28) - open/close 24103 (time 1761286563.08 total 294.47 last 85.29) - open/close 24897 (time 1761286573.09 total 304.48 last 79.33) - open/close 25693 (time 1761286583.09 total 314.49 last 79.57) - open/close 26523 (time 1761286593.10 total 324.49 last 82.94) - open/close 27380 (time 1761286603.10 total 334.50 last 85.65) - open/close 28210 (time 1761286613.11 total 344.51 last 82.92) - open/close 29057 (time 1761286623.12 total 354.52 last 84.61) - open/close 29870 (time 1761286633.13 total 364.52 last 81.28) - open/close 30751 (time 1761286643.14 total 374.54 last 87.98) - open/close 31616 (time 1761286653.15 total 384.55 last 86.41) - open/close 32469 (time 1761286663.17 total 394.56 last 85.15) - open/close 33297 (time 1761286673.18 total 404.57 last 82.73) - open/close 34069 (time 1761286683.18 total 414.58 last 77.13) - open/close 34874 (time 1761286693.19 total 424.59 last 80.46) - open/close 35655 (time 1761286703.19 total 434.59 last 78.08) - open/close 36456 (time 1761286713.21 total 444.61 last 79.94) - open/close 37280 (time 1761286723.22 total 454.61 last 82.36) - open/close 38030 (time 1761286733.22 total 464.62 last 74.97) - open/close 38831 (time 1761286743.23 total 474.62 last 80.04) - open/close 39662 (time 1761286753.23 total 484.63 last 83.07) - open/close 40000 (time 1761286757.39 total 488.79 last 81.22) - open/close 40807 (time 1761286767.41 total 498.81 last 80.56) - open/close 41622 (time 1761286777.42 total 508.82 last 81.41) - open/close 42427 (time 1761286787.42 total 518.82 last 80.50) - open/close 43227 (time 1761286797.43 total 528.83 last 79.93) - open/close 44073 (time 1761286807.43 total 538.83 last 84.58) - open/close 44888 (time 1761286817.45 total 548.84 last 81.39) - open/close 45684 (time 1761286827.46 total 558.85 last 79.53) - open/close 46410 (time 1761286837.46 total 568.86 last 72.54) - open/close 47210 (time 1761286847.47 total 578.87 last 79.97) - open/close 47982 (time 1761286857.47 total 588.87 last 77.16) - open/close 48810 (time 1761286867.48 total 598.88 last 82.76) - open/close 49554 (time 1761286877.49 total 608.88 last 74.35) - open/close 50000 (time 1761286882.98 total 614.38 last 81.10) - open/close 50804 (time 1761286893.00 total 624.39 last 80.32) - open/close 51642 (time 1761286903.00 total 634.39 last 83.78) - open/close 52395 (time 1761286913.01 total 644.41 last 75.20) - open/close 53210 (time 1761286923.02 total 654.42 last 81.43) - open/close 54008 (time 1761286933.03 total 664.43 last 79.70) - open/close 54827 (time 1761286943.04 total 674.43 last 81.85) - open/close 55613 (time 1761286953.04 total 684.44 last 78.55) - open/close 56390 (time 1761286963.04 total 694.44 last 77.70) - open/close 57183 (time 1761286973.05 total 704.44 last 79.29) - open/close 57962 (time 1761286983.05 total 714.45 last 77.84) - open/close 58746 (time 1761286993.06 total 724.46 last 78.35) - open/close 59488 (time 1761287003.07 total 734.46 last 74.15) - open/close 60000 (time 1761287009.59 total 740.99 last 78.46) - open/close 60737 (time 1761287019.59 total 750.99 last 73.70) - open/close 61375 (time 1761287029.60 total 760.99 last 63.77) - open/close 62120 (time 1761287039.60 total 771.00 last 74.46) - open/close 62922 (time 1761287049.60 total 781.00 last 80.19) - open/close 63704 (time 1761287059.61 total 791.00 last 78.18) - open/close 64492 (time 1761287069.62 total 801.01 last 78.72) total: 64768 open/close in 804.04 seconds: 80.55 ops/second - /unlink 929 (time 1761287085.13 total 10.01 last 92.84) - /unlink 1805 (time 1761287095.13 total 20.01 last 87.60) - /unlink 2636 (time 1761287105.13 total 30.01 last 83.04) - /unlink 3396 (time 1761287115.14 total 40.02 last 75.96) - /unlink 4142 (time 1761287125.14 total 50.02 last 74.58) - /unlink 5000 (time 1761287135.15 total 60.03 last 85.73) - /unlink 5906 (time 1761287145.15 total 70.03 last 90.56) - /unlink 6724 (time 1761287155.15 total 80.03 last 81.80) - /unlink 7559 (time 1761287165.16 total 90.04 last 83.45) - /unlink 8339 (time 1761287175.16 total 100.04 last 77.97) - /unlink 9181 (time 1761287185.16 total 110.04 last 84.20) - /unlink 9951 (time 1761287195.17 total 120.05 last 76.94) - /unlink 10710 (time 1761287205.17 total 130.05 last 75.88) - /unlink 11502 (time 1761287215.18 total 140.06 last 79.18) - /unlink 12227 (time 1761287225.19 total 150.07 last 72.41) - /unlink 12965 (time 1761287235.20 total 160.08 last 73.75) - /unlink 13692 (time 1761287245.21 total 170.09 last 72.63) - /unlink 14455 (time 1761287255.21 total 180.09 last 76.29) - /unlink 15234 (time 1761287265.21 total 190.09 last 77.87) - /unlink 15980 (time 1761287275.21 total 200.10 last 74.57) - /unlink 16682 (time 1761287285.22 total 210.10 last 70.15) - /unlink 17436 (time 1761287295.23 total 220.11 last 75.36) - /unlink 18159 (time 1761287305.24 total 230.12 last 72.22) - /unlink 18941 (time 1761287315.25 total 240.13 last 78.13) - /unlink 19665 (time 1761287325.25 total 250.13 last 72.37) - /unlink 20000 (time 1761287329.44 total 254.32 last 80.05) - /unlink 20772 (time 1761287339.45 total 264.33 last 77.06) - /unlink 21580 (time 1761287349.46 total 274.34 last 80.76) - /unlink 22414 (time 1761287359.49 total 284.37 last 83.17) - /unlink 23191 (time 1761287369.50 total 294.38 last 77.62) - /unlink 23956 (time 1761287379.50 total 304.38 last 76.49) - /unlink 24727 (time 1761287389.51 total 314.39 last 77.00) - /unlink 25467 (time 1761287399.51 total 324.39 last 73.99) - /unlink 26269 (time 1761287409.53 total 334.41 last 80.09) - /unlink 27048 (time 1761287419.53 total 344.41 last 77.85) - /unlink 27815 (time 1761287429.54 total 354.42 last 76.61) - /unlink 28538 (time 1761287439.55 total 364.43 last 72.24) - /unlink 29314 (time 1761287449.56 total 374.44 last 77.55) - /unlink 30000 (time 1761287458.27 total 383.15 last 78.71) - /unlink 30797 (time 1761287468.28 total 393.16 last 79.64) - /unlink 31605 (time 1761287478.29 total 403.17 last 80.71) - /unlink 32431 (time 1761287488.30 total 413.18 last 82.51) - /unlink 33254 (time 1761287498.31 total 423.19 last 82.21) - /unlink 34108 (time 1761287508.32 total 433.20 last 85.38) - /unlink 34940 (time 1761287518.32 total 443.20 last 83.15) - /unlink 35766 (time 1761287528.33 total 453.21 last 82.54) - /unlink 36525 (time 1761287538.33 total 463.21 last 75.89) - /unlink 37303 (time 1761287548.33 total 473.21 last 77.80) - /unlink 38092 (time 1761287558.33 total 483.21 last 78.89) - /unlink 38924 (time 1761287568.34 total 493.22 last 83.10) - /unlink 39729 (time 1761287578.36 total 503.24 last 80.39) - /unlink 40000 (time 1761287581.90 total 506.78 last 76.42) - /unlink 40821 (time 1761287591.91 total 516.79 last 82.04) - /unlink 41639 (time 1761287601.92 total 526.80 last 81.73) - /unlink 42481 (time 1761287611.92 total 536.80 last 84.16) - /unlink 43256 (time 1761287621.93 total 546.81 last 77.42) - /unlink 44005 (time 1761287631.94 total 556.82 last 74.87) - /unlink 44731 (time 1761287641.94 total 566.82 last 72.56) - /unlink 45494 (time 1761287651.94 total 576.82 last 76.28) - /unlink 46310 (time 1761287661.95 total 586.83 last 81.56) - /unlink 47108 (time 1761287671.95 total 596.83 last 79.77) - /unlink 47912 (time 1761287681.95 total 606.83 last 80.39) - /unlink 48599 (time 1761287691.97 total 616.85 last 68.60) - /unlink 49184 (time 1761287701.98 total 626.86 last 58.45) - /unlink 49976 (time 1761287711.99 total 636.87 last 79.14) - /unlink 50709 (time 1761287721.99 total 646.87 last 73.29) - /unlink 51479 (time 1761287731.99 total 656.87 last 76.97) - /unlink 52226 (time 1761287742.00 total 666.88 last 74.64) - /unlink 52932 (time 1761287752.00 total 676.88 last 70.59) - /unlink 53715 (time 1761287762.02 total 686.90 last 78.13) - /unlink 54483 (time 1761287772.03 total 696.91 last 76.72) - /unlink 55246 (time 1761287782.04 total 706.92 last 76.26) - /unlink 56087 (time 1761287792.04 total 716.92 last 84.07) - /unlink 56764 (time 1761287802.05 total 726.93 last 67.64) - /unlink 57607 (time 1761287812.07 total 736.95 last 84.13) - /unlink 58387 (time 1761287822.08 total 746.96 last 77.93) - /unlink 59233 (time 1761287832.08 total 756.97 last 84.56) - /unlink 60000 (time 1761287841.68 total 766.56 last 79.92) - /unlink 60633 (time 1761287851.69 total 776.57 last 63.27) - /unlink 61245 (time 1761287861.70 total 786.58 last 61.13) - /unlink 61721 (time 1761287871.70 total 796.58 last 47.58) - /unlink 62419 (time 1761287881.71 total 806.59 last 69.73) - /unlink 63216 (time 1761287891.72 total 816.61 last 79.62) - /unlink 63963 (time 1761287901.73 total 826.61 last 74.67) - /unlink 64690 (time 1761287911.73 total 836.61 last 72.70) total: 64768 /unlink in 837.85 seconds: 77.30 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 650 (time 1761287949.60 total 10.00 last 65.00) - open/close 1416 (time 1761287959.60 total 20.00 last 76.60) - open/close 2211 (time 1761287969.60 total 30.00 last 79.47) - open/close 3000 (time 1761287979.61 total 40.01 last 78.83) - open/close 3821 (time 1761287989.62 total 50.02 last 82.03) - open/close 4585 (time 1761287999.62 total 60.02 last 76.37) - open/close 5413 (time 1761288009.63 total 70.03 last 82.75) - open/close 6246 (time 1761288019.64 total 80.04 last 83.24) - open/close 7041 (time 1761288029.65 total 90.05 last 79.40) - open/close 7797 (time 1761288039.65 total 100.05 last 75.58) - open/close 8600 (time 1761288049.65 total 110.06 last 80.27) - open/close 9428 (time 1761288059.66 total 120.06 last 82.77) - open/close 10000 (time 1761288066.66 total 127.07 last 81.67) - open/close 10793 (time 1761288076.67 total 137.08 last 79.20) - open/close 11563 (time 1761288086.68 total 147.08 last 76.96) - open/close 12341 (time 1761288096.68 total 157.08 last 77.80) - open/close 13131 (time 1761288106.69 total 167.09 last 78.92) - open/close 13936 (time 1761288116.70 total 177.10 last 80.41) - open/close 14785 (time 1761288126.72 total 187.13 last 84.71) - open/close 15607 (time 1761288136.73 total 197.13 last 82.18) - open/close 16387 (time 1761288146.73 total 207.13 last 77.98) - open/close 17224 (time 1761288156.74 total 217.14 last 83.64) - open/close 18052 (time 1761288166.74 total 227.15 last 82.73) - open/close 18893 (time 1761288176.76 total 237.16 last 83.99) - open/close 19673 (time 1761288186.76 total 247.17 last 77.95) - open/close 20000 (time 1761288190.87 total 251.27 last 79.62) - open/close 20833 (time 1761288200.89 total 261.29 last 83.15) - open/close 21738 (time 1761288210.90 total 271.30 last 90.41) - open/close 22747 (time 1761288220.91 total 281.31 last 100.83) - open/close 23885 (time 1761288230.91 total 291.31 last 113.74) - open/close 24937 (time 1761288240.92 total 301.33 last 105.07) - open/close 25778 (time 1761288250.94 total 311.35 last 83.94) - open/close 26740 (time 1761288260.95 total 321.35 last 96.17) - open/close 27793 (time 1761288270.95 total 331.35 last 105.28) - open/close 28910 (time 1761288280.95 total 341.36 last 111.65) - open/close 30000 (time 1761288289.36 total 349.76 last 129.65) - open/close 31349 (time 1761288299.36 total 359.77 last 134.85) - open/close 32668 (time 1761288309.37 total 369.77 last 131.88) - open/close 34058 (time 1761288319.37 total 379.77 last 138.97) - open/close 35693 (time 1761288329.37 total 389.77 last 163.41) - open/close 37135 (time 1761288339.37 total 399.78 last 144.18) - open/close 38607 (time 1761288349.38 total 409.78 last 147.17) - open/close 40000 (time 1761288358.93 total 419.33 last 145.82) - open/close 41150 (time 1761288368.93 total 429.33 last 114.97) - open/close 42434 (time 1761288378.93 total 439.34 last 128.37) - open/close 43462 (time 1761288388.94 total 449.34 last 102.78) - open/close 44168 (time 1761288398.96 total 459.36 last 70.44) - open/close 44611 (time 1761288408.96 total 469.36 last 44.29) - open/close 45154 (time 1761288418.96 total 479.37 last 54.28) - open/close 45923 (time 1761288428.96 total 489.37 last 76.90) - open/close 46677 (time 1761288438.97 total 499.37 last 75.39) - open/close 47475 (time 1761288448.97 total 509.38 last 79.73) - open/close 48269 (time 1761288458.98 total 519.38 last 79.34) - open/close 49110 (time 1761288468.98 total 529.39 last 84.10) - open/close 49909 (time 1761288478.99 total 539.39 last 79.88) - open/close 50704 (time 1761288488.99 total 549.39 last 79.49) - open/close 51540 (time 1761288498.99 total 559.40 last 83.54) - open/close 52312 (time 1761288509.00 total 569.41 last 77.12) - open/close 53050 (time 1761288519.01 total 579.42 last 73.73) - open/close 53786 (time 1761288529.02 total 589.42 last 73.54) - open/close 54557 (time 1761288539.03 total 599.43 last 77.05) - open/close 55298 (time 1761288549.05 total 609.45 last 73.97) - open/close 56050 (time 1761288559.06 total 619.46 last 75.08) - open/close 56840 (time 1761288569.07 total 629.47 last 78.97) - open/close 57616 (time 1761288579.07 total 639.47 last 77.60) - open/close 58360 (time 1761288589.08 total 649.49 last 74.28) - open/close 59121 (time 1761288599.09 total 659.49 last 76.06) - open/close 60000 (time 1761288608.71 total 669.11 last 91.38) - open/close 60837 (time 1761288618.71 total 679.12 last 83.65) - open/close 61638 (time 1761288628.72 total 689.12 last 80.05) - open/close 62411 (time 1761288638.72 total 699.13 last 77.25) - open/close 63111 (time 1761288648.73 total 709.14 last 69.94) - open/close 63879 (time 1761288658.75 total 719.15 last 76.70) - open/close 64588 (time 1761288668.75 total 729.15 last 70.89) total: 64768 open/close in 731.35 seconds: 88.56 ops/second - /unlink 767 (time 1761288684.20 total 10.00 last 76.67) - /unlink 1550 (time 1761288694.21 total 20.01 last 78.24) - /unlink 2325 (time 1761288704.21 total 30.01 last 77.48) - /unlink 3117 (time 1761288714.22 total 40.02 last 79.16) - /unlink 3928 (time 1761288724.22 total 50.02 last 81.08) - /unlink 4732 (time 1761288734.22 total 60.03 last 80.37) - /unlink 5547 (time 1761288744.23 total 70.04 last 81.41) - /unlink 6473 (time 1761288754.24 total 80.04 last 92.58) - /unlink 7497 (time 1761288764.24 total 90.05 last 102.33) - /unlink 8592 (time 1761288774.25 total 100.05 last 109.42) - /unlink 10000 (time 1761288783.87 total 109.68 last 146.28) - /unlink 11583 (time 1761288793.88 total 119.68 last 158.25) - /unlink 12956 (time 1761288803.88 total 129.68 last 137.25) - /unlink 14410 (time 1761288813.89 total 139.69 last 145.35) - /unlink 15997 (time 1761288823.89 total 149.69 last 158.65) - /unlink 17516 (time 1761288833.89 total 159.70 last 151.82) - /unlink 18973 (time 1761288843.90 total 169.70 last 145.64) - /unlink 20000 (time 1761288850.61 total 176.41 last 153.01) - /unlink 21623 (time 1761288860.61 total 186.41 last 162.29) - /unlink 23029 (time 1761288870.62 total 196.42 last 140.51) - /unlink 23988 (time 1761288880.62 total 206.42 last 95.86) - /unlink 24888 (time 1761288890.62 total 216.43 last 89.98) - /unlink 26026 (time 1761288900.63 total 226.43 last 113.75) - /unlink 27843 (time 1761288910.63 total 236.43 last 181.68) - /unlink 29470 (time 1761288920.65 total 246.45 last 162.36) - /unlink 30000 (time 1761288923.74 total 249.54 last 171.67) - /unlink 31671 (time 1761288933.75 total 259.55 last 166.96) - /unlink 32919 (time 1761288943.75 total 269.56 last 124.69) - /unlink 34459 (time 1761288953.76 total 279.56 last 153.97) - /unlink 36017 (time 1761288963.76 total 289.56 last 155.79) - /unlink 37456 (time 1761288973.76 total 299.57 last 143.80) - /unlink 38844 (time 1761288983.77 total 309.57 last 138.74) - /unlink 40000 (time 1761288990.67 total 316.48 last 167.39) - /unlink 41556 (time 1761289000.68 total 326.48 last 155.52) - /unlink 42978 (time 1761289010.68 total 336.48 last 142.18) - /unlink 44627 (time 1761289020.68 total 346.49 last 164.85) - /unlink 46881 (time 1761289030.69 total 356.49 last 225.34) - /unlink 50000 (time 1761289040.57 total 366.37 last 315.56) - /unlink 53570 (time 1761289050.57 total 376.37 last 356.96) - /unlink 56644 (time 1761289060.57 total 386.38 last 307.37) - /unlink 59402 (time 1761289070.57 total 396.38 last 275.77) - /unlink 62005 (time 1761289080.57 total 406.38 last 260.26) - /unlink 64057 (time 1761289090.58 total 416.38 last 205.17) total: 64768 /unlink in 419.76 seconds: 154.30 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1077 (time 1761289123.46 total 10.00 last 107.69) - open/close 2251 (time 1761289133.47 total 20.01 last 117.34) - open/close 3624 (time 1761289143.47 total 30.01 last 137.24) - open/close 5373 (time 1761289153.48 total 40.02 last 174.79) - open/close 6692 (time 1761289163.48 total 50.02 last 131.89) - open/close 7900 (time 1761289173.49 total 60.03 last 120.67) - open/close 9052 (time 1761289183.49 total 70.03 last 115.19) - open/close 10000 (time 1761289190.68 total 77.22 last 131.79) - open/close 11127 (time 1761289200.70 total 87.24 last 112.52) - open/close 12549 (time 1761289210.70 total 97.24 last 142.15) - open/close 14128 (time 1761289220.71 total 107.25 last 157.78) - open/close 15611 (time 1761289230.71 total 117.25 last 148.28) - open/close 17347 (time 1761289240.71 total 127.25 last 173.53) - open/close 19242 (time 1761289250.72 total 137.26 last 189.44) - open/close 20000 (time 1761289254.69 total 141.22 last 191.04) - open/close 21867 (time 1761289264.69 total 151.23 last 186.67) - open/close 23514 (time 1761289274.69 total 161.23 last 164.66) - open/close 24923 (time 1761289284.69 total 171.23 last 140.89) - open/close 26947 (time 1761289294.69 total 181.23 last 202.37) - open/close 28847 (time 1761289304.69 total 191.23 last 189.96) - open/close 30000 (time 1761289311.82 total 198.36 last 161.90) - open/close 31444 (time 1761289321.82 total 208.36 last 144.37) - open/close 32820 (time 1761289331.82 total 218.36 last 137.58) - open/close 34503 (time 1761289341.82 total 228.36 last 168.24) - open/close 35803 (time 1761289351.83 total 238.37 last 129.95) - open/close 37164 (time 1761289361.83 total 248.37 last 136.07) - open/close 38759 (time 1761289371.83 total 258.37 last 159.47) - open/close 40000 (time 1761289379.35 total 265.89 last 164.94) - open/close 42312 (time 1761289389.36 total 275.90 last 231.12) - open/close 44244 (time 1761289399.36 total 285.90 last 193.11) - open/close 46133 (time 1761289409.36 total 295.90 last 188.89) - open/close 47951 (time 1761289419.36 total 305.90 last 181.79) - open/close 49679 (time 1761289429.37 total 315.91 last 172.74) - open/close 51418 (time 1761289439.37 total 325.91 last 173.86) - open/close 53478 (time 1761289449.37 total 335.91 last 205.95) - open/close 55081 (time 1761289459.38 total 345.92 last 160.23) - open/close 56971 (time 1761289469.38 total 355.92 last 188.94) - open/close 58713 (time 1761289479.38 total 365.92 last 174.15) - open/close 60000 (time 1761289485.56 total 372.10 last 208.34) - open/close 61915 (time 1761289495.59 total 382.13 last 190.90) - open/close 63777 (time 1761289505.60 total 392.13 last 186.13) total: 64768 open/close in 397.26 seconds: 163.04 ops/second - /unlink 3210 (time 1761289522.48 total 10.00 last 320.91) - /unlink 7131 (time 1761289532.48 total 20.00 last 392.05) - /unlink 10000 (time 1761289537.90 total 25.42 last 529.42) - /unlink 14415 (time 1761289547.90 total 35.42 last 441.46) - /unlink 18356 (time 1761289557.90 total 45.42 last 394.07) - /unlink 20000 (time 1761289561.11 total 48.64 last 511.36) - /unlink 24565 (time 1761289571.11 total 58.64 last 456.47) - /unlink 30000 (time 1761289580.64 total 68.16 last 570.69) - /unlink 34947 (time 1761289590.64 total 78.17 last 494.60) - /unlink 40000 (time 1761289600.51 total 88.04 last 511.63) - /unlink 45140 (time 1761289610.52 total 98.04 last 513.98) - /unlink 50000 (time 1761289620.09 total 107.62 last 507.39) - /unlink 54550 (time 1761289630.09 total 117.62 last 454.93) - /unlink 58913 (time 1761289640.10 total 127.63 last 436.17) - /unlink 60000 (time 1761289642.39 total 129.92 last 473.65) - /unlink 64762 (time 1761289652.39 total 139.92 last 476.15) total: 64768 /unlink in 139.93 seconds: 462.85 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 2985 (time 1761289683.36 total 10.00 last 298.46) - open/close 5681 (time 1761289693.36 total 20.00 last 269.53) - open/close 8524 (time 1761289703.36 total 30.00 last 284.27) - open/close 10000 (time 1761289708.89 total 35.53 last 267.08) - open/close 12473 (time 1761289718.89 total 45.53 last 247.26) - open/close 15161 (time 1761289728.89 total 55.54 last 268.73) - open/close 18463 (time 1761289738.90 total 65.54 last 330.07) - open/close 19902 (time 1761289748.91 total 75.55 last 143.75) - open/close 20613 (time 1761289758.92 total 85.56 last 71.05) - open/close 21297 (time 1761289768.92 total 95.56 last 68.36) - open/close 22086 (time 1761289778.92 total 105.56 last 78.90) - open/close 22904 (time 1761289788.94 total 115.58 last 81.62) - open/close 23749 (time 1761289798.95 total 125.59 last 84.45) - open/close 24672 (time 1761289808.95 total 135.59 last 92.30) - open/close 25666 (time 1761289818.96 total 145.60 last 99.32) - open/close 26614 (time 1761289828.97 total 155.61 last 94.73) - open/close 27592 (time 1761289838.98 total 165.62 last 97.66) - open/close 28613 (time 1761289848.99 total 175.63 last 102.04) - open/close 29646 (time 1761289859.00 total 185.64 last 103.20) - open/close 30000 (time 1761289862.85 total 189.49 last 91.76) - open/close 30899 (time 1761289872.86 total 199.50 last 89.82) - open/close 31972 (time 1761289882.87 total 209.51 last 107.26) - open/close 33144 (time 1761289892.87 total 219.51 last 117.14) - open/close 34358 (time 1761289902.88 total 229.52 last 121.32) - open/close 35438 (time 1761289912.88 total 239.52 last 107.94) - open/close 36500 (time 1761289922.88 total 249.52 last 106.19) - open/close 37395 (time 1761289932.89 total 259.53 last 89.48) - open/close 38323 (time 1761289942.90 total 269.54 last 92.71) - open/close 39196 (time 1761289952.91 total 279.55 last 87.20) - open/close 40000 (time 1761289962.13 total 288.77 last 87.20) - open/close 40839 (time 1761289972.13 total 298.77 last 83.88) - open/close 41756 (time 1761289982.14 total 308.78 last 91.64) - open/close 42638 (time 1761289992.14 total 318.78 last 88.19) - open/close 43518 (time 1761290002.14 total 328.78 last 87.96) - open/close 44399 (time 1761290012.15 total 338.79 last 88.03) - open/close 45275 (time 1761290022.15 total 348.80 last 87.57) - open/close 46114 (time 1761290032.16 total 358.80 last 83.85) - open/close 47072 (time 1761290042.16 total 368.80 last 95.79) - open/close 48320 (time 1761290052.17 total 378.81 last 124.68) - open/close 49388 (time 1761290062.18 total 388.82 last 106.75) - open/close 50000 (time 1761290067.16 total 393.80 last 122.72) - open/close 51101 (time 1761290077.16 total 403.81 last 110.08) - open/close 52021 (time 1761290087.18 total 413.83 last 91.81) - open/close 52945 (time 1761290097.19 total 423.83 last 92.38) - open/close 53940 (time 1761290107.19 total 433.84 last 99.43) - open/close 54851 (time 1761290117.20 total 443.84 last 91.02) - open/close 55975 (time 1761290127.21 total 453.85 last 112.35) - open/close 57301 (time 1761290137.21 total 463.85 last 132.54) - open/close 58618 (time 1761290147.21 total 473.85 last 131.68) - open/close 59850 (time 1761290157.22 total 483.86 last 123.15) - open/close 60881 (time 1761290167.22 total 493.86 last 103.04) - open/close 61824 (time 1761290177.23 total 503.88 last 94.19) - open/close 62752 (time 1761290187.24 total 513.88 last 92.78) - open/close 63662 (time 1761290197.24 total 523.89 last 90.93) - open/close 64686 (time 1761290207.25 total 533.89 last 102.37) total: 64768 open/close in 534.82 seconds: 121.10 ops/second - /unlink 1599 (time 1761290220.80 total 10.00 last 159.90) - /unlink 3269 (time 1761290230.80 total 20.00 last 166.95) - /unlink 5311 (time 1761290240.80 total 30.00 last 204.20) - /unlink 7408 (time 1761290250.81 total 40.00 last 209.69) - /unlink 9241 (time 1761290260.81 total 50.01 last 183.23) - /unlink 10000 (time 1761290264.40 total 53.60 last 211.40) - /unlink 12052 (time 1761290274.40 total 63.60 last 205.12) - /unlink 13810 (time 1761290284.41 total 73.61 last 175.70) - /unlink 15502 (time 1761290294.42 total 83.61 last 169.09) - /unlink 17376 (time 1761290304.42 total 93.62 last 187.35) - /unlink 19204 (time 1761290314.42 total 103.62 last 182.69) - /unlink 20000 (time 1761290319.52 total 108.71 last 156.36) - /unlink 21734 (time 1761290329.52 total 118.72 last 173.38) - /unlink 23651 (time 1761290339.52 total 128.72 last 191.59) - /unlink 25583 (time 1761290349.53 total 138.72 last 193.15) - /unlink 27281 (time 1761290359.53 total 148.73 last 169.78) - /unlink 28947 (time 1761290369.53 total 158.73 last 166.55) - /unlink 30000 (time 1761290375.70 total 164.90 last 170.69) - /unlink 31784 (time 1761290385.70 total 174.90 last 178.38) - /unlink 33643 (time 1761290395.70 total 184.90 last 185.84) - /unlink 35317 (time 1761290405.70 total 194.90 last 167.37) - /unlink 36931 (time 1761290415.71 total 204.91 last 161.33) - /unlink 38596 (time 1761290425.71 total 214.91 last 166.47) - /unlink 40000 (time 1761290434.27 total 223.47 last 164.05) - /unlink 41989 (time 1761290444.27 total 233.47 last 198.90) - /unlink 44004 (time 1761290454.28 total 243.48 last 201.35) - /unlink 45850 (time 1761290464.28 total 253.48 last 184.48) - /unlink 47484 (time 1761290474.29 total 263.49 last 163.29) - /unlink 49270 (time 1761290484.29 total 273.49 last 178.57) - /unlink 50000 (time 1761290489.18 total 278.38 last 149.19) - /unlink 51657 (time 1761290499.19 total 288.38 last 165.69) - /unlink 53645 (time 1761290509.19 total 298.39 last 198.73) - /unlink 55304 (time 1761290519.19 total 308.39 last 165.89) - /unlink 57488 (time 1761290529.19 total 318.39 last 218.37) - /unlink 59683 (time 1761290539.19 total 328.39 last 219.44) - /unlink 61500 (time 1761290549.20 total 338.40 last 181.59) - /unlink 63228 (time 1761290559.20 total 348.40 last 172.77) total: 64768 /unlink in 356.12 seconds: 181.87 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg244-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg244-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg244-server stop mds service on oleg244-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg244-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg244-server' oleg244-server: oleg244-server.virtnet: executing unload_modules_local oleg244-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg244-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg244-client: oleg244-client: ssh exited with exit code 2 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 2 pdsh@oleg244-client: oleg244-client: ssh exited with exit code 2 pdsh@oleg244-client: oleg244-server: ssh exited with exit code 2