== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 08:56:49 (1761310609) Stopping clients: oleg247-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg247-client.virtnet /mnt/lustre2 (opts:-f) oleg247-server: oleg247-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg247-server' oleg247-server: oleg247-server.virtnet: executing load_modules_local oleg247-server: Loading modules from /home/green/git/lustre-release/lustre oleg247-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg247-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg247-server: detected 4 online CPUs by sysfs oleg247-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg247-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg247-server: oleg247-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg247-client: oleg247-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg247-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg247-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg247-server: oleg247-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg247-client: oleg247-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg247-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg247-client.virtnet: -o user_xattr,flock oleg247-server@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 16166 358 15808 3% /mnt/lustre[OST:0] filesystem_summary: 16137 329 15808 3% /mnt/lustre fail_loc=0x1312 fail_val=5 - open/close 1205 (time 1761310677.49 total 10.00 last 120.50) - open/close 2383 (time 1761310687.49 total 20.00 last 117.75) - open/close 3519 (time 1761310697.50 total 30.01 last 113.60) - open/close 4725 (time 1761310707.50 total 40.01 last 120.54) - open/close 6092 (time 1761310717.50 total 50.01 last 136.69) - open/close 7479 (time 1761310727.51 total 60.02 last 138.56) - open/close 8696 (time 1761310737.51 total 70.02 last 121.69) - open/close 9793 (time 1761310747.51 total 80.02 last 109.69) - open/close 10000 (time 1761310749.63 total 82.14 last 98.00) - open/close 11236 (time 1761310759.63 total 92.14 last 123.54) - open/close 12306 (time 1761310769.63 total 102.14 last 106.96) - open/close 13540 (time 1761310779.64 total 112.15 last 123.32) - open/close 14699 (time 1761310789.64 total 122.15 last 115.85) - open/close 15694 (time 1761310799.65 total 132.16 last 99.46) - open/close 16333 (time 1761310809.65 total 142.16 last 63.85) - open/close 16858 (time 1761310819.67 total 152.18 last 52.44) - open/close 17381 (time 1761310829.67 total 162.18 last 52.26) - open/close 18033 (time 1761310839.68 total 172.19 last 65.18) - open/close 18732 (time 1761310849.68 total 182.19 last 69.85) - open/close 19536 (time 1761310859.69 total 192.20 last 80.32) - open/close 20000 (time 1761310865.84 total 198.35 last 75.53) - open/close 20765 (time 1761310875.84 total 208.35 last 76.47) - open/close 21561 (time 1761310885.85 total 218.36 last 79.54) - open/close 22378 (time 1761310895.85 total 228.36 last 81.68) - open/close 23155 (time 1761310905.86 total 238.37 last 77.62) - open/close 23951 (time 1761310915.88 total 248.39 last 79.48) - open/close 24783 (time 1761310925.88 total 258.39 last 83.16) - open/close 25621 (time 1761310935.90 total 268.41 last 83.63) - open/close 26422 (time 1761310945.92 total 278.43 last 79.95) - open/close 27254 (time 1761310955.93 total 288.44 last 83.07) - open/close 28086 (time 1761310965.94 total 298.45 last 83.14) - open/close 28908 (time 1761310975.95 total 308.46 last 82.16) - open/close 29765 (time 1761310985.95 total 318.46 last 85.66) - open/close 30000 (time 1761310988.65 total 321.16 last 86.92) - open/close 30905 (time 1761310998.66 total 331.17 last 90.45) - open/close 31812 (time 1761311008.66 total 341.17 last 90.67) - open/close 32594 (time 1761311018.66 total 351.17 last 78.19) - open/close 33422 (time 1761311028.67 total 361.18 last 82.79) - open/close 34279 (time 1761311038.68 total 371.19 last 85.62) - open/close 35111 (time 1761311048.68 total 381.19 last 83.14) - open/close 36079 (time 1761311058.69 total 391.20 last 96.78) - open/close 36941 (time 1761311068.69 total 401.20 last 86.19) - open/close 37911 (time 1761311078.70 total 411.21 last 96.89) - open/close 38854 (time 1761311088.70 total 421.21 last 94.23) - open/close 39811 (time 1761311098.71 total 431.22 last 95.67) - open/close 40781 (time 1761311108.71 total 441.22 last 96.96) - open/close 41692 (time 1761311118.72 total 451.23 last 91.00) - open/close 42612 (time 1761311128.73 total 461.24 last 91.94) - open/close 43617 (time 1761311138.73 total 471.24 last 100.49) - open/close 44640 (time 1761311148.73 total 481.24 last 102.29) - open/close 45716 (time 1761311158.73 total 491.24 last 107.57) - open/close 46727 (time 1761311168.74 total 501.25 last 101.07) - open/close 47695 (time 1761311178.74 total 511.25 last 96.74) - open/close 48582 (time 1761311188.75 total 521.26 last 88.65) - open/close 49521 (time 1761311198.76 total 531.27 last 93.80) - open/close 50000 (time 1761311203.28 total 535.79 last 105.93) - open/close 50977 (time 1761311213.29 total 545.80 last 97.67) - open/close 52119 (time 1761311223.29 total 555.80 last 114.18) - open/close 53253 (time 1761311233.29 total 565.80 last 113.34) - open/close 54329 (time 1761311243.30 total 575.81 last 107.51) - open/close 55482 (time 1761311253.30 total 585.81 last 115.27) - open/close 56888 (time 1761311263.31 total 595.82 last 140.53) - open/close 58204 (time 1761311273.31 total 605.82 last 131.52) - open/close 59308 (time 1761311283.32 total 615.83 last 110.37) - open/close 60000 (time 1761311291.56 total 624.07 last 83.98) - open/close 60660 (time 1761311301.56 total 634.07 last 65.96) - open/close 61284 (time 1761311311.58 total 644.09 last 62.32) - open/close 61974 (time 1761311321.58 total 654.09 last 69.00) - open/close 62731 (time 1761311331.58 total 664.09 last 75.66) - open/close 63561 (time 1761311341.59 total 674.10 last 82.96) - open/close 64385 (time 1761311351.59 total 684.10 last 82.40) total: 64768 open/close in 688.47 seconds: 94.07 ops/second - /unlink 1574 (time 1761311368.94 total 10.00 last 157.39) - /unlink 3417 (time 1761311378.94 total 20.00 last 184.26) - /unlink 5113 (time 1761311388.94 total 30.00 last 169.59) - /unlink 6532 (time 1761311398.94 total 40.00 last 141.89) - /unlink 7717 (time 1761311408.95 total 50.01 last 118.43) - /unlink 8738 (time 1761311418.96 total 60.02 last 102.00) - /unlink 9767 (time 1761311428.98 total 70.05 last 102.63) - /unlink 10000 (time 1761311431.18 total 72.24 last 106.11) - /unlink 11455 (time 1761311441.18 total 82.25 last 145.45) - /unlink 12789 (time 1761311451.19 total 92.25 last 133.33) - /unlink 14202 (time 1761311461.19 total 102.25 last 141.27) - /unlink 15240 (time 1761311471.19 total 112.26 last 103.76) - /unlink 16497 (time 1761311481.20 total 122.26 last 125.68) - /unlink 17634 (time 1761311491.20 total 132.26 last 113.69) - /unlink 18937 (time 1761311501.20 total 142.26 last 130.29) - /unlink 20000 (time 1761311507.99 total 149.05 last 156.63) - /unlink 21358 (time 1761311517.99 total 159.05 last 135.78) - /unlink 22679 (time 1761311528.00 total 169.06 last 131.98) - /unlink 24121 (time 1761311538.00 total 179.06 last 144.18) - /unlink 25722 (time 1761311548.00 total 189.06 last 160.09) - /unlink 27192 (time 1761311558.00 total 199.06 last 146.98) - /unlink 28516 (time 1761311568.00 total 209.06 last 132.35) - /unlink 29876 (time 1761311578.00 total 219.07 last 135.99) - /unlink 31201 (time 1761311588.01 total 229.07 last 132.43) - /unlink 32517 (time 1761311598.01 total 239.07 last 131.58) - /unlink 33948 (time 1761311608.03 total 249.09 last 142.87) - /unlink 35249 (time 1761311618.04 total 259.10 last 129.98) - /unlink 36541 (time 1761311628.04 total 269.10 last 129.19) - /unlink 37832 (time 1761311638.04 total 279.10 last 129.03) - /unlink 39175 (time 1761311648.05 total 289.11 last 134.21) - /unlink 40000 (time 1761311654.01 total 295.07 last 138.35) - /unlink 41280 (time 1761311664.01 total 305.07 last 127.99) - /unlink 42439 (time 1761311674.02 total 315.08 last 115.87) - /unlink 43730 (time 1761311684.02 total 325.08 last 129.10) - /unlink 45029 (time 1761311694.02 total 335.09 last 129.78) - /unlink 46379 (time 1761311704.03 total 345.09 last 134.96) - /unlink 47742 (time 1761311714.03 total 355.09 last 136.26) - /unlink 48990 (time 1761311724.03 total 365.09 last 124.78) - /unlink 50000 (time 1761311731.11 total 372.17 last 142.72) - /unlink 51470 (time 1761311741.11 total 382.17 last 146.98) - /unlink 52803 (time 1761311751.12 total 392.18 last 133.24) - /unlink 54268 (time 1761311761.12 total 402.18 last 146.44) - /unlink 55866 (time 1761311771.12 total 412.18 last 159.76) - /unlink 57222 (time 1761311781.12 total 422.18 last 135.58) - /unlink 58638 (time 1761311791.13 total 432.19 last 141.55) - /unlink 60000 (time 1761311801.08 total 442.14 last 136.90) - /unlink 61706 (time 1761311811.08 total 452.14 last 170.53) - /unlink 63105 (time 1761311821.08 total 462.14 last 139.85) - /unlink 64436 (time 1761311831.09 total 472.15 last 133.06) total: 64768 /unlink in 474.72 seconds: 136.44 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 764 (time 1761311868.49 total 10.02 last 76.26) - open/close 1526 (time 1761311878.49 total 20.02 last 76.19) - open/close 2266 (time 1761311888.50 total 30.02 last 73.99) - open/close 3028 (time 1761311898.50 total 40.02 last 76.19) - open/close 3871 (time 1761311908.50 total 50.03 last 84.24) - open/close 4660 (time 1761311918.52 total 60.05 last 78.76) - open/close 5427 (time 1761311928.53 total 70.06 last 76.63) - open/close 6209 (time 1761311938.54 total 80.07 last 78.08) - open/close 6998 (time 1761311948.55 total 90.08 last 78.84) - open/close 7779 (time 1761311958.56 total 100.08 last 78.06) - open/close 8593 (time 1761311968.56 total 110.09 last 81.37) - open/close 9352 (time 1761311978.57 total 120.09 last 75.86) - open/close 10000 (time 1761311987.35 total 128.88 last 73.76) - open/close 10689 (time 1761311997.37 total 138.89 last 68.81) - open/close 11489 (time 1761312007.38 total 148.91 last 79.88) - open/close 12295 (time 1761312017.39 total 158.92 last 80.51) - open/close 13111 (time 1761312027.40 total 168.93 last 81.53) - open/close 13885 (time 1761312037.40 total 178.93 last 77.38) - open/close 14703 (time 1761312047.41 total 188.94 last 81.72) - open/close 15538 (time 1761312057.41 total 198.94 last 83.50) - open/close 16377 (time 1761312067.42 total 208.95 last 83.82) - open/close 17181 (time 1761312077.43 total 218.95 last 80.38) - open/close 17970 (time 1761312087.43 total 228.96 last 78.87) - open/close 18818 (time 1761312097.43 total 238.96 last 84.79) - open/close 19647 (time 1761312107.44 total 248.97 last 82.82) - open/close 20000 (time 1761312111.25 total 252.78 last 92.54) - open/close 20835 (time 1761312121.26 total 262.78 last 83.48) - open/close 21694 (time 1761312131.26 total 272.79 last 85.88) - open/close 22529 (time 1761312141.26 total 282.79 last 83.49) - open/close 23336 (time 1761312151.27 total 292.80 last 80.62) - open/close 24133 (time 1761312161.28 total 302.80 last 79.64) - open/close 24901 (time 1761312171.29 total 312.81 last 76.74) - open/close 25815 (time 1761312181.29 total 322.82 last 91.38) - open/close 26629 (time 1761312191.31 total 332.84 last 81.24) - open/close 27374 (time 1761312201.32 total 342.84 last 74.46) - open/close 28137 (time 1761312211.32 total 352.85 last 76.24) - open/close 28954 (time 1761312221.33 total 362.86 last 81.61) - open/close 29752 (time 1761312231.33 total 372.86 last 79.80) - open/close 30000 (time 1761312234.30 total 375.82 last 83.68) - open/close 30862 (time 1761312244.31 total 385.83 last 86.11) - open/close 31647 (time 1761312254.31 total 395.84 last 78.45) - open/close 32408 (time 1761312264.32 total 405.84 last 76.08) - open/close 33241 (time 1761312274.32 total 415.85 last 83.25) - open/close 34169 (time 1761312284.33 total 425.85 last 92.76) - open/close 34973 (time 1761312294.34 total 435.86 last 80.33) - open/close 35778 (time 1761312304.34 total 445.86 last 80.48) - open/close 36549 (time 1761312314.35 total 455.87 last 77.02) - open/close 37279 (time 1761312324.36 total 465.88 last 72.93) - open/close 38000 (time 1761312334.38 total 475.91 last 71.93) - open/close 38885 (time 1761312344.39 total 485.91 last 88.46) - open/close 39833 (time 1761312354.40 total 495.92 last 94.68) - open/close 40818 (time 1761312364.40 total 505.92 last 98.49) - open/close 41738 (time 1761312374.40 total 515.93 last 91.97) - open/close 42572 (time 1761312384.41 total 525.94 last 83.32) - open/close 43399 (time 1761312394.41 total 535.94 last 82.69) - open/close 44220 (time 1761312404.43 total 545.95 last 82.01) - open/close 45106 (time 1761312414.45 total 555.97 last 88.41) - open/close 45919 (time 1761312424.45 total 565.98 last 81.24) - open/close 46945 (time 1761312434.46 total 575.98 last 102.57) - open/close 47818 (time 1761312444.46 total 585.99 last 87.27) - open/close 48659 (time 1761312454.46 total 595.99 last 84.07) - open/close 49553 (time 1761312464.47 total 606.00 last 89.34) - open/close 50000 (time 1761312469.87 total 611.40 last 82.77) - open/close 50794 (time 1761312479.87 total 621.40 last 79.39) - open/close 51620 (time 1761312489.88 total 631.41 last 82.52) - open/close 52449 (time 1761312499.89 total 641.42 last 82.83) - open/close 53327 (time 1761312509.90 total 651.42 last 87.75) - open/close 54179 (time 1761312519.90 total 661.43 last 85.15) - open/close 55027 (time 1761312529.91 total 671.43 last 84.74) - open/close 55882 (time 1761312539.92 total 681.44 last 85.44) - open/close 56693 (time 1761312549.92 total 691.44 last 81.08) - open/close 57514 (time 1761312559.92 total 701.45 last 82.08) - open/close 58307 (time 1761312569.94 total 711.47 last 79.11) - open/close 59107 (time 1761312579.96 total 721.49 last 79.84) - open/close 59879 (time 1761312589.97 total 731.50 last 77.15) - open/close 60650 (time 1761312599.98 total 741.51 last 77.00) - open/close 61430 (time 1761312609.99 total 751.51 last 77.98) - open/close 62227 (time 1761312619.99 total 761.52 last 79.64) - open/close 63076 (time 1761312630.00 total 771.52 last 84.87) - open/close 63866 (time 1761312640.01 total 781.53 last 78.92) - open/close 64564 (time 1761312650.03 total 791.56 last 69.62) total: 64768 open/close in 794.11 seconds: 81.56 ops/second - /unlink 1405 (time 1761312665.43 total 10.02 last 140.26) - /unlink 2732 (time 1761312675.43 total 20.02 last 132.65) - /unlink 4146 (time 1761312685.43 total 30.02 last 141.37) - /unlink 5397 (time 1761312695.43 total 40.02 last 125.09) - /unlink 6717 (time 1761312705.44 total 50.03 last 131.95) - /unlink 8148 (time 1761312715.44 total 60.03 last 143.07) - /unlink 9644 (time 1761312725.44 total 70.03 last 149.55) - /unlink 10000 (time 1761312727.96 total 72.55 last 141.21) - /unlink 11337 (time 1761312737.97 total 82.56 last 133.67) - /unlink 12677 (time 1761312747.97 total 92.56 last 133.97) - /unlink 13953 (time 1761312757.97 total 102.56 last 127.55) - /unlink 15222 (time 1761312767.98 total 112.57 last 126.84) - /unlink 16947 (time 1761312777.98 total 122.57 last 172.46) - /unlink 18609 (time 1761312787.98 total 132.57 last 166.16) - /unlink 19998 (time 1761312797.99 total 142.57 last 138.85) - /unlink 21348 (time 1761312807.99 total 152.58 last 134.99) - /unlink 23006 (time 1761312817.99 total 162.58 last 165.73) - /unlink 24396 (time 1761312827.99 total 172.58 last 138.99) - /unlink 25751 (time 1761312838.00 total 182.59 last 135.42) - /unlink 27131 (time 1761312848.00 total 192.59 last 137.96) - /unlink 28559 (time 1761312858.00 total 202.59 last 142.77) - /unlink 29895 (time 1761312868.01 total 212.60 last 133.55) - /unlink 31300 (time 1761312878.01 total 222.60 last 140.47) - /unlink 32636 (time 1761312888.02 total 232.60 last 133.51) - /unlink 34110 (time 1761312898.02 total 242.61 last 147.34) - /unlink 35655 (time 1761312908.02 total 252.61 last 154.49) - /unlink 37520 (time 1761312918.02 total 262.61 last 186.42) - /unlink 39377 (time 1761312928.03 total 272.62 last 185.63) - /unlink 40000 (time 1761312931.38 total 275.97 last 185.58) - /unlink 41753 (time 1761312941.39 total 285.98 last 175.24) - /unlink 43375 (time 1761312951.40 total 295.99 last 162.01) - /unlink 45027 (time 1761312961.40 total 305.99 last 165.15) - /unlink 46568 (time 1761312971.41 total 315.99 last 154.06) - /unlink 47975 (time 1761312981.41 total 325.99 last 140.70) - /unlink 49372 (time 1761312991.41 total 336.00 last 139.60) - /unlink 50000 (time 1761312995.87 total 340.46 last 140.77) - /unlink 51495 (time 1761313005.88 total 350.47 last 149.43) - /unlink 53090 (time 1761313015.88 total 360.47 last 159.49) - /unlink 54551 (time 1761313025.88 total 370.47 last 146.08) - /unlink 56579 (time 1761313035.88 total 380.47 last 202.78) - /unlink 58160 (time 1761313045.88 total 390.47 last 158.08) - /unlink 59566 (time 1761313055.89 total 400.48 last 140.55) - /unlink 60000 (time 1761313059.39 total 403.98 last 123.76) - /unlink 61699 (time 1761313069.40 total 413.98 last 169.86) - /unlink 63197 (time 1761313079.40 total 423.99 last 149.77) total: 64768 /unlink in 433.87 seconds: 149.28 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 863 (time 1761313122.20 total 10.01 last 86.20) - open/close 1721 (time 1761313132.21 total 20.02 last 85.75) - open/close 2540 (time 1761313142.21 total 30.02 last 81.87) - open/close 3372 (time 1761313152.22 total 40.03 last 83.14) - open/close 4200 (time 1761313162.23 total 50.04 last 82.69) - open/close 5088 (time 1761313172.25 total 60.06 last 88.67) - open/close 5895 (time 1761313182.25 total 70.06 last 80.69) - open/close 6696 (time 1761313192.26 total 80.07 last 80.03) - open/close 7573 (time 1761313202.26 total 90.07 last 87.68) - open/close 8393 (time 1761313212.27 total 100.08 last 81.91) - open/close 9225 (time 1761313222.27 total 110.08 last 83.18) - open/close 10000 (time 1761313231.16 total 118.97 last 87.21) - open/close 10810 (time 1761313241.17 total 128.98 last 80.91) - open/close 11635 (time 1761313251.18 total 138.99 last 82.41) - open/close 12383 (time 1761313261.18 total 148.99 last 74.78) - open/close 13120 (time 1761313271.19 total 159.00 last 73.66) - open/close 13876 (time 1761313281.20 total 169.01 last 75.52) - open/close 14703 (time 1761313291.20 total 179.01 last 82.69) - open/close 15513 (time 1761313301.21 total 189.02 last 80.95) - open/close 16331 (time 1761313311.22 total 199.03 last 81.73) - open/close 17145 (time 1761313321.23 total 209.04 last 81.29) - open/close 17960 (time 1761313331.23 total 219.04 last 81.49) - open/close 18795 (time 1761313341.24 total 229.05 last 83.40) - open/close 19638 (time 1761313351.25 total 239.05 last 84.29) - open/close 20000 (time 1761313356.02 total 243.83 last 75.80) - open/close 20792 (time 1761313366.03 total 253.84 last 79.14) - open/close 21556 (time 1761313376.03 total 263.84 last 76.38) - open/close 22337 (time 1761313386.04 total 273.85 last 78.03) - open/close 23092 (time 1761313396.04 total 283.85 last 75.47) - open/close 23861 (time 1761313406.05 total 293.86 last 76.84) - open/close 24649 (time 1761313416.05 total 303.86 last 78.78) - open/close 25430 (time 1761313426.07 total 313.88 last 77.99) - open/close 26266 (time 1761313436.07 total 323.88 last 83.59) - open/close 27063 (time 1761313446.07 total 333.88 last 79.68) - open/close 27809 (time 1761313456.07 total 343.88 last 74.59) - open/close 28589 (time 1761313466.09 total 353.90 last 77.85) - open/close 29388 (time 1761313476.10 total 363.91 last 79.84) - open/close 30000 (time 1761313483.83 total 371.64 last 79.21) - open/close 30811 (time 1761313493.84 total 381.65 last 81.03) - open/close 31568 (time 1761313503.85 total 391.66 last 75.57) - open/close 32348 (time 1761313513.86 total 401.67 last 77.94) - open/close 33108 (time 1761313523.87 total 411.68 last 75.96) - open/close 33800 (time 1761313533.87 total 421.68 last 69.20) - open/close 34686 (time 1761313543.87 total 431.68 last 88.55) - open/close 35507 (time 1761313553.89 total 441.70 last 81.95) - open/close 36336 (time 1761313563.90 total 451.71 last 82.83) - open/close 37158 (time 1761313573.91 total 461.72 last 82.15) - open/close 38014 (time 1761313583.92 total 471.73 last 85.44) - open/close 38809 (time 1761313593.93 total 481.74 last 79.49) - open/close 39672 (time 1761313603.94 total 491.74 last 86.22) - open/close 40000 (time 1761313608.36 total 496.17 last 74.17) - open/close 40729 (time 1761313618.37 total 506.18 last 72.82) - open/close 41528 (time 1761313628.37 total 516.18 last 79.86) - open/close 42284 (time 1761313638.38 total 526.19 last 75.54) - open/close 43004 (time 1761313648.38 total 536.19 last 72.00) - open/close 43612 (time 1761313658.40 total 546.21 last 60.70) - open/close 44349 (time 1761313668.40 total 556.21 last 73.68) - open/close 45084 (time 1761313678.41 total 566.21 last 73.47) - open/close 45818 (time 1761313688.41 total 576.22 last 73.35) - open/close 46635 (time 1761313698.42 total 586.23 last 81.61) - open/close 47553 (time 1761313708.43 total 596.24 last 91.74) - open/close 48508 (time 1761313718.43 total 606.24 last 95.47) - open/close 49355 (time 1761313728.44 total 616.25 last 84.65) - open/close 50000 (time 1761313736.86 total 624.67 last 76.55) - open/close 50788 (time 1761313746.87 total 634.68 last 78.73) - open/close 51546 (time 1761313756.87 total 644.68 last 75.79) - open/close 52284 (time 1761313766.88 total 654.69 last 73.78) - open/close 53047 (time 1761313776.88 total 664.69 last 76.29) - open/close 53652 (time 1761313786.89 total 674.70 last 60.43) - open/close 54373 (time 1761313796.89 total 684.70 last 72.09) - open/close 55111 (time 1761313806.90 total 694.71 last 73.75) - open/close 55827 (time 1761313816.90 total 704.71 last 71.56) - open/close 56562 (time 1761313826.91 total 714.72 last 73.43) - open/close 57265 (time 1761313836.92 total 724.73 last 70.25) - open/close 57998 (time 1761313846.92 total 734.73 last 73.28) - open/close 58754 (time 1761313856.92 total 744.73 last 75.60) - open/close 59425 (time 1761313866.93 total 754.74 last 67.04) - open/close 59979 (time 1761313876.98 total 764.79 last 55.15) - open/close 60622 (time 1761313887.00 total 774.81 last 64.16) - open/close 61349 (time 1761313897.01 total 784.82 last 72.62) - open/close 62135 (time 1761313907.02 total 794.83 last 78.56) - open/close 62899 (time 1761313917.02 total 804.83 last 76.37) - open/close 63683 (time 1761313927.02 total 814.83 last 78.37) - open/close 64459 (time 1761313937.03 total 824.84 last 77.56) total: 64768 open/close in 828.93 seconds: 78.13 ops/second - /unlink 1325 (time 1761313954.74 total 10.00 last 132.45) - /unlink 2656 (time 1761313964.74 total 20.01 last 133.02) - /unlink 4037 (time 1761313974.74 total 30.01 last 138.08) - /unlink 5335 (time 1761313984.75 total 40.02 last 129.71) - /unlink 6585 (time 1761313994.76 total 50.02 last 124.95) - /unlink 7861 (time 1761314004.76 total 60.03 last 127.56) - /unlink 9207 (time 1761314014.76 total 70.03 last 134.55) - /unlink 10000 (time 1761314021.06 total 76.33 last 125.85) - /unlink 11194 (time 1761314031.07 total 86.34 last 119.31) - /unlink 12588 (time 1761314041.07 total 96.34 last 139.40) - /unlink 13918 (time 1761314051.08 total 106.34 last 132.92) - /unlink 15243 (time 1761314061.09 total 116.35 last 132.38) - /unlink 16557 (time 1761314071.09 total 126.36 last 131.29) - /unlink 17826 (time 1761314081.11 total 136.37 last 126.74) - /unlink 19086 (time 1761314091.13 total 146.40 last 125.69) - /unlink 20000 (time 1761314098.55 total 153.81 last 123.26) - /unlink 21280 (time 1761314108.55 total 163.82 last 127.97) - /unlink 22574 (time 1761314118.55 total 173.82 last 129.36) - /unlink 23852 (time 1761314128.56 total 183.82 last 127.74) - /unlink 25153 (time 1761314138.56 total 193.83 last 130.07) - /unlink 26350 (time 1761314148.56 total 203.83 last 119.70) - /unlink 27496 (time 1761314158.56 total 213.83 last 114.57) - /unlink 28746 (time 1761314168.57 total 223.83 last 124.97) - /unlink 29956 (time 1761314178.57 total 233.84 last 120.94) - /unlink 31235 (time 1761314188.57 total 243.84 last 127.84) - /unlink 32568 (time 1761314198.58 total 253.85 last 133.25) - /unlink 33848 (time 1761314208.59 total 263.85 last 127.89) - /unlink 35170 (time 1761314218.59 total 273.85 last 132.20) - /unlink 36390 (time 1761314228.59 total 283.86 last 121.96) - /unlink 37762 (time 1761314238.60 total 293.86 last 137.12) - /unlink 39118 (time 1761314248.60 total 303.86 last 135.58) - /unlink 40000 (time 1761314256.44 total 311.71 last 112.45) - /unlink 41160 (time 1761314266.46 total 321.72 last 115.84) - /unlink 42354 (time 1761314276.46 total 331.73 last 119.34) - /unlink 43561 (time 1761314286.47 total 341.73 last 120.62) - /unlink 44918 (time 1761314296.47 total 351.74 last 135.65) - /unlink 46175 (time 1761314306.48 total 361.75 last 125.52) - /unlink 47357 (time 1761314316.50 total 371.77 last 118.02) - /unlink 48729 (time 1761314326.50 total 381.77 last 137.16) - /unlink 50000 (time 1761314336.26 total 391.53 last 130.22) - /unlink 51324 (time 1761314346.27 total 401.54 last 132.34) - /unlink 52582 (time 1761314356.27 total 411.54 last 125.75) - /unlink 53820 (time 1761314366.28 total 421.54 last 123.74) - /unlink 55125 (time 1761314376.28 total 431.55 last 130.47) - /unlink 56427 (time 1761314386.28 total 441.55 last 130.20) - /unlink 57832 (time 1761314396.28 total 451.55 last 140.44) - /unlink 59152 (time 1761314406.28 total 461.55 last 131.99) - /unlink 60000 (time 1761314413.09 total 468.36 last 124.58) - /unlink 61336 (time 1761314423.10 total 478.36 last 133.53) - /unlink 62622 (time 1761314433.10 total 488.36 last 128.59) - /unlink 63909 (time 1761314443.10 total 498.37 last 128.62) total: 64768 /unlink in 505.02 seconds: 128.25 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 783 (time 1761314484.23 total 10.01 last 78.26) - open/close 1657 (time 1761314494.23 total 20.01 last 87.39) - open/close 2416 (time 1761314504.24 total 30.01 last 75.84) - open/close 3180 (time 1761314514.25 total 40.02 last 76.35) - open/close 3868 (time 1761314524.25 total 50.02 last 68.77) - open/close 4580 (time 1761314534.26 total 60.04 last 71.13) - open/close 5293 (time 1761314544.27 total 70.04 last 71.27) - open/close 6121 (time 1761314554.28 total 80.05 last 82.73) - open/close 6840 (time 1761314564.28 total 90.05 last 71.88) - open/close 7544 (time 1761314574.28 total 100.05 last 70.38) - open/close 8299 (time 1761314584.29 total 110.06 last 75.44) - open/close 9060 (time 1761314594.29 total 120.07 last 76.06) - open/close 9911 (time 1761314604.30 total 130.07 last 85.07) - open/close 10772 (time 1761314614.30 total 140.07 last 86.07) - open/close 11622 (time 1761314624.30 total 150.07 last 84.98) - open/close 12406 (time 1761314634.30 total 160.08 last 78.38) - open/close 13175 (time 1761314644.31 total 170.08 last 76.85) - open/close 13934 (time 1761314654.32 total 180.09 last 75.85) - open/close 14756 (time 1761314664.32 total 190.10 last 82.14) - open/close 15557 (time 1761314674.33 total 200.11 last 80.04) - open/close 16306 (time 1761314684.33 total 210.11 last 74.89) - open/close 17070 (time 1761314694.35 total 220.13 last 76.26) - open/close 17856 (time 1761314704.36 total 230.14 last 78.52) - open/close 18652 (time 1761314714.37 total 240.14 last 79.57) - open/close 19435 (time 1761314724.37 total 250.14 last 78.29) - open/close 20000 (time 1761314731.44 total 257.21 last 79.88) - open/close 20767 (time 1761314741.45 total 267.23 last 76.61) - open/close 21564 (time 1761314751.46 total 277.23 last 79.63) - open/close 22397 (time 1761314761.47 total 287.24 last 83.23) - open/close 23193 (time 1761314771.49 total 297.26 last 79.45) - open/close 23950 (time 1761314781.50 total 307.27 last 75.63) - open/close 24691 (time 1761314791.51 total 317.28 last 74.02) - open/close 25479 (time 1761314801.52 total 327.29 last 78.71) - open/close 26227 (time 1761314811.53 total 337.30 last 74.76) - open/close 27035 (time 1761314821.53 total 347.30 last 80.79) - open/close 27830 (time 1761314831.54 total 357.31 last 79.41) - open/close 28669 (time 1761314841.55 total 367.32 last 83.82) - open/close 29455 (time 1761314851.56 total 377.33 last 78.53) - open/close 30000 (time 1761314858.91 total 384.68 last 74.13) - open/close 30818 (time 1761314868.91 total 394.69 last 81.77) - open/close 31607 (time 1761314878.92 total 404.69 last 78.84) - open/close 32379 (time 1761314888.93 total 414.71 last 77.09) - open/close 33128 (time 1761314898.94 total 424.71 last 74.86) - open/close 33927 (time 1761314908.95 total 434.73 last 79.79) - open/close 34704 (time 1761314918.96 total 444.73 last 77.66) - open/close 35493 (time 1761314928.97 total 454.75 last 78.79) - open/close 36283 (time 1761314938.99 total 464.76 last 78.87) - open/close 37067 (time 1761314948.99 total 474.77 last 78.35) - open/close 37868 (time 1761314959.00 total 484.78 last 80.03) - open/close 38663 (time 1761314969.01 total 494.79 last 79.43) - open/close 39464 (time 1761314979.02 total 504.79 last 80.03) - open/close 40000 (time 1761314985.49 total 511.26 last 82.87) - open/close 40748 (time 1761314995.49 total 521.26 last 74.77) - open/close 41472 (time 1761315005.50 total 531.28 last 72.32) - open/close 42187 (time 1761315015.50 total 541.28 last 71.50) - open/close 42969 (time 1761315025.51 total 551.28 last 78.15) - open/close 43695 (time 1761315035.52 total 561.29 last 72.53) - open/close 44484 (time 1761315045.53 total 571.30 last 78.82) - open/close 45200 (time 1761315055.53 total 581.31 last 71.56) - open/close 45980 (time 1761315065.54 total 591.31 last 77.94) - open/close 46771 (time 1761315075.55 total 601.32 last 79.05) - open/close 47577 (time 1761315085.56 total 611.33 last 80.51) - open/close 48368 (time 1761315095.57 total 621.35 last 78.98) - open/close 49181 (time 1761315105.59 total 631.36 last 81.19) - open/close 49948 (time 1761315115.59 total 641.37 last 76.65) - open/close 50718 (time 1761315125.60 total 651.38 last 76.93) - open/close 51494 (time 1761315135.61 total 661.38 last 77.58) - open/close 52268 (time 1761315145.62 total 671.39 last 77.32) - open/close 53042 (time 1761315155.63 total 681.40 last 77.32) - open/close 53851 (time 1761315165.64 total 691.42 last 80.77) - open/close 54618 (time 1761315175.66 total 701.44 last 76.55) - open/close 55413 (time 1761315185.68 total 711.45 last 79.37) - open/close 56215 (time 1761315195.69 total 721.46 last 80.11) - open/close 56949 (time 1761315205.70 total 731.47 last 73.32) - open/close 57718 (time 1761315215.70 total 741.48 last 76.87) - open/close 58455 (time 1761315225.71 total 751.48 last 73.68) - open/close 59137 (time 1761315235.71 total 761.48 last 68.18) - open/close 59919 (time 1761315245.71 total 771.49 last 78.18) - open/close 60696 (time 1761315255.72 total 781.49 last 77.67) - open/close 61428 (time 1761315265.73 total 791.50 last 73.11) - open/close 62161 (time 1761315275.74 total 801.51 last 73.23) - open/close 62764 (time 1761315285.75 total 811.52 last 60.26) - open/close 63415 (time 1761315295.75 total 821.52 last 65.08) - open/close 64196 (time 1761315305.76 total 831.53 last 78.05) total: 64768 open/close in 839.04 seconds: 77.19 ops/second - /unlink 1160 (time 1761315327.58 total 10.00 last 115.97) - /unlink 2303 (time 1761315337.59 total 20.00 last 114.28) - /unlink 3487 (time 1761315347.59 total 30.01 last 118.38) - /unlink 4710 (time 1761315357.59 total 40.01 last 122.23) - /unlink 5867 (time 1761315367.59 total 50.01 last 115.70) - /unlink 7118 (time 1761315377.59 total 60.01 last 125.09) - /unlink 8412 (time 1761315387.59 total 70.01 last 129.39) - /unlink 9707 (time 1761315397.60 total 80.01 last 129.50) - /unlink 10000 (time 1761315399.69 total 82.11 last 139.63) - /unlink 11275 (time 1761315409.70 total 92.12 last 127.38) - /unlink 12635 (time 1761315419.71 total 102.13 last 135.88) - /unlink 13979 (time 1761315429.73 total 112.15 last 134.20) - /unlink 15196 (time 1761315439.73 total 122.15 last 121.62) - /unlink 16529 (time 1761315449.74 total 132.15 last 133.28) - /unlink 17762 (time 1761315459.74 total 142.15 last 123.29) - /unlink 18895 (time 1761315469.74 total 152.16 last 113.28) - /unlink 20000 (time 1761315479.49 total 161.91 last 113.27) - /unlink 21245 (time 1761315489.49 total 171.91 last 124.49) - /unlink 22685 (time 1761315499.50 total 181.92 last 143.87) - /unlink 24040 (time 1761315509.51 total 191.93 last 135.45) - /unlink 25384 (time 1761315519.51 total 201.93 last 134.38) - /unlink 26626 (time 1761315529.52 total 211.93 last 124.11) - /unlink 27937 (time 1761315539.54 total 221.96 last 130.79) - /unlink 29084 (time 1761315549.55 total 231.97 last 114.57) - /unlink 30000 (time 1761315557.43 total 239.85 last 116.23) - /unlink 31259 (time 1761315567.44 total 249.85 last 125.85) - /unlink 32514 (time 1761315577.44 total 259.86 last 125.45) - /unlink 33705 (time 1761315587.44 total 269.86 last 119.09) - /unlink 34999 (time 1761315597.44 total 279.86 last 129.39) - /unlink 36292 (time 1761315607.44 total 289.86 last 129.29) - /unlink 37617 (time 1761315617.44 total 299.86 last 132.47) - /unlink 38828 (time 1761315627.46 total 309.88 last 120.86) - /unlink 40000 (time 1761315636.95 total 319.37 last 123.58) - /unlink 41250 (time 1761315646.96 total 329.38 last 124.87) - /unlink 42525 (time 1761315656.97 total 339.39 last 127.38) - /unlink 43915 (time 1761315666.98 total 349.40 last 138.87) - /unlink 45363 (time 1761315676.98 total 359.40 last 144.75) - /unlink 46640 (time 1761315686.98 total 369.40 last 127.67) - /unlink 47929 (time 1761315696.99 total 379.40 last 128.85) - /unlink 49167 (time 1761315706.99 total 389.41 last 123.76) - /unlink 50000 (time 1761315713.24 total 395.66 last 133.32) - /unlink 51356 (time 1761315723.24 total 405.66 last 135.58) - /unlink 52699 (time 1761315733.24 total 415.66 last 134.24) - /unlink 53977 (time 1761315743.24 total 425.66 last 127.77) - /unlink 55308 (time 1761315753.25 total 435.67 last 133.04) - /unlink 56667 (time 1761315763.26 total 445.67 last 135.82) - /unlink 58007 (time 1761315773.26 total 455.68 last 133.89) - /unlink 59362 (time 1761315783.26 total 465.68 last 135.49) - /unlink 60000 (time 1761315788.23 total 470.64 last 128.57) - /unlink 61313 (time 1761315798.23 total 480.65 last 131.23) - /unlink 62601 (time 1761315808.24 total 490.65 last 128.75) - /unlink 63966 (time 1761315818.25 total 500.67 last 136.35) total: 64768 /unlink in 507.01 seconds: 127.74 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 842 (time 1761315855.64 total 10.02 last 84.05) - open/close 1654 (time 1761315865.65 total 20.03 last 81.11) - open/close 2497 (time 1761315875.66 total 30.04 last 84.22) - open/close 3307 (time 1761315885.67 total 40.05 last 80.93) - open/close 4158 (time 1761315895.68 total 50.05 last 85.03) - open/close 4953 (time 1761315905.69 total 60.06 last 79.45) - open/close 5736 (time 1761315915.69 total 70.07 last 78.25) - open/close 6525 (time 1761315925.70 total 80.08 last 78.84) - open/close 7285 (time 1761315935.71 total 90.08 last 75.95) - open/close 8107 (time 1761315945.72 total 100.09 last 82.11) - open/close 8876 (time 1761315955.72 total 110.10 last 76.84) - open/close 9700 (time 1761315965.74 total 120.11 last 82.30) - open/close 10000 (time 1761315969.73 total 124.10 last 75.17) - open/close 10800 (time 1761315979.74 total 134.12 last 79.88) - open/close 11544 (time 1761315989.75 total 144.13 last 74.33) - open/close 12321 (time 1761315999.75 total 154.13 last 77.69) - open/close 13118 (time 1761316009.75 total 164.13 last 79.69) - open/close 13937 (time 1761316019.76 total 174.14 last 81.82) - open/close 14721 (time 1761316029.78 total 184.16 last 78.28) - open/close 15530 (time 1761316039.79 total 194.17 last 80.82) - open/close 16323 (time 1761316049.79 total 204.17 last 79.27) - open/close 17083 (time 1761316059.80 total 214.18 last 75.95) - open/close 17829 (time 1761316069.81 total 224.19 last 74.53) - open/close 18600 (time 1761316079.82 total 234.19 last 77.06) - open/close 19346 (time 1761316089.82 total 244.20 last 74.53) - open/close 20000 (time 1761316098.67 total 253.05 last 73.92) - open/close 20770 (time 1761316108.68 total 263.06 last 76.91) - open/close 21554 (time 1761316118.69 total 273.06 last 78.35) - open/close 22256 (time 1761316128.70 total 283.07 last 70.15) - open/close 22861 (time 1761316138.70 total 293.08 last 60.47) - open/close 23579 (time 1761316148.71 total 303.08 last 71.77) - open/close 24358 (time 1761316158.71 total 313.08 last 77.88) - open/close 25185 (time 1761316168.72 total 323.09 last 82.62) - open/close 25983 (time 1761316178.73 total 333.10 last 79.74) - open/close 26735 (time 1761316188.73 total 343.10 last 75.18) - open/close 27488 (time 1761316198.74 total 353.11 last 75.24) - open/close 28268 (time 1761316208.74 total 363.11 last 77.99) - open/close 29048 (time 1761316218.74 total 373.12 last 77.96) - open/close 29867 (time 1761316228.75 total 383.13 last 81.82) - open/close 30635 (time 1761316238.76 total 393.14 last 76.72) - open/close 31384 (time 1761316248.77 total 403.14 last 74.85) - open/close 32136 (time 1761316258.77 total 413.15 last 75.19) - open/close 32877 (time 1761316268.78 total 423.16 last 73.99) - open/close 33633 (time 1761316278.80 total 433.18 last 75.45) - open/close 34430 (time 1761316288.83 total 443.20 last 79.54) - open/close 35163 (time 1761316298.83 total 453.21 last 73.24) - open/close 35888 (time 1761316308.84 total 463.22 last 72.42) - open/close 36639 (time 1761316318.85 total 473.22 last 75.09) - open/close 37371 (time 1761316328.85 total 483.23 last 73.17) - open/close 38158 (time 1761316338.85 total 493.23 last 78.67) - open/close 38886 (time 1761316348.85 total 503.23 last 72.79) - open/close 39607 (time 1761316358.86 total 513.24 last 72.05) - open/close 40000 (time 1761316364.13 total 518.50 last 74.63) - open/close 40781 (time 1761316374.14 total 528.51 last 78.02) - open/close 41480 (time 1761316384.15 total 538.52 last 69.84) - open/close 42180 (time 1761316394.16 total 548.53 last 69.92) - open/close 42889 (time 1761316404.16 total 558.54 last 70.87) - open/close 43662 (time 1761316414.17 total 568.55 last 77.23) - open/close 44346 (time 1761316424.19 total 578.57 last 68.25) - open/close 45040 (time 1761316434.21 total 588.58 last 69.31) - open/close 45784 (time 1761316444.21 total 598.59 last 74.34) - open/close 46500 (time 1761316454.23 total 608.60 last 71.52) - open/close 47211 (time 1761316464.24 total 618.62 last 70.99) - open/close 47947 (time 1761316474.24 total 628.62 last 73.60) - open/close 48734 (time 1761316484.25 total 638.63 last 78.63) - open/close 49470 (time 1761316494.26 total 648.64 last 73.54) - open/close 50000 (time 1761316501.02 total 655.39 last 78.46) - open/close 50778 (time 1761316511.04 total 665.41 last 77.64) - open/close 51518 (time 1761316521.04 total 675.42 last 73.94) - open/close 52240 (time 1761316531.04 total 685.42 last 72.20) - open/close 53020 (time 1761316541.05 total 695.42 last 77.98) - open/close 53775 (time 1761316551.06 total 705.43 last 75.42) - open/close 54522 (time 1761316561.07 total 715.44 last 74.63) - open/close 55262 (time 1761316571.07 total 725.45 last 73.96) - open/close 56065 (time 1761316581.08 total 735.46 last 80.19) - open/close 56861 (time 1761316591.09 total 745.46 last 79.58) - open/close 57627 (time 1761316601.10 total 755.48 last 76.47) - open/close 58467 (time 1761316611.11 total 765.49 last 83.93) - open/close 59271 (time 1761316621.12 total 775.50 last 80.33) - open/close 60000 (time 1761316630.41 total 784.78 last 78.50) - open/close 60817 (time 1761316640.41 total 794.79 last 81.66) - open/close 61719 (time 1761316650.42 total 804.79 last 90.15) - open/close 62471 (time 1761316660.42 total 814.80 last 75.15) - open/close 63195 (time 1761316670.43 total 824.81 last 72.35) - open/close 63963 (time 1761316680.44 total 834.81 last 76.77) - open/close 64669 (time 1761316690.44 total 844.82 last 70.56) total: 64768 open/close in 846.46 seconds: 76.52 ops/second - /unlink 1264 (time 1761316705.90 total 10.01 last 126.27) - /unlink 2540 (time 1761316715.91 total 20.02 last 127.45) - /unlink 3794 (time 1761316725.92 total 30.03 last 125.31) - /unlink 4860 (time 1761316735.92 total 40.03 last 106.55) - /unlink 6032 (time 1761316745.92 total 50.03 last 117.18) - /unlink 7268 (time 1761316755.92 total 60.04 last 123.58) - /unlink 8691 (time 1761316765.93 total 70.04 last 142.20) - /unlink 10000 (time 1761316775.49 total 79.60 last 136.92) - /unlink 11427 (time 1761316785.49 total 89.61 last 142.65) - /unlink 12868 (time 1761316795.49 total 99.61 last 144.10) - /unlink 14170 (time 1761316805.49 total 109.61 last 130.20) - /unlink 15358 (time 1761316815.50 total 119.61 last 118.72) - /unlink 16632 (time 1761316825.50 total 129.62 last 127.38) - /unlink 17799 (time 1761316835.51 total 139.62 last 116.64) - /unlink 18970 (time 1761316845.51 total 149.62 last 117.07) - /unlink 20000 (time 1761316854.66 total 158.78 last 112.54) - /unlink 21248 (time 1761316864.67 total 168.78 last 124.73) - /unlink 22491 (time 1761316874.67 total 178.78 last 124.28) - /unlink 23768 (time 1761316884.68 total 188.79 last 127.62) - /unlink 24903 (time 1761316894.68 total 198.79 last 113.46) - /unlink 26074 (time 1761316904.69 total 208.80 last 117.03) - /unlink 27140 (time 1761316914.69 total 218.81 last 106.50) - /unlink 28427 (time 1761316924.70 total 228.81 last 128.64) - /unlink 29727 (time 1761316934.70 total 238.81 last 129.97) - /unlink 30000 (time 1761316936.93 total 241.04 last 122.74) - /unlink 31252 (time 1761316946.93 total 251.04 last 125.14) - /unlink 32497 (time 1761316956.94 total 261.05 last 124.39) - /unlink 33631 (time 1761316966.94 total 271.06 last 113.37) - /unlink 34649 (time 1761316976.95 total 281.06 last 101.76) - /unlink 35661 (time 1761316987.12 total 291.23 last 99.50) - /unlink 36632 (time 1761316997.12 total 301.24 last 97.03) - /unlink 37827 (time 1761317007.12 total 311.24 last 119.49) - /unlink 39080 (time 1761317017.13 total 321.24 last 125.27) - /unlink 40000 (time 1761317024.61 total 328.72 last 122.92) - /unlink 41214 (time 1761317034.62 total 338.73 last 121.34) - /unlink 42331 (time 1761317044.62 total 348.73 last 111.67) - /unlink 43501 (time 1761317054.62 total 358.74 last 116.95) - /unlink 44861 (time 1761317064.62 total 368.74 last 135.99) - /unlink 46180 (time 1761317074.63 total 378.74 last 131.85) - /unlink 47539 (time 1761317084.64 total 388.75 last 135.79) - /unlink 48872 (time 1761317094.64 total 398.75 last 133.28) - /unlink 50000 (time 1761317103.01 total 407.12 last 134.77) - /unlink 51335 (time 1761317113.02 total 417.14 last 133.28) - /unlink 52586 (time 1761317123.04 total 427.15 last 124.96) - /unlink 53921 (time 1761317133.04 total 437.16 last 133.41) - /unlink 55420 (time 1761317143.05 total 447.16 last 149.81) - /unlink 56975 (time 1761317153.05 total 457.16 last 155.46) - /unlink 58445 (time 1761317163.05 total 467.17 last 146.96) - /unlink 59788 (time 1761317173.06 total 477.17 last 134.21) - /unlink 61052 (time 1761317183.06 total 487.17 last 126.40) - /unlink 62261 (time 1761317193.06 total 497.18 last 120.85) - /unlink 63560 (time 1761317203.07 total 507.18 last 129.86) total: 64768 /unlink in 516.42 seconds: 125.42 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg247-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg247-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg247-server stop mds service on oleg247-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg247-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy unloading modules on: 'oleg247-server' oleg247-server: oleg247-server.virtnet: executing unload_modules_local oleg247-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy oleg247-server: LNET ready to unload oleg247-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy modules unloaded. pdsh@oleg247-client: oleg247-client: ssh exited with exit code 2 pdsh@oleg247-client: oleg247-server: ssh exited with exit code 2 pdsh@oleg247-client: oleg247-client: ssh exited with exit code 2 pdsh@oleg247-client: oleg247-server: ssh exited with exit code 2