== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 13:27:25 (1776187645) Stopping clients: oleg230-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg230-client.virtnet /mnt/lustre2 (opts:-f) oleg230-server: oleg230-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg230-server' oleg230-server: oleg230-server.virtnet: executing load_modules_local oleg230-server: Loading modules from /home/green/git/lustre-release/lustre oleg230-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg230-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg230-server: detected 4 online CPUs by sysfs oleg230-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg230-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg230-server: oleg230-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg230-client: oleg230-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg230-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg230-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg230-server: oleg230-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg230-client: oleg230-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg230-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg230-client.virtnet: -o user_xattr,flock oleg230-server@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 16166 358 15808 3% /mnt/lustre[OST:0] filesystem_summary: 16137 329 15808 3% /mnt/lustre fail_loc=0x1312 fail_val=5 - open/close 866 (time 1776187758.07 total 10.00 last 86.59) - open/close 1671 (time 1776187768.08 total 20.01 last 80.41) - open/close 2579 (time 1776187778.08 total 30.02 last 90.77) - open/close 3485 (time 1776187788.09 total 40.02 last 90.56) - open/close 4430 (time 1776187798.09 total 50.02 last 94.49) - open/close 5403 (time 1776187808.09 total 60.03 last 97.26) - open/close 6293 (time 1776187818.10 total 70.03 last 88.94) - open/close 7060 (time 1776187828.10 total 80.03 last 76.68) - open/close 7979 (time 1776187838.11 total 90.04 last 91.83) - open/close 8814 (time 1776187848.12 total 100.05 last 83.44) - open/close 9593 (time 1776187858.16 total 110.10 last 77.53) - open/close 10000 (time 1776187866.91 total 118.85 last 46.53) - open/close 10842 (time 1776187876.91 total 128.85 last 84.19) - open/close 11706 (time 1776187886.92 total 138.85 last 86.38) - open/close 12532 (time 1776187896.93 total 148.86 last 82.47) - open/close 13411 (time 1776187906.94 total 158.87 last 87.82) - open/close 14378 (time 1776187916.95 total 168.88 last 96.65) - open/close 15295 (time 1776187926.95 total 178.88 last 91.68) - open/close 16316 (time 1776187936.96 total 188.89 last 102.02) - open/close 17243 (time 1776187946.96 total 198.89 last 92.65) - open/close 18257 (time 1776187956.96 total 208.89 last 101.39) - open/close 19215 (time 1776187966.96 total 218.90 last 95.78) - open/close 20000 (time 1776187975.47 total 227.40 last 92.33) - open/close 20962 (time 1776187985.49 total 237.42 last 96.00) - open/close 21907 (time 1776187995.49 total 247.43 last 94.44) - open/close 22843 (time 1776188005.51 total 257.44 last 93.48) - open/close 23668 (time 1776188015.51 total 267.45 last 82.44) - open/close 24614 (time 1776188025.52 total 277.46 last 94.51) - open/close 25579 (time 1776188035.53 total 287.46 last 96.45) - open/close 26524 (time 1776188045.53 total 297.47 last 94.45) - open/close 27493 (time 1776188055.54 total 307.47 last 96.85) - open/close 28471 (time 1776188065.54 total 317.47 last 97.79) - open/close 29377 (time 1776188075.54 total 327.48 last 90.56) - open/close 30000 (time 1776188082.35 total 334.29 last 91.50) - open/close 30876 (time 1776188092.37 total 344.30 last 87.48) - open/close 31725 (time 1776188102.38 total 354.31 last 84.81) - open/close 32609 (time 1776188112.39 total 364.33 last 88.26) - open/close 33569 (time 1776188122.40 total 374.33 last 95.92) - open/close 34357 (time 1776188132.40 total 384.34 last 78.79) - open/close 35230 (time 1776188142.41 total 394.34 last 87.24) - open/close 36163 (time 1776188152.41 total 404.34 last 93.29) - open/close 37118 (time 1776188162.42 total 414.35 last 95.45) - open/close 38085 (time 1776188172.42 total 424.35 last 96.68) - open/close 39102 (time 1776188182.42 total 434.36 last 101.64) - open/close 40000 (time 1776188191.56 total 443.50 last 98.26) - open/close 41083 (time 1776188201.57 total 453.50 last 108.24) - open/close 42074 (time 1776188211.57 total 463.50 last 99.09) - open/close 43033 (time 1776188221.57 total 473.50 last 95.89) - open/close 44044 (time 1776188231.58 total 483.51 last 101.03) - open/close 45076 (time 1776188241.62 total 493.55 last 102.76) - open/close 45833 (time 1776188251.62 total 503.55 last 75.70) - open/close 46734 (time 1776188261.63 total 513.56 last 90.00) - open/close 47683 (time 1776188271.64 total 523.57 last 94.82) - open/close 48654 (time 1776188281.64 total 533.57 last 97.09) - open/close 49679 (time 1776188291.64 total 543.58 last 102.46) - open/close 50000 (time 1776188295.94 total 547.87 last 74.75) - open/close 50749 (time 1776188305.95 total 557.88 last 74.83) - open/close 51434 (time 1776188315.95 total 567.89 last 68.46) - open/close 52336 (time 1776188325.97 total 577.90 last 90.06) - open/close 53189 (time 1776188335.97 total 587.90 last 85.28) - open/close 54158 (time 1776188345.98 total 597.91 last 96.84) - open/close 55223 (time 1776188355.98 total 607.91 last 106.45) - open/close 56225 (time 1776188365.99 total 617.92 last 100.16) - open/close 57200 (time 1776188376.00 total 627.93 last 97.38) - open/close 58131 (time 1776188386.01 total 637.94 last 93.03) - open/close 58871 (time 1776188396.02 total 647.96 last 73.87) - open/close 59604 (time 1776188406.03 total 657.97 last 73.21) - open/close 60000 (time 1776188410.04 total 661.97 last 98.93) - open/close 60959 (time 1776188420.04 total 671.98 last 95.84) - open/close 61653 (time 1776188430.07 total 682.00 last 69.24) - open/close 62597 (time 1776188440.08 total 692.02 last 94.24) - open/close 63448 (time 1776188450.09 total 702.02 last 85.05) - open/close 64379 (time 1776188460.09 total 712.03 last 93.07) total: 64768 open/close in 716.97 seconds: 90.34 ops/second - /unlink 1478 (time 1776188480.32 total 10.00 last 147.73) - /unlink 2900 (time 1776188490.32 total 20.01 last 142.13) - /unlink 4268 (time 1776188500.33 total 30.02 last 136.72) - /unlink 5337 (time 1776188510.33 total 40.02 last 106.86) - /unlink 6727 (time 1776188520.34 total 50.02 last 138.94) - /unlink 8197 (time 1776188530.34 total 60.03 last 146.99) - /unlink 9568 (time 1776188540.34 total 70.03 last 137.06) - /unlink 10000 (time 1776188542.92 total 72.61 last 167.62) - /unlink 11698 (time 1776188552.92 total 82.61 last 169.79) - /unlink 13075 (time 1776188562.92 total 92.61 last 137.65) - /unlink 14780 (time 1776188572.93 total 102.62 last 170.35) - /unlink 16345 (time 1776188582.94 total 112.63 last 156.37) - /unlink 17778 (time 1776188592.94 total 122.63 last 143.25) - /unlink 18974 (time 1776188602.94 total 132.63 last 119.59) - /unlink 20000 (time 1776188609.27 total 138.96 last 162.03) - /unlink 21352 (time 1776188619.28 total 148.96 last 135.18) - /unlink 22708 (time 1776188629.29 total 158.98 last 135.42) - /unlink 23721 (time 1776188639.29 total 168.98 last 101.28) - /unlink 24948 (time 1776188649.29 total 178.98 last 122.66) - /unlink 26221 (time 1776188659.30 total 188.98 last 127.27) - /unlink 27504 (time 1776188669.30 total 198.99 last 128.26) - /unlink 28990 (time 1776188679.30 total 208.99 last 148.56) - /unlink 30000 (time 1776188686.33 total 216.02 last 143.65) - /unlink 31520 (time 1776188696.34 total 226.03 last 151.94) - /unlink 32914 (time 1776188706.34 total 236.03 last 139.37) - /unlink 34276 (time 1776188716.34 total 246.03 last 136.12) - /unlink 35805 (time 1776188726.35 total 256.04 last 152.84) - /unlink 37255 (time 1776188736.35 total 266.04 last 144.99) - /unlink 38439 (time 1776188746.35 total 276.04 last 118.39) - /unlink 39567 (time 1776188756.35 total 286.04 last 112.76) - /unlink 40000 (time 1776188760.79 total 290.48 last 97.55) - /unlink 41239 (time 1776188770.80 total 300.48 last 123.85) - /unlink 42598 (time 1776188780.80 total 310.49 last 135.81) - /unlink 43902 (time 1776188790.81 total 320.50 last 130.33) - /unlink 45290 (time 1776188800.81 total 330.50 last 138.78) - /unlink 46852 (time 1776188810.81 total 340.50 last 156.15) - /unlink 48073 (time 1776188820.84 total 350.53 last 121.70) - /unlink 49340 (time 1776188830.85 total 360.54 last 126.61) - /unlink 50000 (time 1776188836.71 total 366.40 last 112.69) - /unlink 51649 (time 1776188846.71 total 376.40 last 164.83) - /unlink 53295 (time 1776188856.71 total 386.40 last 164.58) - /unlink 54860 (time 1776188866.71 total 396.40 last 156.50) - /unlink 56342 (time 1776188876.72 total 406.40 last 148.19) - /unlink 58079 (time 1776188886.72 total 416.41 last 173.60) - /unlink 59601 (time 1776188896.72 total 426.41 last 152.20) - /unlink 60000 (time 1776188899.14 total 428.83 last 164.92) - /unlink 61625 (time 1776188909.14 total 438.83 last 162.46) - /unlink 63111 (time 1776188919.15 total 448.84 last 148.48) - /unlink 64422 (time 1776188929.16 total 458.85 last 131.02) total: 64768 /unlink in 461.13 seconds: 140.45 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 756 (time 1776188964.35 total 10.00 last 75.58) - open/close 1612 (time 1776188974.36 total 20.01 last 85.54) - open/close 2573 (time 1776188984.37 total 30.02 last 96.04) - open/close 3517 (time 1776188994.37 total 40.02 last 94.34) - open/close 4475 (time 1776189004.37 total 50.02 last 95.80) - open/close 5366 (time 1776189014.38 total 60.03 last 89.02) - open/close 6370 (time 1776189024.39 total 70.03 last 100.36) - open/close 7269 (time 1776189034.39 total 80.04 last 89.89) - open/close 8248 (time 1776189044.39 total 90.04 last 97.87) - open/close 9301 (time 1776189054.40 total 100.05 last 105.21) - open/close 10000 (time 1776189061.25 total 106.90 last 101.97) - open/close 10861 (time 1776189071.26 total 116.91 last 86.04) - open/close 11830 (time 1776189081.27 total 126.91 last 96.85) - open/close 12766 (time 1776189091.27 total 136.92 last 93.59) - open/close 13675 (time 1776189101.27 total 146.92 last 90.84) - open/close 14640 (time 1776189111.28 total 156.93 last 96.45) - open/close 15646 (time 1776189121.29 total 166.94 last 100.44) - open/close 16689 (time 1776189131.30 total 176.95 last 104.26) - open/close 17593 (time 1776189141.30 total 186.95 last 90.39) - open/close 18310 (time 1776189151.33 total 196.98 last 71.44) - open/close 19188 (time 1776189161.34 total 206.99 last 87.72) - open/close 20000 (time 1776189170.82 total 216.47 last 85.71) - open/close 20945 (time 1776189180.82 total 226.47 last 94.42) - open/close 21920 (time 1776189190.83 total 236.48 last 97.46) - open/close 22903 (time 1776189200.84 total 246.48 last 98.24) - open/close 23779 (time 1776189210.84 total 256.49 last 87.58) - open/close 24725 (time 1776189220.84 total 266.49 last 94.60) - open/close 25556 (time 1776189230.84 total 276.49 last 83.09) - open/close 26432 (time 1776189240.85 total 286.49 last 87.54) - open/close 27337 (time 1776189250.85 total 296.50 last 90.44) - open/close 28282 (time 1776189260.86 total 306.51 last 94.45) - open/close 29351 (time 1776189270.86 total 316.51 last 106.90) - open/close 30000 (time 1776189277.61 total 323.26 last 96.16) - open/close 30970 (time 1776189287.61 total 333.26 last 96.98) - open/close 31898 (time 1776189297.62 total 343.26 last 92.74) - open/close 32857 (time 1776189307.62 total 353.27 last 95.83) - open/close 33832 (time 1776189317.62 total 363.27 last 97.49) - open/close 34839 (time 1776189327.63 total 373.28 last 100.67) - open/close 35778 (time 1776189337.63 total 383.28 last 93.90) - open/close 36659 (time 1776189347.63 total 393.28 last 88.04) - open/close 37346 (time 1776189357.64 total 403.29 last 68.64) - open/close 38153 (time 1776189367.65 total 413.30 last 80.63) - open/close 38979 (time 1776189377.66 total 423.31 last 82.54) - open/close 39923 (time 1776189387.66 total 433.31 last 94.39) - open/close 40812 (time 1776189397.66 total 443.31 last 88.90) - open/close 41654 (time 1776189407.66 total 453.31 last 84.20) - open/close 42519 (time 1776189417.67 total 463.32 last 86.42) - open/close 43433 (time 1776189427.67 total 473.32 last 91.39) - open/close 44264 (time 1776189437.68 total 483.33 last 83.02) - open/close 45198 (time 1776189447.69 total 493.34 last 93.33) - open/close 46080 (time 1776189457.69 total 503.34 last 88.16) - open/close 46903 (time 1776189467.70 total 513.35 last 82.25) - open/close 47708 (time 1776189477.70 total 523.35 last 80.49) - open/close 48428 (time 1776189487.70 total 533.35 last 72.00) - open/close 49065 (time 1776189497.72 total 543.37 last 63.54) - open/close 49867 (time 1776189507.74 total 553.39 last 80.07) - open/close 50596 (time 1776189517.75 total 563.40 last 72.84) - open/close 51206 (time 1776189527.76 total 573.41 last 60.94) - open/close 51749 (time 1776189537.76 total 583.41 last 54.27) - open/close 52613 (time 1776189547.77 total 593.42 last 86.35) - open/close 53478 (time 1776189557.77 total 603.42 last 86.46) - open/close 54240 (time 1776189567.79 total 613.44 last 76.09) - open/close 55067 (time 1776189577.79 total 623.44 last 82.66) - open/close 55898 (time 1776189587.79 total 633.44 last 83.10) - open/close 56741 (time 1776189597.80 total 643.45 last 84.24) - open/close 57619 (time 1776189607.80 total 653.45 last 87.78) - open/close 58533 (time 1776189617.81 total 663.46 last 91.30) - open/close 59325 (time 1776189627.82 total 673.47 last 79.12) - open/close 60000 (time 1776189636.14 total 681.79 last 81.14) - open/close 60799 (time 1776189646.15 total 691.80 last 79.86) - open/close 61552 (time 1776189656.15 total 701.80 last 75.24) - open/close 62321 (time 1776189666.16 total 711.81 last 76.88) - open/close 63146 (time 1776189676.17 total 721.82 last 82.39) - open/close 63900 (time 1776189686.18 total 731.83 last 75.30) - open/close 64638 (time 1776189696.19 total 741.84 last 73.75) total: 64768 open/close in 743.67 seconds: 87.09 ops/second - /unlink 1339 (time 1776189713.00 total 10.00 last 133.86) - /unlink 2622 (time 1776189723.00 total 20.00 last 128.28) - /unlink 3864 (time 1776189733.00 total 30.01 last 124.16) - /unlink 5178 (time 1776189743.01 total 40.01 last 131.33) - /unlink 6654 (time 1776189753.01 total 50.01 last 147.58) - /unlink 8064 (time 1776189763.01 total 60.01 last 141.00) - /unlink 9376 (time 1776189773.01 total 70.01 last 131.19) - /unlink 10000 (time 1776189778.98 total 75.99 last 104.48) - /unlink 11080 (time 1776189788.98 total 85.99 last 107.98) - /unlink 12253 (time 1776189798.99 total 96.00 last 117.22) - /unlink 13451 (time 1776189808.99 total 106.00 last 119.80) - /unlink 14883 (time 1776189819.03 total 116.03 last 142.69) - /unlink 16210 (time 1776189829.03 total 126.03 last 132.70) - /unlink 17385 (time 1776189839.03 total 136.04 last 117.47) - /unlink 18537 (time 1776189849.04 total 146.05 last 115.03) - /unlink 19630 (time 1776189859.05 total 156.05 last 109.27) - /unlink 20000 (time 1776189861.59 total 158.60 last 145.27) - /unlink 21208 (time 1776189871.60 total 168.60 last 120.75) - /unlink 22652 (time 1776189881.60 total 178.61 last 144.34) - /unlink 23954 (time 1776189891.60 total 188.61 last 130.19) - /unlink 25315 (time 1776189901.61 total 198.61 last 136.06) - /unlink 26664 (time 1776189911.61 total 208.62 last 134.85) - /unlink 27849 (time 1776189921.61 total 218.62 last 118.48) - /unlink 29022 (time 1776189931.64 total 228.64 last 117.01) - /unlink 30000 (time 1776189938.80 total 235.81 last 136.44) - /unlink 31309 (time 1776189948.81 total 245.81 last 130.85) - /unlink 32706 (time 1776189958.81 total 255.81 last 139.68) - /unlink 34044 (time 1776189968.81 total 265.82 last 133.78) - /unlink 35330 (time 1776189978.81 total 275.82 last 128.56) - /unlink 36761 (time 1776189988.82 total 285.82 last 143.03) - /unlink 38003 (time 1776189998.82 total 295.83 last 124.18) - /unlink 39099 (time 1776190008.83 total 305.84 last 109.45) - /unlink 40000 (time 1776190018.15 total 315.16 last 96.70) - /unlink 41612 (time 1776190028.16 total 325.16 last 161.14) - /unlink 42932 (time 1776190038.16 total 335.17 last 131.93) - /unlink 44211 (time 1776190048.17 total 345.17 last 127.84) - /unlink 45669 (time 1776190058.17 total 355.17 last 145.79) - /unlink 47123 (time 1776190068.18 total 365.18 last 145.22) - /unlink 48509 (time 1776190078.19 total 375.19 last 138.52) - /unlink 49943 (time 1776190088.19 total 385.19 last 143.37) - /unlink 51191 (time 1776190098.19 total 395.19 last 124.78) - /unlink 52570 (time 1776190108.20 total 405.20 last 137.79) - /unlink 53946 (time 1776190118.20 total 415.21 last 137.51) - /unlink 55444 (time 1776190128.21 total 425.21 last 149.75) - /unlink 56905 (time 1776190138.21 total 435.22 last 146.04) - /unlink 58337 (time 1776190148.21 total 445.22 last 143.14) - /unlink 59708 (time 1776190158.22 total 455.23 last 137.00) - /unlink 60000 (time 1776190161.07 total 458.07 last 102.70) - /unlink 61374 (time 1776190171.07 total 468.07 last 137.40) - /unlink 62733 (time 1776190181.07 total 478.07 last 135.89) - /unlink 64138 (time 1776190191.07 total 488.07 last 140.48) total: 64768 /unlink in 492.74 seconds: 131.44 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 944 (time 1776190231.12 total 10.01 last 94.30) - open/close 1819 (time 1776190241.13 total 20.02 last 87.41) - open/close 2721 (time 1776190251.13 total 30.02 last 90.19) - open/close 3582 (time 1776190261.14 total 40.03 last 86.08) - open/close 4480 (time 1776190271.14 total 50.03 last 89.78) - open/close 5424 (time 1776190281.14 total 60.03 last 94.36) - open/close 6395 (time 1776190291.15 total 70.04 last 97.06) - open/close 7224 (time 1776190301.15 total 80.04 last 82.84) - open/close 8148 (time 1776190311.16 total 90.05 last 92.33) - open/close 9108 (time 1776190321.17 total 100.06 last 95.95) - open/close 10000 (time 1776190331.03 total 109.92 last 90.40) - open/close 10855 (time 1776190341.04 total 119.93 last 85.46) - open/close 11710 (time 1776190351.05 total 129.94 last 85.42) - open/close 12546 (time 1776190361.05 total 139.94 last 83.57) - open/close 13205 (time 1776190371.06 total 149.95 last 65.83) - open/close 13921 (time 1776190381.07 total 159.96 last 71.56) - open/close 14680 (time 1776190391.07 total 169.96 last 75.85) - open/close 15512 (time 1776190401.08 total 179.97 last 83.15) - open/close 16385 (time 1776190411.09 total 189.98 last 87.22) - open/close 17384 (time 1776190421.11 total 200.00 last 99.69) - open/close 18120 (time 1776190431.11 total 210.00 last 73.59) - open/close 18917 (time 1776190441.12 total 220.01 last 79.63) - open/close 19582 (time 1776190451.12 total 230.01 last 66.48) - open/close 20000 (time 1776190456.82 total 235.71 last 73.41) - open/close 20721 (time 1776190466.82 total 245.71 last 72.07) - open/close 21655 (time 1776190476.83 total 255.72 last 93.31) - open/close 22544 (time 1776190486.84 total 265.72 last 88.88) - open/close 23417 (time 1776190496.85 total 275.74 last 87.20) - open/close 24271 (time 1776190506.85 total 285.74 last 85.37) - open/close 25158 (time 1776190516.85 total 295.74 last 88.69) - open/close 26128 (time 1776190526.85 total 305.74 last 96.99) - open/close 26955 (time 1776190536.86 total 315.75 last 82.60) - open/close 27933 (time 1776190546.86 total 325.75 last 97.80) - open/close 28883 (time 1776190556.87 total 335.76 last 94.93) - open/close 29661 (time 1776190566.89 total 345.78 last 77.67) - open/close 30000 (time 1776190571.94 total 350.83 last 67.06) - open/close 30807 (time 1776190581.95 total 360.84 last 80.66) - open/close 31687 (time 1776190591.96 total 370.85 last 87.95) - open/close 32686 (time 1776190601.96 total 380.85 last 99.81) - open/close 33585 (time 1776190611.97 total 390.86 last 89.84) - open/close 34423 (time 1776190621.97 total 400.86 last 83.78) - open/close 35348 (time 1776190631.98 total 410.87 last 92.41) - open/close 36193 (time 1776190641.99 total 420.88 last 84.44) - open/close 36929 (time 1776190651.99 total 430.88 last 73.58) - open/close 37759 (time 1776190662.00 total 440.89 last 82.94) - open/close 38329 (time 1776190672.00 total 450.89 last 57.00) - open/close 38953 (time 1776190682.01 total 460.90 last 62.32) - open/close 39667 (time 1776190692.02 total 470.91 last 71.37) - open/close 40000 (time 1776190696.98 total 475.87 last 67.08) - open/close 40838 (time 1776190706.98 total 485.87 last 83.78) - open/close 41508 (time 1776190716.99 total 495.88 last 66.95) - open/close 42409 (time 1776190726.99 total 505.88 last 90.07) - open/close 43359 (time 1776190737.00 total 515.89 last 94.93) - open/close 44290 (time 1776190747.01 total 525.90 last 93.01) - open/close 45182 (time 1776190757.03 total 535.92 last 89.04) - open/close 46006 (time 1776190767.04 total 545.93 last 82.32) - open/close 46833 (time 1776190777.05 total 555.94 last 82.60) - open/close 47712 (time 1776190787.07 total 565.96 last 87.78) - open/close 48519 (time 1776190797.09 total 575.98 last 80.54) - open/close 49150 (time 1776190807.10 total 585.99 last 63.02) - open/close 49821 (time 1776190817.10 total 595.99 last 67.06) - open/close 50000 (time 1776190819.11 total 598.00 last 89.42) - open/close 50897 (time 1776190829.11 total 608.00 last 89.64) - open/close 51731 (time 1776190839.11 total 618.00 last 83.40) - open/close 52575 (time 1776190849.11 total 628.00 last 84.39) - open/close 53416 (time 1776190859.12 total 638.01 last 84.04) - open/close 54189 (time 1776190869.13 total 648.02 last 77.23) - open/close 54916 (time 1776190879.14 total 658.03 last 72.62) - open/close 55639 (time 1776190889.15 total 668.04 last 72.25) - open/close 56371 (time 1776190899.15 total 678.04 last 73.17) - open/close 56976 (time 1776190909.16 total 688.05 last 60.45) - open/close 57599 (time 1776190919.16 total 698.05 last 62.29) - open/close 58252 (time 1776190929.17 total 708.06 last 65.25) - open/close 59014 (time 1776190939.18 total 718.07 last 76.12) - open/close 59845 (time 1776190949.19 total 728.08 last 83.07) - open/close 60657 (time 1776190959.19 total 738.08 last 81.19) - open/close 61318 (time 1776190969.19 total 748.08 last 66.09) - open/close 62006 (time 1776190979.21 total 758.10 last 68.67) - open/close 62588 (time 1776190989.22 total 768.11 last 58.16) - open/close 63082 (time 1776190999.25 total 778.14 last 49.24) - open/close 63838 (time 1776191009.25 total 788.14 last 75.56) - open/close 64350 (time 1776191019.26 total 798.15 last 51.17) total: 64768 open/close in 804.24 seconds: 80.53 ops/second - /unlink 1449 (time 1776191040.04 total 10.00 last 144.86) - /unlink 2665 (time 1776191050.04 total 20.00 last 121.59) - /unlink 3674 (time 1776191060.04 total 30.01 last 100.89) - /unlink 4871 (time 1776191070.05 total 40.01 last 119.64) - /unlink 6334 (time 1776191080.05 total 50.02 last 146.22) - /unlink 7538 (time 1776191090.06 total 60.02 last 120.35) - /unlink 8599 (time 1776191100.07 total 70.03 last 106.00) - /unlink 9822 (time 1776191110.07 total 80.03 last 122.24) - /unlink 10841 (time 1776191120.08 total 90.04 last 101.80) - /unlink 11751 (time 1776191130.08 total 100.05 last 90.98) - /unlink 13079 (time 1776191140.09 total 110.05 last 132.78) - /unlink 14445 (time 1776191150.09 total 120.05 last 136.58) - /unlink 15891 (time 1776191160.09 total 130.05 last 144.57) - /unlink 17384 (time 1776191170.09 total 140.05 last 149.29) - /unlink 18713 (time 1776191180.11 total 150.07 last 132.71) - /unlink 19957 (time 1776191190.11 total 160.07 last 124.32) - /unlink 21248 (time 1776191200.12 total 170.08 last 128.95) - /unlink 22568 (time 1776191210.13 total 180.09 last 131.94) - /unlink 23939 (time 1776191220.13 total 190.09 last 137.04) - /unlink 25224 (time 1776191230.15 total 200.11 last 128.30) - /unlink 26595 (time 1776191240.15 total 210.11 last 137.09) - /unlink 27880 (time 1776191250.15 total 220.11 last 128.49) - /unlink 29255 (time 1776191260.15 total 230.11 last 137.46) - /unlink 30000 (time 1776191265.74 total 235.70 last 133.40) - /unlink 31322 (time 1776191275.74 total 245.70 last 132.18) - /unlink 32623 (time 1776191285.74 total 255.71 last 130.02) - /unlink 33909 (time 1776191295.75 total 265.71 last 128.58) - /unlink 35224 (time 1776191305.75 total 275.71 last 131.46) - /unlink 36532 (time 1776191315.75 total 285.71 last 130.78) - /unlink 37907 (time 1776191325.75 total 295.71 last 137.47) - /unlink 39222 (time 1776191335.75 total 305.71 last 131.49) - /unlink 40000 (time 1776191341.08 total 311.04 last 146.00) - /unlink 41382 (time 1776191351.09 total 321.05 last 138.15) - /unlink 42672 (time 1776191361.09 total 331.05 last 128.90) - /unlink 44013 (time 1776191371.10 total 341.06 last 134.04) - /unlink 45535 (time 1776191381.10 total 351.06 last 152.17) - /unlink 46945 (time 1776191391.10 total 361.06 last 140.96) - /unlink 48449 (time 1776191401.12 total 371.08 last 150.14) - /unlink 49925 (time 1776191411.12 total 381.08 last 147.59) - /unlink 51228 (time 1776191421.13 total 391.09 last 130.24) - /unlink 52527 (time 1776191431.13 total 401.09 last 129.84) - /unlink 53907 (time 1776191441.13 total 411.10 last 137.94) - /unlink 55402 (time 1776191451.14 total 421.10 last 149.40) - /unlink 56806 (time 1776191461.14 total 431.10 last 140.38) - /unlink 58158 (time 1776191471.15 total 441.11 last 135.16) - /unlink 59550 (time 1776191481.15 total 451.12 last 139.07) - /unlink 60000 (time 1776191485.34 total 455.30 last 107.46) - /unlink 61024 (time 1776191495.35 total 465.31 last 102.34) - /unlink 62429 (time 1776191505.35 total 475.31 last 140.50) - /unlink 64006 (time 1776191515.35 total 485.31 last 157.69) total: 64768 /unlink in 490.86 seconds: 131.95 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 792 (time 1776191557.22 total 10.01 last 79.13) - open/close 1560 (time 1776191567.22 total 20.01 last 76.79) - open/close 2474 (time 1776191577.23 total 30.02 last 91.30) - open/close 3204 (time 1776191587.24 total 40.03 last 72.95) - open/close 4089 (time 1776191597.25 total 50.03 last 88.45) - open/close 5009 (time 1776191607.26 total 60.04 last 91.91) - open/close 5838 (time 1776191617.26 total 70.05 last 82.83) - open/close 6660 (time 1776191627.27 total 80.06 last 82.16) - open/close 7622 (time 1776191637.27 total 90.06 last 96.16) - open/close 8505 (time 1776191647.28 total 100.07 last 88.27) - open/close 9359 (time 1776191657.28 total 110.07 last 85.40) - open/close 10000 (time 1776191663.12 total 115.91 last 109.76) - open/close 11069 (time 1776191673.12 total 125.91 last 106.84) - open/close 11856 (time 1776191683.13 total 135.92 last 78.62) - open/close 12819 (time 1776191693.14 total 145.92 last 96.27) - open/close 13791 (time 1776191703.15 total 155.93 last 97.11) - open/close 14717 (time 1776191713.15 total 165.93 last 92.60) - open/close 15614 (time 1776191723.16 total 175.94 last 89.60) - open/close 16607 (time 1776191733.16 total 185.95 last 99.28) - open/close 17307 (time 1776191743.17 total 195.96 last 69.94) - open/close 18217 (time 1776191753.17 total 205.96 last 90.94) - open/close 19209 (time 1776191763.18 total 215.97 last 99.14) - open/close 20000 (time 1776191772.21 total 225.00 last 87.56) - open/close 20804 (time 1776191782.22 total 235.00 last 80.38) - open/close 21672 (time 1776191792.22 total 245.01 last 86.77) - open/close 22556 (time 1776191802.22 total 255.01 last 88.39) - open/close 23584 (time 1776191812.26 total 265.04 last 102.43) - open/close 24541 (time 1776191822.26 total 275.05 last 95.63) - open/close 25508 (time 1776191832.27 total 285.06 last 96.63) - open/close 26480 (time 1776191842.27 total 295.06 last 97.16) - open/close 27410 (time 1776191852.28 total 305.07 last 92.97) - open/close 28335 (time 1776191862.28 total 315.07 last 92.48) - open/close 29171 (time 1776191872.29 total 325.07 last 83.55) - open/close 30000 (time 1776191882.01 total 334.80 last 85.23) - open/close 30859 (time 1776191892.02 total 344.81 last 85.83) - open/close 31807 (time 1776191902.03 total 354.82 last 94.69) - open/close 32759 (time 1776191912.04 total 364.83 last 95.13) - open/close 33386 (time 1776191922.04 total 374.83 last 62.68) - open/close 34219 (time 1776191932.05 total 384.84 last 83.25) - open/close 35068 (time 1776191942.06 total 394.85 last 84.82) - open/close 35845 (time 1776191952.07 total 404.85 last 77.64) - open/close 36622 (time 1776191962.07 total 414.85 last 77.70) - open/close 37339 (time 1776191972.07 total 424.86 last 71.66) - open/close 38170 (time 1776191982.08 total 434.87 last 83.04) - open/close 39012 (time 1776191992.08 total 444.87 last 84.17) - open/close 39830 (time 1776192002.09 total 454.88 last 81.72) - open/close 40000 (time 1776192004.17 total 456.96 last 81.75) - open/close 40904 (time 1776192014.18 total 466.96 last 90.38) - open/close 41773 (time 1776192024.18 total 476.97 last 86.84) - open/close 42491 (time 1776192034.20 total 486.99 last 71.68) - open/close 43339 (time 1776192044.21 total 496.99 last 84.74) - open/close 44274 (time 1776192054.21 total 507.00 last 93.47) - open/close 45125 (time 1776192064.21 total 517.00 last 85.07) - open/close 46040 (time 1776192074.21 total 527.00 last 91.48) - open/close 46919 (time 1776192084.22 total 537.01 last 87.88) - open/close 47757 (time 1776192094.23 total 547.02 last 83.69) - open/close 48675 (time 1776192104.23 total 557.02 last 91.77) - open/close 49573 (time 1776192114.24 total 567.03 last 89.74) - open/close 50000 (time 1776192118.45 total 571.23 last 101.52) - open/close 51033 (time 1776192128.46 total 581.25 last 103.19) - open/close 51939 (time 1776192138.47 total 591.26 last 90.48) - open/close 52851 (time 1776192148.48 total 601.26 last 91.15) - open/close 53803 (time 1776192158.48 total 611.27 last 95.14) - open/close 54713 (time 1776192168.48 total 621.27 last 90.99) - open/close 55653 (time 1776192178.49 total 631.28 last 93.94) - open/close 56517 (time 1776192188.50 total 641.28 last 86.36) - open/close 57457 (time 1776192198.50 total 651.29 last 93.97) - open/close 58351 (time 1776192208.50 total 661.29 last 89.35) - open/close 59277 (time 1776192218.52 total 671.30 last 92.48) - open/close 60000 (time 1776192226.44 total 679.23 last 91.28) - open/close 60724 (time 1776192236.44 total 689.23 last 72.38) - open/close 61287 (time 1776192246.44 total 699.23 last 56.27) - open/close 61749 (time 1776192256.45 total 709.24 last 46.15) - open/close 62363 (time 1776192266.46 total 719.25 last 61.38) - open/close 63045 (time 1776192276.48 total 729.27 last 68.07) - open/close 63828 (time 1776192286.48 total 739.27 last 78.25) - open/close 64598 (time 1776192296.48 total 749.27 last 77.00) total: 64768 open/close in 751.26 seconds: 86.21 ops/second - /unlink 1119 (time 1776192313.21 total 10.00 last 111.88) - /unlink 2316 (time 1776192323.21 total 20.00 last 119.68) - /unlink 3948 (time 1776192333.22 total 30.01 last 163.10) - /unlink 5046 (time 1776192343.26 total 40.05 last 109.40) - /unlink 6403 (time 1776192353.26 total 50.05 last 135.62) - /unlink 7680 (time 1776192363.26 total 60.05 last 127.67) - /unlink 9058 (time 1776192373.27 total 70.06 last 137.73) - /unlink 10000 (time 1776192382.56 total 79.35 last 101.39) - /unlink 11191 (time 1776192392.57 total 89.36 last 118.97) - /unlink 12516 (time 1776192402.57 total 99.36 last 132.48) - /unlink 13805 (time 1776192412.58 total 109.36 last 128.87) - /unlink 15415 (time 1776192422.58 total 119.37 last 161.00) - /unlink 16987 (time 1776192432.58 total 129.37 last 157.15) - /unlink 18491 (time 1776192442.58 total 139.37 last 150.38) - /unlink 19856 (time 1776192452.58 total 149.37 last 136.48) - /unlink 21270 (time 1776192462.60 total 159.39 last 141.15) - /unlink 22678 (time 1776192472.60 total 169.39 last 140.74) - /unlink 23964 (time 1776192482.61 total 179.39 last 128.58) - /unlink 25355 (time 1776192492.61 total 189.40 last 139.07) - /unlink 26816 (time 1776192502.61 total 199.40 last 146.02) - /unlink 28195 (time 1776192512.62 total 209.41 last 137.86) - /unlink 29563 (time 1776192522.62 total 219.41 last 136.76) - /unlink 30000 (time 1776192526.07 total 222.86 last 126.74) - /unlink 31299 (time 1776192536.07 total 232.86 last 129.87) - /unlink 32937 (time 1776192546.07 total 242.86 last 163.74) - /unlink 34148 (time 1776192556.08 total 252.87 last 121.05) - /unlink 35169 (time 1776192566.08 total 262.87 last 102.05) - /unlink 36319 (time 1776192576.08 total 272.87 last 114.98) - /unlink 37663 (time 1776192586.09 total 282.88 last 134.31) - /unlink 39037 (time 1776192596.09 total 292.88 last 137.33) - /unlink 40000 (time 1776192602.74 total 299.53 last 144.89) - /unlink 41460 (time 1776192612.74 total 309.53 last 145.96) - /unlink 43105 (time 1776192622.75 total 319.54 last 164.35) - /unlink 44511 (time 1776192632.76 total 329.55 last 140.44) - /unlink 45616 (time 1776192642.76 total 339.55 last 110.49) - /unlink 46733 (time 1776192652.77 total 349.56 last 111.63) - /unlink 48038 (time 1776192662.77 total 359.56 last 130.48) - /unlink 49391 (time 1776192672.79 total 369.58 last 135.01) - /unlink 50000 (time 1776192678.24 total 375.03 last 111.88) - /unlink 51287 (time 1776192688.26 total 385.05 last 128.43) - /unlink 52294 (time 1776192698.26 total 395.05 last 100.66) - /unlink 53670 (time 1776192708.34 total 405.13 last 136.51) - /unlink 55071 (time 1776192718.34 total 415.13 last 140.05) - /unlink 56107 (time 1776192728.35 total 425.14 last 103.58) - /unlink 57453 (time 1776192738.35 total 435.14 last 134.60) - /unlink 58602 (time 1776192748.36 total 445.15 last 114.73) - /unlink 59978 (time 1776192758.37 total 455.16 last 137.54) - /unlink 61880 (time 1776192768.37 total 465.16 last 190.20) - /unlink 63299 (time 1776192778.37 total 475.16 last 141.90) - /unlink 64383 (time 1776192788.37 total 485.16 last 108.35) total: 64768 /unlink in 488.70 seconds: 132.53 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 462 (time 1776192827.76 total 10.01 last 46.17) - open/close 1313 (time 1776192837.77 total 20.01 last 85.05) - open/close 2164 (time 1776192847.77 total 30.02 last 85.05) - open/close 3045 (time 1776192857.78 total 40.02 last 88.09) - open/close 3714 (time 1776192867.79 total 50.03 last 66.82) - open/close 4501 (time 1776192877.79 total 60.03 last 78.67) - open/close 5300 (time 1776192887.80 total 70.04 last 79.84) - open/close 6194 (time 1776192897.80 total 80.05 last 89.36) - open/close 7072 (time 1776192907.81 total 90.06 last 87.70) - open/close 7966 (time 1776192917.82 total 100.07 last 89.30) - open/close 8874 (time 1776192927.83 total 110.07 last 90.76) - open/close 9743 (time 1776192937.84 total 120.08 last 86.84) - open/close 10000 (time 1776192940.47 total 122.72 last 97.43) - open/close 10937 (time 1776192950.48 total 132.73 last 93.61) - open/close 11822 (time 1776192960.50 total 142.74 last 88.36) - open/close 12497 (time 1776192970.52 total 152.76 last 67.38) - open/close 13134 (time 1776192980.53 total 162.78 last 63.60) - open/close 13912 (time 1776192990.53 total 172.78 last 77.78) - open/close 14561 (time 1776193000.54 total 182.78 last 64.88) - open/close 15316 (time 1776193010.55 total 192.79 last 75.43) - open/close 16100 (time 1776193020.56 total 202.80 last 78.33) - open/close 16759 (time 1776193030.56 total 212.80 last 65.86) - open/close 17518 (time 1776193040.57 total 222.81 last 75.86) - open/close 18339 (time 1776193050.57 total 232.82 last 82.05) - open/close 19191 (time 1776193060.58 total 242.82 last 85.17) - open/close 19937 (time 1776193070.58 total 252.82 last 74.59) - open/close 20936 (time 1776193080.59 total 262.83 last 99.76) - open/close 21933 (time 1776193090.59 total 272.84 last 99.66) - open/close 22897 (time 1776193100.63 total 282.87 last 96.11) - open/close 23778 (time 1776193110.63 total 292.87 last 88.07) - open/close 24700 (time 1776193120.64 total 302.88 last 92.14) - open/close 25614 (time 1776193130.64 total 312.88 last 91.37) - open/close 26479 (time 1776193140.64 total 322.88 last 86.49) - open/close 27362 (time 1776193150.65 total 332.89 last 88.19) - open/close 28154 (time 1776193160.66 total 342.90 last 79.17) - open/close 28952 (time 1776193170.66 total 352.90 last 79.79) - open/close 29748 (time 1776193180.66 total 362.91 last 79.54) - open/close 30000 (time 1776193183.48 total 365.73 last 89.38) - open/close 30969 (time 1776193193.49 total 375.74 last 96.80) - open/close 31953 (time 1776193203.50 total 385.74 last 98.40) - open/close 32903 (time 1776193213.50 total 395.74 last 94.96) - open/close 33807 (time 1776193223.51 total 405.75 last 90.33) - open/close 34641 (time 1776193233.51 total 415.75 last 83.40) - open/close 35519 (time 1776193243.51 total 425.75 last 87.79) - open/close 36178 (time 1776193253.53 total 435.77 last 65.79) - open/close 36963 (time 1776193263.53 total 445.77 last 78.49) - open/close 37727 (time 1776193273.55 total 455.79 last 76.25) - open/close 38421 (time 1776193283.55 total 465.79 last 69.37) - open/close 39195 (time 1776193293.56 total 475.80 last 77.33) - open/close 40000 (time 1776193303.01 total 485.25 last 85.17) - open/close 40864 (time 1776193313.02 total 495.26 last 86.35) - open/close 41733 (time 1776193323.02 total 505.26 last 86.89) - open/close 42704 (time 1776193333.02 total 515.26 last 97.08) - open/close 43566 (time 1776193343.02 total 525.27 last 86.18) - open/close 44404 (time 1776193353.03 total 535.27 last 83.77) - open/close 45122 (time 1776193363.03 total 545.28 last 71.74) - open/close 45805 (time 1776193373.03 total 555.28 last 68.30) - open/close 46594 (time 1776193383.04 total 565.29 last 78.84) - open/close 47427 (time 1776193393.05 total 575.29 last 83.26) - open/close 48259 (time 1776193403.05 total 585.30 last 83.15) - open/close 49063 (time 1776193413.06 total 595.30 last 80.37) - open/close 49980 (time 1776193423.06 total 605.31 last 91.65) - open/close 50939 (time 1776193433.07 total 615.31 last 95.86) - open/close 51747 (time 1776193443.07 total 625.32 last 80.75) - open/close 52695 (time 1776193453.07 total 635.32 last 94.79) - open/close 53533 (time 1776193463.07 total 645.32 last 83.80) - open/close 54294 (time 1776193473.08 total 655.33 last 76.02) - open/close 55174 (time 1776193483.09 total 665.33 last 87.99) - open/close 56056 (time 1776193493.09 total 675.34 last 88.14) - open/close 56903 (time 1776193503.09 total 685.34 last 84.68) - open/close 57670 (time 1776193513.10 total 695.35 last 76.62) - open/close 58541 (time 1776193523.11 total 705.35 last 87.07) - open/close 59388 (time 1776193533.11 total 715.36 last 84.65) - open/close 60000 (time 1776193541.53 total 723.78 last 72.69) - open/close 60737 (time 1776193551.68 total 733.92 last 72.67) - open/close 61445 (time 1776193561.68 total 743.92 last 70.80) - open/close 62322 (time 1776193571.68 total 753.92 last 87.69) - open/close 63122 (time 1776193581.68 total 763.93 last 79.95) - open/close 63787 (time 1776193591.69 total 773.94 last 66.43) - open/close 64443 (time 1776193601.70 total 783.94 last 65.58) total: 64768 open/close in 788.96 seconds: 82.09 ops/second - /unlink 1581 (time 1776193621.96 total 10.00 last 158.10) - /unlink 3044 (time 1776193631.96 total 20.00 last 146.23) - /unlink 4381 (time 1776193641.97 total 30.01 last 133.62) - /unlink 5764 (time 1776193651.97 total 40.02 last 138.21) - /unlink 6939 (time 1776193661.98 total 50.02 last 117.46) - /unlink 8153 (time 1776193671.98 total 60.02 last 121.38) - /unlink 9370 (time 1776193681.98 total 70.02 last 121.67) - /unlink 10000 (time 1776193686.70 total 74.74 last 133.52) - /unlink 11374 (time 1776193696.71 total 84.75 last 137.28) - /unlink 12634 (time 1776193706.72 total 94.76 last 125.90) - /unlink 13933 (time 1776193716.72 total 104.77 last 129.84) - /unlink 15236 (time 1776193726.72 total 114.77 last 130.27) - /unlink 16522 (time 1776193736.72 total 124.77 last 128.57) - /unlink 17862 (time 1776193746.73 total 134.78 last 133.91) - /unlink 19063 (time 1776193756.73 total 144.78 last 120.09) - /unlink 20000 (time 1776193764.53 total 152.58 last 120.13) - /unlink 21314 (time 1776193774.53 total 162.58 last 131.38) - /unlink 22641 (time 1776193784.54 total 172.58 last 132.66) - /unlink 23975 (time 1776193794.54 total 182.59 last 133.32) - /unlink 25399 (time 1776193804.54 total 192.59 last 142.40) - /unlink 26749 (time 1776193814.54 total 202.59 last 134.99) - /unlink 27926 (time 1776193824.54 total 212.59 last 117.70) - /unlink 29158 (time 1776193834.55 total 222.59 last 123.17) - /unlink 30000 (time 1776193840.31 total 228.35 last 146.11) - /unlink 31265 (time 1776193850.32 total 238.36 last 126.43) - /unlink 32656 (time 1776193860.32 total 248.36 last 139.08) - /unlink 34088 (time 1776193870.32 total 258.37 last 143.12) - /unlink 35526 (time 1776193880.32 total 268.37 last 143.78) - /unlink 36925 (time 1776193890.33 total 278.37 last 139.83) - /unlink 38363 (time 1776193900.33 total 288.38 last 143.77) - /unlink 39780 (time 1776193910.34 total 298.38 last 141.63) - /unlink 41127 (time 1776193920.34 total 308.38 last 134.70) - /unlink 42563 (time 1776193930.44 total 318.49 last 142.06) - /unlink 43985 (time 1776193940.45 total 328.49 last 142.13) - /unlink 45260 (time 1776193950.46 total 338.50 last 127.42) - /unlink 46490 (time 1776193960.46 total 348.50 last 122.97) - /unlink 47868 (time 1776193970.47 total 358.51 last 137.68) - /unlink 49197 (time 1776193980.47 total 368.52 last 132.81) - /unlink 50000 (time 1776193987.96 total 376.00 last 107.32) - /unlink 51385 (time 1776193997.96 total 386.01 last 138.45) - /unlink 52723 (time 1776194007.97 total 396.01 last 133.73) - /unlink 54162 (time 1776194017.98 total 406.02 last 143.73) - /unlink 55572 (time 1776194028.00 total 416.04 last 140.75) - /unlink 56850 (time 1776194038.03 total 426.07 last 127.42) - /unlink 58204 (time 1776194048.03 total 436.08 last 135.32) - /unlink 59606 (time 1776194058.04 total 446.08 last 140.14) - /unlink 60000 (time 1776194061.21 total 449.25 last 124.29) - /unlink 61359 (time 1776194071.21 total 459.26 last 135.83) - /unlink 62823 (time 1776194081.22 total 469.26 last 146.33) - /unlink 64065 (time 1776194091.22 total 479.26 last 124.20) total: 64768 /unlink in 484.94 seconds: 133.56 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg230-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg230-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg230-server stop mds service on oleg230-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg230-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy unloading modules on: 'oleg230-server' oleg230-server: oleg230-server.virtnet: executing unload_modules_local oleg230-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy oleg230-server: LNET ready to unload oleg230-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy modules unloaded. pdsh@oleg230-client: oleg230-client: ssh exited with exit code 2 pdsh@oleg230-client: oleg230-server: ssh exited with exit code 2 pdsh@oleg230-client: oleg230-client: ssh exited with exit code 2 pdsh@oleg230-client: oleg230-server: ssh exited with exit code 2