== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 14:45:44 (1764791144) Stopping clients: oleg351-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg351-client.virtnet /mnt/lustre2 (opts:-f) oleg351-server: oleg351-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg351-server' oleg351-server: oleg351-server.virtnet: executing load_modules_local oleg351-server: Loading modules from /home/green/git/lustre-release/lustre oleg351-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg351-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg351-server: detected 4 online CPUs by sysfs oleg351-server: MODOPTS_LIBCFS= oleg351-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg351-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg351-server: oleg351-server.virtnet: executing set_default_debug -1 all pdsh@oleg351-client: oleg351-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg351-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg351-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg351-server: oleg351-server.virtnet: executing set_default_debug -1 all pdsh@oleg351-client: oleg351-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg351-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg351-client.virtnet: -o user_xattr,flock 192.168.203.151@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 32648 392 32256 2% /mnt/lustre[OST:0] filesystem_summary: 32585 329 32256 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 800 (time 1764791235.18 total 10.01 last 79.91) - open/close 1580 (time 1764791245.18 total 20.02 last 77.97) - open/close 2420 (time 1764791255.20 total 30.03 last 83.88) - open/close 3160 (time 1764791265.20 total 40.04 last 73.94) - open/close 4016 (time 1764791275.21 total 50.04 last 85.58) - open/close 4957 (time 1764791285.21 total 60.05 last 94.03) - open/close 5998 (time 1764791295.22 total 70.05 last 104.08) - open/close 7419 (time 1764791305.22 total 80.05 last 142.07) - open/close 8484 (time 1764791315.22 total 90.05 last 106.47) - open/close 9546 (time 1764791325.23 total 100.06 last 106.14) - open/close 10000 (time 1764791332.62 total 107.46 last 61.38) - open/close 10476 (time 1764791342.62 total 117.46 last 47.59) - open/close 10908 (time 1764791352.62 total 127.46 last 43.20) - open/close 11375 (time 1764791362.64 total 137.48 last 46.60) - open/close 12068 (time 1764791372.65 total 147.48 last 69.27) - open/close 12827 (time 1764791382.65 total 157.48 last 75.89) - open/close 13594 (time 1764791392.65 total 167.49 last 76.66) - open/close 14398 (time 1764791402.66 total 177.50 last 80.32) - open/close 15405 (time 1764791412.67 total 187.50 last 100.67) - open/close 16629 (time 1764791422.67 total 197.51 last 122.33) - open/close 17994 (time 1764791432.68 total 207.52 last 136.36) - open/close 18946 (time 1764791442.69 total 217.52 last 95.13) - open/close 20000 (time 1764791451.42 total 226.25 last 120.72) - open/close 21481 (time 1764791461.42 total 236.26 last 148.09) - open/close 23012 (time 1764791471.43 total 246.26 last 153.03) - open/close 25083 (time 1764791481.43 total 256.26 last 207.04) - open/close 27327 (time 1764791491.43 total 266.26 last 224.34) - open/close 29029 (time 1764791501.44 total 276.27 last 170.12) - open/close 30000 (time 1764791508.07 total 282.90 last 146.48) - open/close 31678 (time 1764791518.07 total 292.90 last 167.76) - open/close 33901 (time 1764791528.08 total 302.91 last 222.10) - open/close 36259 (time 1764791538.08 total 312.91 last 235.79) - open/close 39523 (time 1764791548.08 total 322.91 last 326.34) - open/close 43126 (time 1764791558.08 total 332.91 last 360.22) - open/close 47113 (time 1764791568.08 total 342.92 last 398.70) - open/close 48887 (time 1764791578.09 total 352.93 last 177.18) - open/close 49756 (time 1764791588.09 total 362.93 last 86.90) - open/close 50000 (time 1764791590.56 total 365.40 last 98.89) - open/close 50928 (time 1764791600.58 total 375.42 last 92.61) - open/close 51753 (time 1764791610.59 total 385.42 last 82.46) - open/close 52624 (time 1764791620.59 total 395.43 last 87.04) - open/close 53355 (time 1764791630.61 total 405.44 last 73.02) - open/close 54083 (time 1764791640.62 total 415.45 last 72.72) - open/close 55021 (time 1764791650.62 total 425.46 last 93.75) - open/close 56038 (time 1764791660.62 total 435.46 last 101.69) - open/close 57386 (time 1764791670.63 total 445.46 last 134.72) - open/close 58293 (time 1764791680.64 total 455.47 last 90.64) - open/close 58834 (time 1764791690.64 total 465.47 last 54.09) - open/close 59516 (time 1764791700.65 total 475.48 last 68.13) - open/close 60000 (time 1764791709.10 total 483.94 last 57.24) - open/close 60612 (time 1764791719.11 total 493.95 last 61.13) - open/close 61219 (time 1764791729.12 total 503.95 last 60.67) - open/close 61976 (time 1764791739.13 total 513.96 last 75.63) - open/close 62732 (time 1764791749.13 total 523.96 last 75.57) - open/close 63473 (time 1764791759.13 total 533.97 last 74.08) - open/close 63981 (time 1764791769.14 total 543.97 last 50.79) - open/close 64467 (time 1764791779.16 total 554.00 last 48.46) total: 64768 open/close in 560.05 seconds: 115.65 ops/second - /unlink 1111 (time 1764791799.12 total 10.00 last 111.09) - /unlink 2157 (time 1764791809.12 total 20.01 last 104.56) - /unlink 3314 (time 1764791819.13 total 30.01 last 115.63) - /unlink 4416 (time 1764791829.13 total 40.01 last 110.20) - /unlink 5574 (time 1764791839.13 total 50.01 last 115.80) - /unlink 6688 (time 1764791849.13 total 60.01 last 111.37) - /unlink 7823 (time 1764791859.14 total 70.03 last 113.33) - /unlink 8940 (time 1764791869.15 total 80.04 last 111.62) - /unlink 10000 (time 1764791878.53 total 89.42 last 112.99) - /unlink 11123 (time 1764791888.54 total 99.42 last 112.27) - /unlink 12272 (time 1764791898.54 total 109.42 last 114.90) - /unlink 13549 (time 1764791908.54 total 119.43 last 127.60) - /unlink 14804 (time 1764791918.55 total 129.43 last 125.47) - /unlink 15919 (time 1764791928.57 total 139.46 last 111.23) - /unlink 17095 (time 1764791938.58 total 149.46 last 117.53) - /unlink 18245 (time 1764791948.59 total 159.47 last 114.88) - /unlink 19513 (time 1764791958.59 total 169.47 last 126.79) - /unlink 20000 (time 1764791962.45 total 173.33 last 126.27) - /unlink 21200 (time 1764791972.45 total 183.34 last 119.93) - /unlink 22314 (time 1764791982.46 total 193.34 last 111.35) - /unlink 23238 (time 1764791992.46 total 203.34 last 92.40) - /unlink 24252 (time 1764792002.46 total 213.35 last 101.35) - /unlink 25114 (time 1764792012.48 total 223.36 last 86.05) - /unlink 25882 (time 1764792022.49 total 233.38 last 76.69) - /unlink 26599 (time 1764792032.50 total 243.38 last 71.66) - /unlink 27384 (time 1764792042.50 total 253.39 last 78.46) - /unlink 28207 (time 1764792052.51 total 263.40 last 82.24) - /unlink 29389 (time 1764792062.51 total 273.40 last 118.17) - /unlink 30000 (time 1764792068.63 total 279.52 last 99.90) - /unlink 31045 (time 1764792078.65 total 289.53 last 104.30) - /unlink 32067 (time 1764792088.66 total 299.54 last 102.11) - /unlink 33093 (time 1764792098.66 total 309.55 last 102.57) - /unlink 34574 (time 1764792108.66 total 319.55 last 148.08) - /unlink 35850 (time 1764792118.67 total 329.55 last 127.53) - /unlink 36897 (time 1764792128.67 total 339.56 last 104.67) - /unlink 37899 (time 1764792138.73 total 349.62 last 99.60) - /unlink 38998 (time 1764792148.75 total 359.63 last 109.72) - /unlink 39726 (time 1764792158.75 total 369.64 last 72.77) - /unlink 40000 (time 1764792162.56 total 373.45 last 71.88) - /unlink 40686 (time 1764792172.58 total 383.46 last 68.50) - /unlink 41466 (time 1764792182.59 total 393.47 last 77.94) - /unlink 42170 (time 1764792192.60 total 403.49 last 70.28) - /unlink 42837 (time 1764792202.61 total 413.49 last 66.67) - /unlink 43544 (time 1764792212.62 total 423.50 last 70.64) - /unlink 44245 (time 1764792222.64 total 433.52 last 69.98) - /unlink 44900 (time 1764792232.65 total 443.53 last 65.41) - /unlink 45635 (time 1764792242.66 total 453.54 last 73.43) - /unlink 46385 (time 1764792252.66 total 463.55 last 74.96) - /unlink 47115 (time 1764792262.67 total 473.56 last 72.93) - /unlink 47846 (time 1764792272.68 total 483.57 last 73.03) - /unlink 48527 (time 1764792282.70 total 493.59 last 67.96) - /unlink 49246 (time 1764792292.73 total 503.62 last 71.71) - /unlink 49986 (time 1764792302.73 total 513.62 last 73.98) - /unlink 50650 (time 1764792312.73 total 523.62 last 66.40) - /unlink 51254 (time 1764792322.75 total 533.63 last 60.30) - /unlink 51721 (time 1764792332.77 total 543.66 last 46.60) - /unlink 52150 (time 1764792342.78 total 553.66 last 42.87) - /unlink 52625 (time 1764792352.78 total 563.67 last 47.48) - /unlink 53258 (time 1764792362.79 total 573.68 last 63.22) - /unlink 53778 (time 1764792372.81 total 583.69 last 51.94) - /unlink 54198 (time 1764792382.83 total 593.71 last 41.91) - /unlink 54662 (time 1764792392.85 total 603.73 last 46.30) - /unlink 55207 (time 1764792402.86 total 613.74 last 54.44) - /unlink 55784 (time 1764792412.87 total 623.75 last 57.64) - /unlink 56482 (time 1764792422.88 total 633.76 last 69.74) - /unlink 57203 (time 1764792432.89 total 643.77 last 72.03) - /unlink 57848 (time 1764792442.90 total 653.78 last 64.46) - /unlink 58468 (time 1764792452.91 total 663.79 last 61.93) - /unlink 59147 (time 1764792462.92 total 673.81 last 67.78) - /unlink 59813 (time 1764792472.93 total 683.82 last 66.53) - /unlink 60000 (time 1764792476.01 total 686.90 last 60.74) - /unlink 60728 (time 1764792486.02 total 696.91 last 72.73) - /unlink 61379 (time 1764792496.03 total 706.91 last 65.07) - /unlink 62077 (time 1764792506.04 total 716.92 last 69.74) - /unlink 62725 (time 1764792516.04 total 726.92 last 64.79) - /unlink 63400 (time 1764792526.04 total 736.93 last 67.45) - /unlink 64118 (time 1764792536.05 total 746.94 last 71.76) total: 64768 /unlink in 755.74 seconds: 85.70 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 719 (time 1764792578.67 total 10.00 last 71.89) - open/close 1452 (time 1764792588.67 total 20.00 last 73.30) - open/close 2169 (time 1764792598.68 total 30.01 last 71.64) - open/close 2914 (time 1764792608.69 total 40.03 last 74.38) - open/close 3663 (time 1764792618.70 total 50.03 last 74.85) - open/close 4409 (time 1764792628.70 total 60.03 last 74.59) - open/close 5159 (time 1764792638.71 total 70.04 last 74.96) - open/close 5772 (time 1764792648.72 total 80.05 last 61.25) - open/close 6266 (time 1764792658.73 total 90.06 last 49.33) - open/close 6893 (time 1764792668.73 total 100.06 last 62.70) - open/close 7478 (time 1764792678.73 total 110.06 last 58.49) - open/close 8085 (time 1764792688.74 total 120.07 last 60.66) - open/close 8754 (time 1764792698.74 total 130.07 last 66.89) - open/close 9439 (time 1764792708.74 total 140.07 last 68.50) - open/close 10000 (time 1764792716.93 total 148.26 last 68.51) - open/close 10659 (time 1764792726.93 total 158.26 last 65.89) - open/close 11260 (time 1764792736.93 total 168.26 last 60.08) - open/close 11862 (time 1764792746.96 total 178.29 last 60.03) - open/close 12484 (time 1764792756.97 total 188.30 last 62.15) - open/close 13073 (time 1764792766.98 total 198.31 last 58.84) - open/close 13636 (time 1764792776.99 total 208.32 last 56.22) - open/close 14318 (time 1764792786.99 total 218.33 last 68.19) - open/close 15060 (time 1764792797.01 total 228.34 last 74.07) - open/close 15817 (time 1764792807.02 total 238.35 last 75.63) - open/close 16598 (time 1764792817.03 total 248.36 last 78.04) - open/close 17370 (time 1764792827.05 total 258.38 last 77.05) - open/close 18183 (time 1764792837.06 total 268.39 last 81.21) - open/close 18911 (time 1764792847.06 total 278.39 last 72.79) - open/close 19684 (time 1764792857.06 total 288.40 last 77.26) - open/close 20000 (time 1764792861.11 total 292.44 last 78.18) - open/close 20811 (time 1764792871.11 total 302.45 last 81.03) - open/close 21611 (time 1764792881.12 total 312.45 last 79.95) - open/close 22321 (time 1764792891.14 total 322.47 last 70.90) - open/close 23052 (time 1764792901.15 total 332.48 last 73.01) - open/close 23806 (time 1764792911.16 total 342.49 last 75.31) - open/close 24479 (time 1764792921.17 total 352.50 last 67.26) - open/close 25218 (time 1764792931.17 total 362.50 last 73.89) - open/close 25948 (time 1764792941.18 total 372.51 last 72.91) - open/close 26613 (time 1764792951.19 total 382.52 last 66.42) - open/close 27218 (time 1764792961.20 total 392.53 last 60.46) - open/close 27879 (time 1764792971.20 total 402.53 last 66.07) - open/close 28456 (time 1764792981.22 total 412.55 last 57.60) - open/close 29118 (time 1764792991.24 total 422.57 last 66.08) - open/close 29797 (time 1764793001.24 total 432.57 last 67.88) - open/close 30000 (time 1764793004.37 total 435.70 last 64.82) - open/close 30579 (time 1764793014.37 total 445.70 last 57.89) - open/close 31237 (time 1764793024.38 total 455.71 last 65.74) - open/close 31856 (time 1764793034.39 total 465.72 last 61.87) - open/close 32512 (time 1764793044.39 total 475.73 last 65.55) - open/close 33228 (time 1764793054.41 total 485.74 last 71.52) - open/close 33967 (time 1764793064.42 total 495.75 last 73.81) - open/close 34731 (time 1764793074.42 total 505.75 last 76.38) - open/close 35416 (time 1764793084.42 total 515.76 last 68.47) - open/close 36115 (time 1764793094.44 total 525.77 last 69.82) - open/close 36720 (time 1764793104.44 total 535.77 last 60.47) - open/close 37310 (time 1764793114.46 total 545.79 last 58.91) - open/close 37851 (time 1764793124.48 total 555.82 last 53.95) - open/close 38441 (time 1764793134.49 total 565.82 last 58.95) - open/close 38925 (time 1764793144.50 total 575.83 last 48.38) - open/close 39278 (time 1764793154.51 total 585.84 last 35.26) - open/close 39675 (time 1764793164.52 total 595.86 last 39.64) - open/close 40000 (time 1764793173.10 total 604.43 last 37.91) - open/close 40395 (time 1764793183.13 total 614.46 last 39.38) - open/close 40799 (time 1764793193.14 total 624.47 last 40.36) - open/close 41217 (time 1764793203.34 total 634.68 last 40.95) - open/close 41538 (time 1764793213.36 total 644.69 last 32.04) - open/close 41763 (time 1764793223.36 total 654.70 last 22.49) - open/close 42051 (time 1764793233.36 total 664.70 last 28.80) - open/close 42477 (time 1764793243.37 total 674.70 last 42.60) - open/close 42971 (time 1764793253.37 total 684.70 last 49.36) - open/close 43606 (time 1764793263.38 total 694.71 last 63.48) - open/close 44408 (time 1764793273.38 total 704.71 last 80.17) - open/close 45434 (time 1764793283.39 total 714.73 last 102.46) - open/close 46580 (time 1764793293.40 total 724.73 last 114.56) - open/close 47812 (time 1764793303.40 total 734.73 last 123.18) - open/close 48851 (time 1764793313.40 total 744.74 last 103.84) - open/close 49736 (time 1764793323.41 total 754.75 last 88.42) - open/close 50000 (time 1764793326.34 total 757.68 last 90.09) - open/close 51008 (time 1764793336.34 total 767.68 last 100.79) - open/close 51994 (time 1764793346.35 total 777.68 last 98.53) - open/close 53051 (time 1764793356.36 total 787.69 last 105.64) - open/close 54198 (time 1764793366.36 total 797.69 last 114.66) - open/close 55377 (time 1764793376.36 total 807.69 last 117.89) - open/close 56794 (time 1764793386.36 total 817.70 last 141.68) - open/close 57814 (time 1764793396.36 total 827.70 last 101.99) - open/close 58667 (time 1764793406.37 total 837.70 last 85.28) - open/close 59531 (time 1764793416.37 total 847.71 last 86.33) - open/close 60000 (time 1764793421.43 total 852.76 last 92.86) - open/close 60915 (time 1764793431.43 total 862.76 last 91.49) - open/close 61785 (time 1764793441.44 total 872.77 last 86.93) - open/close 62710 (time 1764793451.44 total 882.77 last 92.44) - open/close 63499 (time 1764793461.45 total 892.78 last 78.87) - open/close 64322 (time 1764793471.45 total 902.78 last 82.28) total: 64768 open/close in 907.52 seconds: 71.37 ops/second - /unlink 911 (time 1764793488.96 total 10.00 last 91.07) - /unlink 1754 (time 1764793498.96 total 20.00 last 84.29) - /unlink 2599 (time 1764793508.97 total 30.02 last 84.38) - /unlink 3539 (time 1764793518.98 total 40.03 last 93.90) - /unlink 4525 (time 1764793528.98 total 50.03 last 98.60) - /unlink 5392 (time 1764793538.98 total 60.03 last 86.70) - /unlink 6342 (time 1764793548.99 total 70.03 last 94.98) - /unlink 7292 (time 1764793558.99 total 80.04 last 94.95) - /unlink 8228 (time 1764793568.99 total 90.04 last 93.58) - /unlink 9481 (time 1764793578.99 total 100.04 last 125.28) - /unlink 10000 (time 1764793583.30 total 104.34 last 120.67) - /unlink 11204 (time 1764793593.30 total 114.34 last 120.40) - /unlink 12399 (time 1764793603.30 total 124.35 last 119.45) - /unlink 13365 (time 1764793613.31 total 134.35 last 96.52) - /unlink 14239 (time 1764793623.32 total 144.36 last 87.35) - /unlink 15191 (time 1764793633.32 total 154.36 last 95.19) - /unlink 16185 (time 1764793643.32 total 164.37 last 99.36) - /unlink 17093 (time 1764793653.33 total 174.37 last 90.74) - /unlink 17979 (time 1764793663.33 total 184.37 last 88.57) - /unlink 18942 (time 1764793673.33 total 194.38 last 96.29) - /unlink 19848 (time 1764793683.34 total 204.38 last 90.54) - /unlink 20737 (time 1764793693.35 total 214.39 last 88.79) - /unlink 21994 (time 1764793703.36 total 224.40 last 125.59) - /unlink 23084 (time 1764793713.36 total 234.41 last 108.95) - /unlink 24161 (time 1764793723.36 total 244.41 last 107.68) - /unlink 25095 (time 1764793733.37 total 254.42 last 93.35) - /unlink 26218 (time 1764793743.37 total 264.42 last 112.29) - /unlink 27387 (time 1764793753.37 total 274.42 last 116.88) - /unlink 28426 (time 1764793763.38 total 284.42 last 103.87) - /unlink 29975 (time 1764793773.38 total 294.43 last 154.81) - /unlink 31199 (time 1764793783.39 total 304.43 last 122.32) - /unlink 32207 (time 1764793793.40 total 314.45 last 100.66) - /unlink 33349 (time 1764793803.41 total 324.45 last 114.14) - /unlink 34404 (time 1764793813.41 total 334.46 last 105.43) - /unlink 35519 (time 1764793823.42 total 344.46 last 111.45) - /unlink 36634 (time 1764793833.42 total 354.46 last 111.49) - /unlink 37917 (time 1764793843.42 total 364.46 last 128.29) - /unlink 39285 (time 1764793853.43 total 374.47 last 136.71) - /unlink 40000 (time 1764793858.81 total 379.86 last 132.77) - /unlink 41180 (time 1764793868.81 total 389.86 last 117.99) - /unlink 42378 (time 1764793878.82 total 399.86 last 119.73) - /unlink 43437 (time 1764793888.82 total 409.87 last 105.84) - /unlink 44637 (time 1764793898.83 total 419.87 last 119.97) - /unlink 45925 (time 1764793908.83 total 429.88 last 128.73) - /unlink 47281 (time 1764793918.83 total 439.88 last 135.60) - /unlink 48709 (time 1764793928.83 total 449.88 last 142.79) - /unlink 50000 (time 1764793937.79 total 458.83 last 144.18) - /unlink 51744 (time 1764793947.79 total 468.83 last 174.40) - /unlink 53147 (time 1764793957.79 total 478.83 last 140.26) - /unlink 54835 (time 1764793967.79 total 488.83 last 168.80) - /unlink 57255 (time 1764793977.79 total 498.84 last 241.88) - /unlink 59693 (time 1764793987.80 total 508.84 last 243.74) - /unlink 62198 (time 1764793997.80 total 518.84 last 250.44) - /unlink 64441 (time 1764794007.80 total 528.85 last 224.22) total: 64768 /unlink in 530.01 seconds: 122.20 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1383 (time 1764794041.31 total 10.00 last 138.23) - open/close 2837 (time 1764794051.31 total 20.01 last 145.39) - open/close 4253 (time 1764794061.31 total 30.01 last 141.53) - open/close 5650 (time 1764794071.32 total 40.01 last 139.66) - open/close 7311 (time 1764794081.32 total 50.01 last 166.09) - open/close 8955 (time 1764794091.32 total 60.02 last 164.29) - open/close 10000 (time 1764794097.76 total 66.46 last 162.32) - open/close 11529 (time 1764794107.77 total 76.46 last 152.83) - open/close 12931 (time 1764794117.77 total 86.47 last 140.16) - open/close 13836 (time 1764794127.77 total 96.47 last 90.45) - open/close 14692 (time 1764794137.78 total 106.47 last 85.57) - open/close 15564 (time 1764794147.79 total 116.48 last 87.12) - open/close 16285 (time 1764794157.79 total 126.49 last 72.04) - open/close 17357 (time 1764794167.80 total 136.50 last 107.16) - open/close 18549 (time 1764794177.80 total 146.50 last 119.17) - open/close 19885 (time 1764794187.80 total 156.50 last 133.57) - open/close 21210 (time 1764794197.81 total 166.50 last 132.46) - open/close 22546 (time 1764794207.81 total 176.51 last 133.56) - open/close 23849 (time 1764794217.81 total 186.51 last 130.29) - open/close 25274 (time 1764794227.81 total 196.51 last 142.45) - open/close 26756 (time 1764794237.82 total 206.51 last 148.17) - open/close 28351 (time 1764794247.82 total 216.52 last 159.44) - open/close 30000 (time 1764794257.29 total 225.99 last 174.15) - open/close 31221 (time 1764794267.29 total 235.99 last 122.09) - open/close 32220 (time 1764794277.30 total 246.00 last 99.79) - open/close 33193 (time 1764794287.30 total 256.00 last 97.26) - open/close 34375 (time 1764794297.31 total 266.00 last 118.18) - open/close 36160 (time 1764794307.31 total 276.00 last 178.48) - open/close 37971 (time 1764794317.31 total 286.01 last 181.02) - open/close 39780 (time 1764794327.31 total 296.01 last 180.86) - open/close 41613 (time 1764794337.32 total 306.02 last 183.16) - open/close 43849 (time 1764794347.32 total 316.02 last 223.59) - open/close 46349 (time 1764794357.32 total 326.02 last 249.92) - open/close 48307 (time 1764794367.33 total 336.02 last 195.75) - open/close 50000 (time 1764794373.13 total 341.83 last 291.62) - open/close 52418 (time 1764794383.13 total 351.83 last 241.77) - open/close 54905 (time 1764794393.14 total 361.83 last 248.65) - open/close 57370 (time 1764794403.14 total 371.84 last 246.47) - open/close 59466 (time 1764794413.14 total 381.84 last 209.51) - open/close 62406 (time 1764794423.14 total 391.84 last 293.98) total: 64768 open/close in 400.37 seconds: 161.77 ops/second - /unlink 5580 (time 1764794443.24 total 10.00 last 557.90) - /unlink 10000 (time 1764794453.22 total 19.98 last 442.83) - /unlink 14001 (time 1764794463.22 total 29.98 last 400.09) - /unlink 18077 (time 1764794473.22 total 39.98 last 407.54) - /unlink 20000 (time 1764794477.25 total 44.02 last 477.12) - /unlink 25358 (time 1764794487.25 total 54.02 last 535.72) - /unlink 30000 (time 1764794495.98 total 62.75 last 531.75) - /unlink 34282 (time 1764794505.98 total 72.75 last 428.17) - /unlink 38907 (time 1764794515.98 total 82.75 last 462.43) - /unlink 40000 (time 1764794518.09 total 84.86 last 517.81) - /unlink 44348 (time 1764794528.10 total 94.86 last 434.73) - /unlink 49333 (time 1764794538.10 total 104.86 last 498.45) - /unlink 55079 (time 1764794548.10 total 114.86 last 574.52) - /unlink 60000 (time 1764794557.58 total 124.34 last 519.02) total: 64768 /unlink in 133.64 seconds: 484.66 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 2925 (time 1764794597.03 total 10.00 last 292.50) - open/close 6245 (time 1764794607.03 total 20.00 last 331.93) - open/close 10000 (time 1764794617.01 total 29.98 last 376.53) - open/close 12138 (time 1764794627.02 total 39.99 last 213.59) - open/close 13168 (time 1764794637.02 total 49.99 last 102.92) - open/close 13995 (time 1764794647.04 total 60.00 last 82.61) - open/close 14662 (time 1764794657.05 total 70.01 last 66.63) - open/close 15304 (time 1764794667.07 total 80.04 last 64.03) - open/close 15888 (time 1764794677.11 total 90.08 last 58.21) - open/close 16485 (time 1764794687.11 total 100.08 last 59.66) - open/close 17294 (time 1764794697.12 total 110.08 last 80.87) - open/close 18132 (time 1764794707.12 total 120.09 last 83.76) - open/close 19029 (time 1764794717.12 total 130.09 last 89.68) - open/close 20000 (time 1764794726.68 total 139.64 last 101.64) - open/close 21026 (time 1764794736.68 total 149.64 last 102.60) - open/close 21905 (time 1764794746.69 total 159.66 last 87.77) - open/close 22796 (time 1764794756.70 total 169.66 last 89.05) - open/close 23698 (time 1764794766.70 total 179.67 last 90.15) - open/close 24230 (time 1764794776.73 total 189.70 last 53.04) - open/close 24730 (time 1764794786.75 total 199.72 last 49.92) - open/close 25331 (time 1764794796.76 total 209.72 last 60.04) - open/close 26110 (time 1764794806.76 total 219.73 last 77.90) - open/close 26921 (time 1764794816.76 total 229.73 last 81.06) - open/close 27753 (time 1764794826.77 total 239.73 last 83.17) - open/close 28603 (time 1764794836.78 total 249.75 last 84.89) - open/close 29434 (time 1764794846.79 total 259.76 last 83.03) - open/close 30000 (time 1764794853.45 total 266.42 last 84.94) - open/close 30925 (time 1764794863.45 total 276.42 last 92.48) - open/close 31757 (time 1764794873.46 total 286.43 last 83.10) - open/close 32538 (time 1764794883.47 total 296.44 last 78.05) - open/close 33382 (time 1764794893.49 total 306.45 last 84.27) - open/close 34193 (time 1764794903.49 total 316.45 last 81.09) - open/close 35019 (time 1764794913.49 total 326.46 last 82.53) - open/close 35838 (time 1764794923.50 total 336.46 last 81.89) - open/close 36681 (time 1764794933.52 total 346.48 last 84.12) - open/close 37445 (time 1764794943.52 total 356.49 last 76.34) - open/close 38534 (time 1764794953.53 total 366.50 last 108.86) - open/close 39647 (time 1764794963.53 total 376.50 last 111.29) - open/close 40000 (time 1764794966.58 total 379.54 last 115.85) - open/close 40993 (time 1764794976.58 total 389.55 last 99.29) - open/close 42157 (time 1764794986.58 total 399.55 last 116.34) - open/close 44074 (time 1764794996.59 total 409.56 last 191.61) - open/close 46264 (time 1764795006.59 total 419.56 last 218.92) - open/close 47841 (time 1764795016.60 total 429.57 last 157.50) - open/close 49173 (time 1764795026.61 total 439.58 last 133.12) - open/close 50000 (time 1764795032.68 total 445.65 last 136.28) - open/close 50894 (time 1764795042.69 total 455.66 last 89.31) - open/close 51647 (time 1764795052.69 total 465.66 last 75.25) - open/close 52297 (time 1764795062.70 total 475.67 last 64.96) - open/close 52943 (time 1764795072.71 total 485.68 last 64.50) - open/close 53638 (time 1764795082.73 total 495.69 last 69.41) - open/close 54361 (time 1764795092.74 total 505.71 last 72.22) - open/close 55045 (time 1764795102.74 total 515.71 last 68.37) - open/close 55879 (time 1764795112.75 total 525.72 last 83.31) - open/close 56685 (time 1764795122.76 total 535.73 last 80.53) - open/close 57476 (time 1764795132.76 total 545.73 last 79.08) - open/close 58239 (time 1764795142.77 total 555.74 last 76.26) - open/close 58830 (time 1764795152.77 total 565.74 last 59.08) - open/close 59503 (time 1764795162.77 total 575.74 last 67.29) - open/close 60000 (time 1764795168.94 total 581.91 last 80.59) - open/close 60825 (time 1764795178.94 total 591.91 last 82.50) - open/close 61575 (time 1764795188.94 total 601.91 last 74.99) - open/close 62364 (time 1764795198.95 total 611.91 last 78.87) - open/close 63128 (time 1764795208.95 total 621.92 last 76.34) - open/close 64000 (time 1764795218.96 total 631.93 last 87.12) total: 64768 open/close in 640.89 seconds: 101.06 ops/second - /unlink 816 (time 1764795240.93 total 10.00 last 81.59) - /unlink 1687 (time 1764795250.93 total 20.00 last 87.07) - /unlink 2578 (time 1764795260.94 total 30.01 last 89.05) - /unlink 3478 (time 1764795270.94 total 40.01 last 89.99) - /unlink 4284 (time 1764795280.94 total 50.02 last 80.54) - /unlink 5040 (time 1764795290.95 total 60.02 last 75.57) - /unlink 5900 (time 1764795300.95 total 70.02 last 85.99) - /unlink 6769 (time 1764795310.97 total 80.04 last 86.75) - /unlink 7563 (time 1764795320.97 total 90.04 last 79.38) - /unlink 8389 (time 1764795330.97 total 100.05 last 82.57) - /unlink 9250 (time 1764795340.99 total 110.07 last 85.94) - /unlink 10000 (time 1764795349.91 total 118.99 last 84.09) - /unlink 10861 (time 1764795359.93 total 129.01 last 85.89) - /unlink 11714 (time 1764795369.94 total 139.01 last 85.26) - /unlink 12553 (time 1764795379.95 total 149.02 last 83.83) - /unlink 13336 (time 1764795389.95 total 159.03 last 78.25) - /unlink 14172 (time 1764795399.95 total 169.03 last 83.59) - /unlink 14994 (time 1764795409.96 total 179.04 last 82.14) - /unlink 15860 (time 1764795419.97 total 189.04 last 86.55) - /unlink 16696 (time 1764795429.97 total 199.05 last 83.55) - /unlink 17562 (time 1764795439.99 total 209.06 last 86.50) - /unlink 18344 (time 1764795449.99 total 219.06 last 78.18) - /unlink 19102 (time 1764795459.99 total 229.07 last 75.76) - /unlink 19968 (time 1764795470.00 total 239.07 last 86.55) - /unlink 20843 (time 1764795480.01 total 249.08 last 87.41) - /unlink 21799 (time 1764795490.02 total 259.10 last 95.47) - /unlink 22605 (time 1764795500.03 total 269.11 last 80.55) - /unlink 23442 (time 1764795510.05 total 279.12 last 83.57) - /unlink 24243 (time 1764795520.06 total 289.14 last 79.96) - /unlink 25063 (time 1764795530.09 total 299.16 last 81.79) - /unlink 25900 (time 1764795540.10 total 309.18 last 83.59) - /unlink 26728 (time 1764795550.11 total 319.18 last 82.76) - /unlink 27577 (time 1764795560.11 total 329.18 last 84.90) - /unlink 28375 (time 1764795570.12 total 339.19 last 79.72) - /unlink 29142 (time 1764795580.13 total 349.20 last 76.63) - /unlink 29933 (time 1764795590.13 total 359.21 last 79.06) - /unlink 30792 (time 1764795600.14 total 369.22 last 85.82) - /unlink 31600 (time 1764795610.15 total 379.23 last 80.70) - /unlink 32399 (time 1764795620.16 total 389.23 last 79.87) - /unlink 33206 (time 1764795630.16 total 399.23 last 80.69) - /unlink 34050 (time 1764795640.17 total 409.24 last 84.31) - /unlink 34882 (time 1764795650.18 total 419.25 last 83.13) - /unlink 35711 (time 1764795660.19 total 429.27 last 82.79) - /unlink 36596 (time 1764795670.20 total 439.27 last 88.44) - /unlink 37391 (time 1764795680.21 total 449.28 last 79.45) - /unlink 38237 (time 1764795690.21 total 459.29 last 84.53) - /unlink 38984 (time 1764795700.23 total 469.30 last 74.60) - /unlink 39755 (time 1764795710.24 total 479.31 last 77.02) - /unlink 40000 (time 1764795713.44 total 482.52 last 76.38) - /unlink 40721 (time 1764795723.45 total 492.53 last 72.05) - /unlink 41436 (time 1764795733.46 total 502.54 last 71.42) - /unlink 42250 (time 1764795743.47 total 512.54 last 81.38) - /unlink 43056 (time 1764795753.47 total 522.54 last 80.58) - /unlink 43820 (time 1764795763.47 total 532.55 last 76.39) - /unlink 44622 (time 1764795773.54 total 542.62 last 79.62) - /unlink 45449 (time 1764795783.55 total 552.62 last 82.66) - /unlink 46301 (time 1764795793.56 total 562.63 last 85.11) - /unlink 47201 (time 1764795803.56 total 572.64 last 89.97) - /unlink 48123 (time 1764795813.57 total 582.64 last 92.14) - /unlink 48898 (time 1764795823.57 total 592.65 last 77.46) - /unlink 49687 (time 1764795833.59 total 602.66 last 78.80) - /unlink 50000 (time 1764795837.31 total 606.38 last 84.07) - /unlink 50831 (time 1764795847.31 total 616.39 last 83.07) - /unlink 51699 (time 1764795857.33 total 626.40 last 86.69) - /unlink 52416 (time 1764795867.34 total 636.41 last 71.62) - /unlink 53096 (time 1764795877.35 total 646.42 last 67.94) - /unlink 53763 (time 1764795887.35 total 656.43 last 66.66) - /unlink 54554 (time 1764795897.36 total 666.43 last 79.06) - /unlink 55336 (time 1764795907.36 total 676.43 last 78.18) - /unlink 56121 (time 1764795917.36 total 686.44 last 78.48) - /unlink 56935 (time 1764795927.37 total 696.45 last 81.31) - /unlink 57754 (time 1764795937.38 total 706.45 last 81.84) - /unlink 58571 (time 1764795947.38 total 716.46 last 81.67) - /unlink 59380 (time 1764795957.39 total 726.46 last 80.87) - /unlink 60000 (time 1764795964.95 total 734.03 last 81.95) - /unlink 60856 (time 1764795974.96 total 744.04 last 85.54) - /unlink 61741 (time 1764795984.97 total 754.04 last 88.46) - /unlink 62656 (time 1764795994.98 total 764.05 last 91.41) - /unlink 63498 (time 1764796004.98 total 774.06 last 84.14) - /unlink 64465 (time 1764796014.99 total 784.06 last 96.62) total: 64768 /unlink in 787.19 seconds: 82.28 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 876 (time 1764796047.43 total 10.01 last 87.52) - open/close 1708 (time 1764796057.43 total 20.01 last 83.17) - open/close 2583 (time 1764796067.44 total 30.01 last 87.49) - open/close 3414 (time 1764796077.46 total 40.04 last 82.91) - open/close 4275 (time 1764796087.46 total 50.04 last 86.08) - open/close 5098 (time 1764796097.47 total 60.04 last 82.26) - open/close 5935 (time 1764796107.47 total 70.05 last 83.68) - open/close 6809 (time 1764796117.47 total 80.05 last 87.39) - open/close 7701 (time 1764796127.48 total 90.06 last 89.14) - open/close 8537 (time 1764796137.48 total 100.06 last 83.54) - open/close 9435 (time 1764796147.49 total 110.06 last 89.77) - open/close 10000 (time 1764796153.55 total 116.13 last 93.20) - open/close 10890 (time 1764796163.56 total 126.14 last 88.88) - open/close 11825 (time 1764796173.57 total 136.14 last 93.46) - open/close 12678 (time 1764796183.57 total 146.15 last 85.27) - open/close 13455 (time 1764796193.58 total 156.15 last 77.65) - open/close 14135 (time 1764796203.58 total 166.16 last 67.98) - open/close 14739 (time 1764796213.59 total 176.16 last 60.36) - open/close 15446 (time 1764796223.59 total 186.16 last 70.70) - open/close 16260 (time 1764796233.61 total 196.18 last 81.24) - open/close 17017 (time 1764796243.61 total 206.19 last 75.66) - open/close 17860 (time 1764796253.62 total 216.20 last 84.24) - open/close 18694 (time 1764796263.62 total 226.20 last 83.40) - open/close 19540 (time 1764796273.62 total 236.20 last 84.55) - open/close 20000 (time 1764796279.73 total 242.31 last 75.35) - open/close 20882 (time 1764796289.73 total 252.31 last 88.15) - open/close 21731 (time 1764796299.74 total 262.32 last 84.85) - open/close 22585 (time 1764796309.75 total 272.33 last 85.31) - open/close 23375 (time 1764796319.76 total 282.34 last 78.94) - open/close 24243 (time 1764796329.76 total 292.34 last 86.74) - open/close 25131 (time 1764796339.77 total 302.34 last 88.78) - open/close 26049 (time 1764796349.78 total 312.36 last 91.70) - open/close 26919 (time 1764796359.78 total 322.36 last 86.98) - open/close 27730 (time 1764796369.78 total 332.36 last 81.07) - open/close 28601 (time 1764796379.80 total 342.38 last 86.97) - open/close 29451 (time 1764796389.80 total 352.38 last 85.00) - open/close 30000 (time 1764796396.05 total 358.63 last 87.76) - open/close 30834 (time 1764796406.06 total 368.64 last 83.35) - open/close 31702 (time 1764796416.06 total 378.64 last 86.76) - open/close 32525 (time 1764796426.07 total 388.65 last 82.26) - open/close 33387 (time 1764796436.08 total 398.66 last 86.10) - open/close 34193 (time 1764796446.10 total 408.68 last 80.41) - open/close 34924 (time 1764796456.11 total 418.69 last 73.02) - open/close 35694 (time 1764796466.12 total 428.69 last 76.99) - open/close 36454 (time 1764796476.13 total 438.71 last 75.92) - open/close 37230 (time 1764796486.13 total 448.71 last 77.59) - open/close 38020 (time 1764796496.14 total 458.72 last 78.93) - open/close 38829 (time 1764796506.15 total 468.73 last 80.81) - open/close 39665 (time 1764796516.16 total 478.73 last 83.53) - open/close 40000 (time 1764796520.14 total 482.72 last 84.08) - open/close 40869 (time 1764796530.14 total 492.72 last 86.88) - open/close 41682 (time 1764796540.15 total 502.73 last 81.26) - open/close 42473 (time 1764796550.15 total 512.73 last 79.07) - open/close 43272 (time 1764796560.18 total 522.76 last 79.68) - open/close 44068 (time 1764796570.19 total 532.76 last 79.55) - open/close 44861 (time 1764796580.19 total 542.77 last 79.27) - open/close 45645 (time 1764796590.19 total 552.77 last 78.40) - open/close 46375 (time 1764796600.20 total 562.77 last 72.96) - open/close 47116 (time 1764796610.20 total 572.78 last 74.05) - open/close 47888 (time 1764796620.22 total 582.79 last 77.10) - open/close 48672 (time 1764796630.22 total 592.80 last 78.37) - open/close 49425 (time 1764796640.23 total 602.81 last 75.24) - open/close 50000 (time 1764796648.09 total 610.67 last 73.16) - open/close 50762 (time 1764796658.10 total 620.68 last 76.11) - open/close 51525 (time 1764796668.11 total 630.68 last 76.25) - open/close 52284 (time 1764796678.12 total 640.70 last 75.77) - open/close 52867 (time 1764796688.13 total 650.71 last 58.26) - open/close 53592 (time 1764796698.14 total 660.71 last 72.46) - open/close 54329 (time 1764796708.14 total 670.72 last 73.64) - open/close 55056 (time 1764796718.15 total 680.73 last 72.61) - open/close 55818 (time 1764796728.16 total 690.74 last 76.14) - open/close 56621 (time 1764796738.18 total 700.75 last 80.20) - open/close 57425 (time 1764796748.18 total 710.76 last 80.37) - open/close 58182 (time 1764796758.18 total 720.76 last 75.67) - open/close 58999 (time 1764796768.20 total 730.77 last 81.60) - open/close 59703 (time 1764796778.20 total 740.78 last 70.38) - open/close 60000 (time 1764796782.11 total 744.69 last 75.97) - open/close 60662 (time 1764796792.11 total 754.69 last 66.17) - open/close 61229 (time 1764796802.12 total 764.70 last 56.63) - open/close 61895 (time 1764796812.13 total 774.71 last 66.59) - open/close 62571 (time 1764796822.13 total 784.71 last 67.59) - open/close 63349 (time 1764796832.13 total 794.71 last 77.77) - open/close 64193 (time 1764796842.15 total 804.73 last 84.28) total: 64768 open/close in 811.52 seconds: 79.81 ops/second - /unlink 817 (time 1764796862.40 total 10.00 last 81.66) - /unlink 1649 (time 1764796872.41 total 20.01 last 83.17) - /unlink 2478 (time 1764796882.41 total 30.01 last 82.90) - /unlink 3330 (time 1764796892.41 total 40.01 last 85.19) - /unlink 4157 (time 1764796902.41 total 50.01 last 82.68) - /unlink 4925 (time 1764796912.41 total 60.02 last 76.76) - /unlink 5680 (time 1764796922.43 total 70.03 last 75.40) - /unlink 6472 (time 1764796932.44 total 80.04 last 79.10) - /unlink 7292 (time 1764796942.45 total 90.05 last 81.94) - /unlink 8067 (time 1764796952.46 total 100.06 last 77.42) - /unlink 8830 (time 1764796962.48 total 110.08 last 76.16) - /unlink 9556 (time 1764796972.50 total 120.10 last 72.46) - /unlink 10000 (time 1764796978.17 total 125.77 last 78.28) - /unlink 10777 (time 1764796988.18 total 135.78 last 77.60) - /unlink 11511 (time 1764796998.18 total 145.78 last 73.40) - /unlink 12312 (time 1764797008.19 total 155.79 last 80.03) - /unlink 13087 (time 1764797018.19 total 165.79 last 77.50) - /unlink 13826 (time 1764797028.20 total 175.80 last 73.83) - /unlink 14589 (time 1764797038.20 total 185.80 last 76.28) - /unlink 15364 (time 1764797048.20 total 195.81 last 77.49) - /unlink 16157 (time 1764797058.21 total 205.81 last 79.27) - /unlink 16927 (time 1764797068.21 total 215.81 last 76.96) - /unlink 17716 (time 1764797078.21 total 225.81 last 78.90) - /unlink 18506 (time 1764797088.21 total 235.82 last 78.97) - /unlink 19293 (time 1764797098.22 total 245.82 last 78.66) - /unlink 20000 (time 1764797107.05 total 254.65 last 80.08) - /unlink 20812 (time 1764797117.07 total 264.67 last 81.02) - /unlink 21575 (time 1764797127.08 total 274.68 last 76.26) - /unlink 22362 (time 1764797137.09 total 284.70 last 78.56) - /unlink 23180 (time 1764797147.10 total 294.70 last 81.75) - /unlink 23994 (time 1764797157.10 total 304.71 last 81.37) - /unlink 24836 (time 1764797167.11 total 314.71 last 84.18) - /unlink 25675 (time 1764797177.11 total 324.71 last 83.88) - /unlink 26599 (time 1764797187.11 total 334.71 last 92.39) - /unlink 27444 (time 1764797197.12 total 344.72 last 84.43) - /unlink 28221 (time 1764797207.12 total 354.73 last 77.65) - /unlink 29027 (time 1764797217.13 total 364.73 last 80.58) - /unlink 29870 (time 1764797227.13 total 374.73 last 84.28) - /unlink 30690 (time 1764797237.14 total 384.74 last 81.95) - /unlink 31481 (time 1764797247.15 total 394.75 last 79.02) - /unlink 32328 (time 1764797257.15 total 404.76 last 84.64) - /unlink 33154 (time 1764797267.16 total 414.76 last 82.53) - /unlink 34003 (time 1764797277.18 total 424.78 last 84.76) - /unlink 34875 (time 1764797287.18 total 434.78 last 87.19) - /unlink 35679 (time 1764797297.19 total 444.79 last 80.36) - /unlink 36517 (time 1764797307.19 total 454.79 last 83.75) - /unlink 37380 (time 1764797317.19 total 464.79 last 86.30) - /unlink 38257 (time 1764797327.21 total 474.82 last 87.51) - /unlink 39061 (time 1764797337.24 total 484.84 last 80.21) - /unlink 39862 (time 1764797347.25 total 494.85 last 80.02) - /unlink 40718 (time 1764797357.25 total 504.86 last 85.53) - /unlink 41614 (time 1764797367.26 total 514.86 last 89.55) - /unlink 42513 (time 1764797377.27 total 524.88 last 89.79) - /unlink 43361 (time 1764797387.28 total 534.88 last 84.76) - /unlink 44194 (time 1764797397.29 total 544.90 last 83.18) - /unlink 44935 (time 1764797407.30 total 554.90 last 74.07) - /unlink 45790 (time 1764797417.31 total 564.92 last 85.36) - /unlink 46565 (time 1764797427.32 total 574.93 last 77.43) - /unlink 47401 (time 1764797437.34 total 584.94 last 83.47) - /unlink 48297 (time 1764797447.34 total 594.94 last 89.59) - /unlink 49234 (time 1764797457.34 total 604.94 last 93.68) - /unlink 50000 (time 1764797466.61 total 614.22 last 82.63) - /unlink 50825 (time 1764797476.62 total 624.22 last 82.46) - /unlink 51615 (time 1764797486.62 total 634.22 last 78.97) - /unlink 52486 (time 1764797496.62 total 644.23 last 87.07) - /unlink 53329 (time 1764797506.64 total 654.24 last 84.21) - /unlink 54243 (time 1764797516.64 total 664.24 last 91.38) - /unlink 55069 (time 1764797526.64 total 674.24 last 82.60) - /unlink 55886 (time 1764797536.64 total 684.25 last 81.64) - /unlink 56624 (time 1764797546.65 total 694.26 last 73.74) - /unlink 57437 (time 1764797556.66 total 704.27 last 81.21) - /unlink 58275 (time 1764797566.67 total 714.28 last 83.72) - /unlink 59093 (time 1764797576.68 total 724.28 last 81.78) - /unlink 59897 (time 1764797586.68 total 734.29 last 80.35) - /unlink 60712 (time 1764797596.69 total 744.29 last 81.44) - /unlink 61439 (time 1764797606.69 total 754.30 last 72.68) - /unlink 62260 (time 1764797616.70 total 764.30 last 82.03) - /unlink 63140 (time 1764797626.70 total 774.31 last 87.98) - /unlink 63929 (time 1764797636.71 total 784.31 last 78.86) - /unlink 64722 (time 1764797646.72 total 794.32 last 79.21) total: 64768 /unlink in 794.93 seconds: 81.48 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg351-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg351-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg351-server stop mds service on oleg351-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg351-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg351-server' oleg351-server: oleg351-server.virtnet: executing unload_modules_local oleg351-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg351-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg351-client: oleg351-client: ssh exited with exit code 2 pdsh@oleg351-client: oleg351-server: ssh exited with exit code 2 pdsh@oleg351-client: oleg351-server: ssh exited with exit code 2 pdsh@oleg351-client: oleg351-client: ssh exited with exit code 2