== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 23:35:02 (1733805302) Stopping clients: oleg307-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg307-client.virtnet /mnt/lustre2 (opts:-f) oleg307-server: oleg307-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg307-server' oleg307-server: oleg307-server.virtnet: executing load_modules_local oleg307-server: Loading modules from /home/green/git/lustre-release/lustre oleg307-server: detected 4 online CPUs by sysfs oleg307-server: MODOPTS_LIBCFS= oleg307-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg307-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg307-server: oleg307-server.virtnet: executing set_default_debug -1 all pdsh@oleg307-client: oleg307-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg307-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg307-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg307-server: oleg307-server.virtnet: executing set_default_debug -1 all pdsh@oleg307-client: oleg307-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg307-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg307-client.virtnet: -o user_xattr,flock 192.168.203.107@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86866 330 86536 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 16134 326 15808 3% /mnt/lustre[OST:0] filesystem_summary: 16138 330 15808 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 1497 (time 1733805362.05 total 10.01 last 149.61) - open/close 3216 (time 1733805372.05 total 20.01 last 171.86) - open/close 4802 (time 1733805382.06 total 30.01 last 158.54) - open/close 6621 (time 1733805392.06 total 40.01 last 181.87) - open/close 8882 (time 1733805402.06 total 50.01 last 226.07) - open/close 10000 (time 1733805407.51 total 55.46 last 205.16) - open/close 11671 (time 1733805417.51 total 65.47 last 167.03) - open/close 13363 (time 1733805427.52 total 75.47 last 169.12) - open/close 15057 (time 1733805437.52 total 85.47 last 169.39) - open/close 16739 (time 1733805447.53 total 95.48 last 168.09) - open/close 18359 (time 1733805457.53 total 105.49 last 161.92) - open/close 20000 (time 1733805466.67 total 114.62 last 179.59) - open/close 21545 (time 1733805476.67 total 124.63 last 154.46) - open/close 23287 (time 1733805486.68 total 134.63 last 174.10) - open/close 24875 (time 1733805496.68 total 144.64 last 158.73) - open/close 26511 (time 1733805506.69 total 154.64 last 163.54) - open/close 28244 (time 1733805516.69 total 164.64 last 173.26) - open/close 30000 (time 1733805526.19 total 174.15 last 184.74) - open/close 31797 (time 1733805536.20 total 184.15 last 179.67) - open/close 33624 (time 1733805546.21 total 194.16 last 182.50) - open/close 35158 (time 1733805556.21 total 204.16 last 153.39) - open/close 36792 (time 1733805566.21 total 214.16 last 163.38) - open/close 38498 (time 1733805576.21 total 224.16 last 170.57) - open/close 40000 (time 1733805584.82 total 232.77 last 174.48) - open/close 41935 (time 1733805594.82 total 242.78 last 193.42) - open/close 43828 (time 1733805604.87 total 252.82 last 188.42) - open/close 45814 (time 1733805614.87 total 262.82 last 198.57) - open/close 47900 (time 1733805624.87 total 272.83 last 208.55) - open/close 50000 (time 1733805634.10 total 282.05 last 227.68) - open/close 52086 (time 1733805644.10 total 292.05 last 208.58) - open/close 54112 (time 1733805654.10 total 302.05 last 202.58) - open/close 56152 (time 1733805664.10 total 312.05 last 203.94) - open/close 58051 (time 1733805674.10 total 322.05 last 189.88) - open/close 59786 (time 1733805684.10 total 332.06 last 173.50) - open/close 61606 (time 1733805694.10 total 342.06 last 181.98) - open/close 63395 (time 1733805704.10 total 352.06 last 178.87) total: 64768 open/close in 359.11 seconds: 180.36 ops/second - /unlink 3669 (time 1733805722.45 total 10.00 last 366.85) - /unlink 6925 (time 1733805732.45 total 20.00 last 325.58) - /unlink 10000 (time 1733805741.99 total 29.54 last 322.39) - /unlink 13472 (time 1733805751.99 total 39.54 last 347.12) - /unlink 17052 (time 1733805762.00 total 49.55 last 357.89) - /unlink 20000 (time 1733805771.18 total 58.73 last 321.05) - /unlink 23584 (time 1733805781.18 total 68.73 last 358.34) - /unlink 26960 (time 1733805791.18 total 78.73 last 337.55) - /unlink 30000 (time 1733805799.69 total 87.24 last 357.33) - /unlink 33487 (time 1733805809.69 total 97.24 last 348.69) - /unlink 36783 (time 1733805819.69 total 107.24 last 329.53) - /unlink 39436 (time 1733805829.69 total 117.24 last 265.26) - /unlink 42635 (time 1733805839.69 total 127.24 last 319.89) - /unlink 45576 (time 1733805849.70 total 137.25 last 294.01) - /unlink 48522 (time 1733805859.70 total 147.25 last 294.56) - /unlink 50000 (time 1733805863.58 total 151.13 last 380.96) - /unlink 54718 (time 1733805873.58 total 161.13 last 471.76) - /unlink 58934 (time 1733805883.58 total 171.13 last 421.52) - /unlink 60000 (time 1733805886.26 total 173.81 last 397.64) - /unlink 63706 (time 1733805896.26 total 183.81 last 370.58) total: 64768 /unlink in 186.71 seconds: 346.89 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1732 (time 1733805927.73 total 10.00 last 173.13) - open/close 3405 (time 1733805937.73 total 20.00 last 167.29) - open/close 5351 (time 1733805947.73 total 30.00 last 194.59) - open/close 7169 (time 1733805957.73 total 40.01 last 181.74) - open/close 8993 (time 1733805967.73 total 50.01 last 182.39) - open/close 10000 (time 1733805973.14 total 55.41 last 186.37) - open/close 11709 (time 1733805983.14 total 65.42 last 170.83) - open/close 13320 (time 1733805993.15 total 75.42 last 161.05) - open/close 15046 (time 1733806003.15 total 85.42 last 172.60) - open/close 16709 (time 1733806013.15 total 95.42 last 166.25) - open/close 18160 (time 1733806023.16 total 105.43 last 144.99) - open/close 19600 (time 1733806033.16 total 115.43 last 143.94) - open/close 20000 (time 1733806035.29 total 117.56 last 187.85) - open/close 21616 (time 1733806045.29 total 127.57 last 161.51) - open/close 23282 (time 1733806055.30 total 137.57 last 166.55) - open/close 25118 (time 1733806065.30 total 147.57 last 183.56) - open/close 26792 (time 1733806075.30 total 157.58 last 167.35) - open/close 28467 (time 1733806085.30 total 167.58 last 167.47) - open/close 30000 (time 1733806094.07 total 176.35 last 174.84) - open/close 31884 (time 1733806104.07 total 186.35 last 188.38) - open/close 33985 (time 1733806114.08 total 196.35 last 209.97) - open/close 36038 (time 1733806124.08 total 206.35 last 205.30) - open/close 37887 (time 1733806134.08 total 216.36 last 184.88) - open/close 39569 (time 1733806144.08 total 226.36 last 168.20) - open/close 40000 (time 1733806146.83 total 229.10 last 157.07) - open/close 41719 (time 1733806156.83 total 239.10 last 171.85) - open/close 43832 (time 1733806166.83 total 249.11 last 211.22) - open/close 45748 (time 1733806176.84 total 259.11 last 191.49) - open/close 47580 (time 1733806186.84 total 269.12 last 183.11) - open/close 49098 (time 1733806196.84 total 279.12 last 151.77) - open/close 50000 (time 1733806202.75 total 285.03 last 152.63) - open/close 51726 (time 1733806212.76 total 295.03 last 172.58) - open/close 53580 (time 1733806222.76 total 305.03 last 185.39) - open/close 55152 (time 1733806232.76 total 315.03 last 157.17) - open/close 56854 (time 1733806242.76 total 325.03 last 170.17) - open/close 58525 (time 1733806252.76 total 335.04 last 167.03) - open/close 60000 (time 1733806262.52 total 344.79 last 151.22) - open/close 61496 (time 1733806272.52 total 354.80 last 149.54) - open/close 63352 (time 1733806282.52 total 364.80 last 185.54) total: 64768 open/close in 372.90 seconds: 173.69 ops/second - /unlink 2644 (time 1733806302.09 total 10.00 last 264.36) - /unlink 5530 (time 1733806312.10 total 20.00 last 288.52) - /unlink 8276 (time 1733806322.10 total 30.01 last 274.46) - /unlink 10000 (time 1733806329.81 total 37.72 last 223.61) - /unlink 12133 (time 1733806339.81 total 47.72 last 213.27) - /unlink 14460 (time 1733806349.82 total 57.72 last 232.63) - /unlink 16737 (time 1733806359.82 total 67.73 last 227.61) - /unlink 18858 (time 1733806369.82 total 77.73 last 212.02) - /unlink 20000 (time 1733806374.96 total 82.86 last 222.58) - /unlink 22240 (time 1733806384.96 total 92.87 last 223.92) - /unlink 24116 (time 1733806394.96 total 102.87 last 187.54) - /unlink 25963 (time 1733806404.97 total 112.87 last 184.61) - /unlink 28545 (time 1733806414.97 total 122.88 last 258.17) - /unlink 30000 (time 1733806419.43 total 127.34 last 326.04) - /unlink 33046 (time 1733806429.43 total 137.34 last 304.55) - /unlink 35794 (time 1733806439.43 total 147.34 last 274.78) - /unlink 38955 (time 1733806449.43 total 157.34 last 316.07) - /unlink 40000 (time 1733806453.09 total 160.99 last 286.05) - /unlink 42682 (time 1733806463.09 total 171.00 last 268.18) - /unlink 45946 (time 1733806473.09 total 181.00 last 326.38) - /unlink 48899 (time 1733806483.09 total 191.00 last 295.28) - /unlink 50000 (time 1733806487.31 total 195.21 last 261.01) - /unlink 52612 (time 1733806497.32 total 205.23 last 260.81) - /unlink 55205 (time 1733806507.32 total 215.23 last 259.29) - /unlink 57776 (time 1733806517.33 total 225.23 last 257.02) - /unlink 60000 (time 1733806524.83 total 232.74 last 296.43) - /unlink 63178 (time 1733806534.83 total 242.74 last 317.76) total: 64768 /unlink in 249.02 seconds: 260.09 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1512 (time 1733806567.87 total 10.01 last 151.08) - open/close 3022 (time 1733806577.88 total 20.01 last 150.94) - open/close 4553 (time 1733806587.88 total 30.01 last 153.08) - open/close 6097 (time 1733806597.88 total 40.02 last 154.33) - open/close 7845 (time 1733806607.89 total 50.02 last 174.73) - open/close 9507 (time 1733806617.89 total 60.03 last 166.16) - open/close 10000 (time 1733806621.08 total 63.22 last 154.33) - open/close 11883 (time 1733806631.08 total 73.22 last 188.29) - open/close 13457 (time 1733806641.09 total 83.23 last 157.25) - open/close 14942 (time 1733806651.10 total 93.23 last 148.43) - open/close 16346 (time 1733806661.10 total 103.24 last 140.35) - open/close 17777 (time 1733806671.11 total 113.24 last 143.03) - open/close 19239 (time 1733806681.11 total 123.24 last 146.19) - open/close 20000 (time 1733806686.24 total 128.37 last 148.33) - open/close 21388 (time 1733806696.24 total 138.38 last 138.74) - open/close 22907 (time 1733806706.25 total 148.38 last 151.82) - open/close 24392 (time 1733806716.25 total 158.38 last 148.50) - open/close 25809 (time 1733806726.27 total 168.41 last 141.39) - open/close 27199 (time 1733806736.27 total 178.41 last 138.98) - open/close 28666 (time 1733806746.28 total 188.41 last 146.64) - open/close 30000 (time 1733806756.19 total 198.32 last 134.61) - open/close 31368 (time 1733806766.19 total 208.33 last 136.69) - open/close 32848 (time 1733806776.20 total 218.33 last 147.93) - open/close 34240 (time 1733806786.21 total 228.34 last 139.12) - open/close 35678 (time 1733806796.21 total 238.34 last 143.76) - open/close 37130 (time 1733806806.21 total 248.35 last 145.13) - open/close 38487 (time 1733806816.21 total 258.35 last 135.68) - open/close 40000 (time 1733806825.74 total 267.88 last 158.79) - open/close 41735 (time 1733806835.74 total 277.88 last 173.48) - open/close 43467 (time 1733806845.75 total 287.88 last 173.15) - open/close 45144 (time 1733806855.75 total 297.88 last 167.67) - open/close 46703 (time 1733806865.75 total 307.89 last 155.80) - open/close 48241 (time 1733806875.76 total 317.89 last 153.74) - open/close 49930 (time 1733806885.76 total 327.90 last 168.84) - open/close 51399 (time 1733806895.76 total 337.90 last 146.89) - open/close 52944 (time 1733806905.77 total 347.91 last 154.33) - open/close 54671 (time 1733806915.78 total 357.91 last 172.67) - open/close 56076 (time 1733806925.78 total 367.92 last 140.44) - open/close 57408 (time 1733806935.78 total 377.92 last 133.17) - open/close 58779 (time 1733806945.79 total 387.92 last 137.03) - open/close 60000 (time 1733806954.71 total 396.84 last 136.92) - open/close 61387 (time 1733806964.71 total 406.85 last 138.64) - open/close 62706 (time 1733806974.72 total 416.85 last 131.83) - open/close 64101 (time 1733806984.72 total 426.85 last 139.46) total: 64768 open/close in 431.33 seconds: 150.16 ops/second - /unlink 2438 (time 1733807000.82 total 10.00 last 243.75) - /unlink 4897 (time 1733807010.83 total 20.01 last 245.72) - /unlink 7077 (time 1733807020.83 total 30.01 last 217.98) - /unlink 9385 (time 1733807030.83 total 40.01 last 230.70) - /unlink 10000 (time 1733807033.56 total 42.75 last 225.01) - /unlink 12510 (time 1733807043.57 total 52.75 last 250.95) - /unlink 15316 (time 1733807053.57 total 62.75 last 280.56) - /unlink 18345 (time 1733807063.57 total 72.75 last 302.89) - /unlink 20000 (time 1733807069.37 total 78.55 last 285.40) - /unlink 22906 (time 1733807079.37 total 88.55 last 290.55) - /unlink 26706 (time 1733807089.37 total 98.56 last 379.89) - /unlink 30000 (time 1733807098.81 total 108.00 last 348.82) - /unlink 33463 (time 1733807108.82 total 118.00 last 346.18) - /unlink 36307 (time 1733807118.82 total 128.00 last 284.33) - /unlink 38804 (time 1733807128.82 total 138.01 last 249.62) - /unlink 40000 (time 1733807133.27 total 142.45 last 269.07) - /unlink 42551 (time 1733807143.27 total 152.46 last 254.97) - /unlink 45420 (time 1733807153.28 total 162.46 last 286.82) - /unlink 48123 (time 1733807163.28 total 172.46 last 270.25) - /unlink 50000 (time 1733807169.11 total 178.30 last 321.69) - /unlink 53224 (time 1733807179.12 total 188.30 last 322.25) - /unlink 55995 (time 1733807189.12 total 198.30 last 277.09) - /unlink 59204 (time 1733807199.12 total 208.30 last 320.85) - /unlink 60000 (time 1733807201.70 total 210.89 last 308.38) - /unlink 62750 (time 1733807211.70 total 220.89 last 274.98) total: 64768 /unlink in 227.41 seconds: 284.81 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1524 (time 1733807249.92 total 10.00 last 152.36) - open/close 3013 (time 1733807259.93 total 20.01 last 148.83) - open/close 4477 (time 1733807269.93 total 30.01 last 146.39) - open/close 6060 (time 1733807279.93 total 40.01 last 158.23) - open/close 7603 (time 1733807289.93 total 50.01 last 154.30) - open/close 9097 (time 1733807299.94 total 60.02 last 149.36) - open/close 10000 (time 1733807306.49 total 66.57 last 137.75) - open/close 11328 (time 1733807316.50 total 76.57 last 132.74) - open/close 12823 (time 1733807326.50 total 86.58 last 149.45) - open/close 14488 (time 1733807336.51 total 96.59 last 166.36) - open/close 15969 (time 1733807346.51 total 106.59 last 148.05) - open/close 17428 (time 1733807356.52 total 116.60 last 145.79) - open/close 18937 (time 1733807366.52 total 126.60 last 150.84) - open/close 20000 (time 1733807374.00 total 134.07 last 142.27) - open/close 21350 (time 1733807384.00 total 144.08 last 134.94) - open/close 22694 (time 1733807394.00 total 154.08 last 134.38) - open/close 24026 (time 1733807404.01 total 164.08 last 133.14) - open/close 25552 (time 1733807414.01 total 174.09 last 152.51) - open/close 27111 (time 1733807424.01 total 184.09 last 155.86) - open/close 28708 (time 1733807434.01 total 194.09 last 159.68) - open/close 30000 (time 1733807443.06 total 203.14 last 142.79) - open/close 31725 (time 1733807453.07 total 213.14 last 172.43) - open/close 33164 (time 1733807463.07 total 223.15 last 143.83) - open/close 34855 (time 1733807473.07 total 233.15 last 169.05) - open/close 36346 (time 1733807483.08 total 243.16 last 149.02) - open/close 37881 (time 1733807493.08 total 253.16 last 153.43) - open/close 39282 (time 1733807503.08 total 263.16 last 140.10) - open/close 40000 (time 1733807506.59 total 266.67 last 204.74) - open/close 41593 (time 1733807516.60 total 276.67 last 159.23) - open/close 43025 (time 1733807526.60 total 286.67 last 143.20) - open/close 44447 (time 1733807536.60 total 296.68 last 142.14) - open/close 45678 (time 1733807546.60 total 306.68 last 123.08) - open/close 46952 (time 1733807556.61 total 316.68 last 127.34) - open/close 48437 (time 1733807566.61 total 326.69 last 148.44) - open/close 49926 (time 1733807576.62 total 336.69 last 148.82) - open/close 51288 (time 1733807586.62 total 346.70 last 136.15) - open/close 52865 (time 1733807596.62 total 356.70 last 157.68) - open/close 54302 (time 1733807606.62 total 366.70 last 143.66) - open/close 55692 (time 1733807616.62 total 376.70 last 139.00) - open/close 57162 (time 1733807626.63 total 386.70 last 146.96) - open/close 58558 (time 1733807636.63 total 396.70 last 139.60) - open/close 60000 (time 1733807645.84 total 405.91 last 156.57) - open/close 61591 (time 1733807655.84 total 415.92 last 158.99) - open/close 63127 (time 1733807665.84 total 425.92 last 153.58) - open/close 64667 (time 1733807675.85 total 435.93 last 153.91) total: 64768 open/close in 436.59 seconds: 148.35 ops/second - /unlink 2466 (time 1733807688.00 total 10.00 last 246.57) - /unlink 5035 (time 1733807698.00 total 20.01 last 256.75) - /unlink 7789 (time 1733807708.00 total 30.01 last 275.37) - /unlink 10000 (time 1733807716.16 total 38.16 last 271.11) - /unlink 13097 (time 1733807726.16 total 48.17 last 309.63) - /unlink 15727 (time 1733807736.17 total 58.17 last 262.86) - /unlink 18118 (time 1733807746.17 total 68.17 last 239.05) - /unlink 20000 (time 1733807752.85 total 74.85 last 281.71) - /unlink 22788 (time 1733807762.85 total 84.86 last 278.68) - /unlink 25383 (time 1733807772.86 total 94.86 last 259.47) - /unlink 28164 (time 1733807782.86 total 104.86 last 278.09) - /unlink 30000 (time 1733807789.36 total 111.36 last 282.47) - /unlink 32895 (time 1733807799.36 total 121.36 last 289.45) - /unlink 36109 (time 1733807809.36 total 131.36 last 321.37) - /unlink 38988 (time 1733807819.36 total 141.36 last 287.84) - /unlink 40000 (time 1733807823.31 total 145.31 last 256.54) - /unlink 42721 (time 1733807833.31 total 155.31 last 272.03) - /unlink 45751 (time 1733807843.31 total 165.32 last 302.89) - /unlink 48894 (time 1733807853.32 total 175.32 last 314.18) - /unlink 50000 (time 1733807857.14 total 179.14 last 289.40) - /unlink 52900 (time 1733807867.14 total 189.14 last 289.89) - /unlink 56093 (time 1733807877.14 total 199.14 last 319.29) - /unlink 59005 (time 1733807887.14 total 209.15 last 291.15) - /unlink 60000 (time 1733807890.35 total 212.35 last 310.42) - /unlink 62961 (time 1733807900.35 total 222.35 last 296.03) total: 64768 /unlink in 228.43 seconds: 283.54 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1782 (time 1733807936.03 total 10.00 last 178.18) - open/close 3664 (time 1733807946.03 total 20.01 last 188.12) - open/close 5534 (time 1733807956.04 total 30.01 last 186.90) - open/close 7617 (time 1733807966.04 total 40.01 last 208.25) - open/close 9622 (time 1733807976.04 total 50.02 last 200.44) - open/close 10000 (time 1733807978.19 total 52.17 last 175.65) - open/close 11567 (time 1733807988.19 total 62.17 last 156.69) - open/close 13288 (time 1733807998.20 total 72.18 last 171.96) - open/close 15087 (time 1733808008.20 total 82.18 last 179.89) - open/close 16728 (time 1733808018.21 total 92.18 last 164.03) - open/close 18269 (time 1733808028.21 total 102.18 last 154.09) - open/close 19756 (time 1733808038.21 total 112.19 last 148.61) - open/close 21350 (time 1733808048.21 total 122.19 last 159.40) - open/close 22866 (time 1733808058.22 total 132.19 last 151.52) - open/close 24407 (time 1733808068.22 total 142.20 last 154.01) - open/close 26036 (time 1733808078.23 total 152.21 last 162.77) - open/close 27568 (time 1733808088.24 total 162.22 last 153.07) - open/close 29450 (time 1733808098.24 total 172.22 last 188.16) - open/close 30000 (time 1733808101.02 total 175.00 last 197.89) - open/close 31997 (time 1733808111.03 total 185.00 last 199.65) - open/close 33890 (time 1733808121.03 total 195.00 last 189.27) - open/close 35838 (time 1733808131.03 total 205.01 last 194.71) - open/close 37824 (time 1733808141.04 total 215.01 last 198.53) - open/close 39616 (time 1733808151.04 total 225.01 last 179.13) - open/close 41463 (time 1733808161.04 total 235.02 last 184.63) - open/close 43518 (time 1733808171.05 total 245.02 last 205.45) - open/close 45368 (time 1733808181.05 total 255.02 last 184.97) - open/close 47687 (time 1733808191.05 total 265.02 last 231.84) - open/close 49613 (time 1733808201.05 total 275.03 last 192.57) - open/close 50000 (time 1733808203.64 total 277.62 last 149.40) - open/close 51674 (time 1733808213.65 total 287.62 last 167.34) - open/close 53652 (time 1733808223.65 total 297.62 last 197.73) - open/close 55664 (time 1733808233.65 total 307.62 last 201.18) - open/close 57793 (time 1733808243.65 total 317.63 last 212.81) - open/close 59513 (time 1733808253.66 total 327.63 last 171.94) - open/close 60000 (time 1733808256.61 total 330.59 last 164.77) - open/close 61574 (time 1733808266.62 total 340.59 last 157.36) - open/close 63257 (time 1733808276.62 total 350.59 last 168.25) total: 64768 open/close in 359.31 seconds: 180.26 ops/second - /unlink 3341 (time 1733808296.46 total 10.00 last 334.02) - /unlink 6644 (time 1733808306.46 total 20.00 last 330.28) - /unlink 10000 (time 1733808315.12 total 28.66 last 387.48) - /unlink 13120 (time 1733808325.13 total 38.67 last 311.91) - /unlink 16006 (time 1733808335.13 total 48.67 last 288.58) - /unlink 19330 (time 1733808345.13 total 58.67 last 332.39) - /unlink 22751 (time 1733808355.13 total 68.67 last 342.09) - /unlink 25891 (time 1733808365.13 total 78.67 last 313.98) - /unlink 29623 (time 1733808375.13 total 88.67 last 373.10) - /unlink 33177 (time 1733808385.13 total 98.67 last 355.34) - /unlink 37083 (time 1733808395.13 total 108.67 last 390.57) - /unlink 40000 (time 1733808402.16 total 115.70 last 415.30) - /unlink 43137 (time 1733808412.16 total 125.70 last 313.66) - /unlink 45853 (time 1733808422.16 total 135.70 last 271.51) - /unlink 48762 (time 1733808432.16 total 145.70 last 290.89) - /unlink 50000 (time 1733808436.75 total 150.29 last 270.07) - /unlink 53294 (time 1733808446.75 total 160.29 last 329.36) - /unlink 56284 (time 1733808456.75 total 170.29 last 298.89) - /unlink 59370 (time 1733808466.75 total 180.29 last 308.57) - /unlink 60000 (time 1733808468.79 total 182.33 last 309.51) - /unlink 63545 (time 1733808478.79 total 192.33 last 354.47) total: 64768 /unlink in 195.75 seconds: 330.86 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg307-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg307-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg307-server stop mds service on oleg307-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg307-server unloading modules via unload_modules_local on: 'oleg307-server' oleg307-server: oleg307-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg307-client: oleg307-client: ssh exited with exit code 2 pdsh@oleg307-client: oleg307-server: ssh exited with exit code 2 pdsh@oleg307-client: oleg307-client: ssh exited with exit code 2 pdsh@oleg307-client: oleg307-server: ssh exited with exit code 2