== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 00:21:04 (1782361264) start mds service on oleg223-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg223-server: oleg223-server.virtnet: executing set_default_debug -1 all pdsh@oleg223-client: oleg223-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg223-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg223-server: oleg223-server.virtnet: executing set_default_debug -1 all pdsh@oleg223-client: oleg223-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg223-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg223-server: oleg223-server.virtnet: executing set_default_debug -1 all pdsh@oleg223-client: oleg223-server: ssh exited with exit code 1 Started lustre-OST0000 oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg223-client.virtnet: -o user_xattr,flock 192.168.202.123@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 401 49599 1% /mnt/lustre[OST:0] filesystem_summary: 50128 529 49599 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 772 (time 1782361314.40 total 10.01 last 77.10) - open/close/unlink 1460 (time 1782361324.40 total 20.01 last 68.79) - open/close/unlink 2273 (time 1782361334.42 total 30.03 last 81.19) - open/close/unlink 3001 (time 1782361344.42 total 40.03 last 72.77) - open/close/unlink 3806 (time 1782361354.42 total 50.03 last 80.48) - open/close/unlink 4634 (time 1782361364.43 total 60.04 last 82.74) - open/close/unlink 5426 (time 1782361374.44 total 70.05 last 79.13) - open/close/unlink 6385 (time 1782361384.45 total 80.06 last 95.78) - open/close/unlink 7172 (time 1782361394.47 total 90.08 last 78.57) - open/close/unlink 8176 (time 1782361404.47 total 100.08 last 100.38) - open/close/unlink 9137 (time 1782361414.47 total 110.08 last 96.10) - open/close/unlink 10000 (time 1782361421.64 total 117.25 last 120.38) - open/close/unlink 11167 (time 1782361431.65 total 127.26 last 116.63) - open/close/unlink 12475 (time 1782361441.65 total 137.26 last 130.75) - open/close/unlink 13500 (time 1782361451.65 total 147.26 last 102.47) - open/close/unlink 14631 (time 1782361461.66 total 157.27 last 113.06) - open/close/unlink 15732 (time 1782361471.67 total 167.28 last 109.96) - open/close/unlink 16746 (time 1782361481.67 total 177.28 last 101.35) - open/close/unlink 17759 (time 1782361491.68 total 187.28 last 101.29) - open/close/unlink 18785 (time 1782361501.68 total 197.29 last 102.52) - open/close/unlink 19816 (time 1782361511.69 total 207.30 last 103.01) - open/close/unlink 20000 (time 1782361513.70 total 209.31 last 91.56) - open/close/unlink 21219 (time 1782361523.71 total 219.32 last 121.83) - open/close/unlink 22131 (time 1782361533.71 total 229.32 last 91.19) - open/close/unlink 23148 (time 1782361543.71 total 239.32 last 101.65) - open/close/unlink 23950 (time 1782361553.72 total 249.33 last 80.16) - open/close/unlink 24847 (time 1782361563.72 total 259.33 last 89.65) - open/close/unlink 25622 (time 1782361573.73 total 269.34 last 77.44) - open/close/unlink 26452 (time 1782361583.74 total 279.35 last 82.95) - open/close/unlink 27257 (time 1782361593.74 total 289.35 last 80.47) - open/close/unlink 28048 (time 1782361603.74 total 299.35 last 79.08) - open/close/unlink 28947 (time 1782361613.75 total 309.36 last 89.83) - open/close/unlink 29783 (time 1782361623.76 total 319.37 last 83.50) - open/close/unlink 30000 (time 1782361626.17 total 321.78 last 90.12) - open/close/unlink 30950 (time 1782361636.18 total 331.79 last 94.88) - open/close/unlink 31984 (time 1782361646.19 total 341.80 last 103.35) - open/close/unlink 33023 (time 1782361656.19 total 351.80 last 103.85) - open/close/unlink 33930 (time 1782361666.19 total 361.80 last 90.70) - open/close/unlink 35029 (time 1782361676.20 total 371.81 last 109.78) - open/close/unlink 36006 (time 1782361686.21 total 381.82 last 97.59) - open/close/unlink 36928 (time 1782361696.22 total 391.83 last 92.19) - open/close/unlink 37860 (time 1782361706.22 total 401.83 last 93.13) - open/close/unlink 38812 (time 1782361716.23 total 411.83 last 95.18) - open/close/unlink 39800 (time 1782361726.23 total 421.84 last 98.79) - open/close/unlink 40000 (time 1782361728.31 total 423.92 last 96.20) - open/close/unlink 40980 (time 1782361738.31 total 433.92 last 97.98) - open/close/unlink 41974 (time 1782361748.31 total 443.92 last 99.39) - open/close/unlink 42998 (time 1782361758.32 total 453.93 last 102.30) - open/close/unlink 43933 (time 1782361768.32 total 463.93 last 93.48) - open/close/unlink 44920 (time 1782361778.33 total 473.94 last 98.63) - open/close/unlink 45885 (time 1782361788.33 total 483.94 last 96.49) - open/close/unlink 46952 (time 1782361798.34 total 493.95 last 106.63) - open/close/unlink 47757 (time 1782361808.34 total 503.95 last 80.47) - open/close/unlink 48718 (time 1782361818.34 total 513.95 last 96.06) - open/close/unlink 49831 (time 1782361828.35 total 523.96 last 111.25) - open/close/unlink 50854 (time 1782361838.36 total 533.97 last 102.20) - open/close/unlink 51877 (time 1782361848.36 total 543.97 last - open/close/unlink 765 (time 1782361314.59 total 10.00 last 76.47) - open/close/unlink 1455 (time 1782361324.60 total 20.01 last 68.95) - open/close/unlink 2273 (time 1782361334.61 total 30.02 last 81.76) - open/close/unlink 2996 (time 1782361344.63 total 40.04 last 72.16) - open/close/unlink 3810 (time 1782361354.63 total 50.04 last 81.38) - open/close/unlink 4639 (time 1782361364.64 total 60.05 last 82.81) - open/close/unlink 5433 (time 1782361374.64 total 70.05 last 79.37) - open/close/unlink 6395 (time 1782361384.65 total 80.06 last 96.14) - open/close/unlink 7178 (time 1782361394.66 total 90.08 last 78.18) - open/close/unlink 8189 (time 1782361404.67 total 100.08 last 101.03) - open/close/unlink 9152 (time 1782361414.67 total 110.08 last 96.30) - open/close/unlink 10000 (time 1782361421.83 total 117.24 last 118.49) - open/close/unlink 11146 (time 1782361431.83 total 127.24 last 114.60) - open/close/unlink 12448 (time 1782361441.83 total 137.24 last 130.17) - open/close/unlink 13464 (time 1782361451.84 total 147.25 last 101.52) - open/close/unlink 14597 (time 1782361461.85 total 157.26 last 113.17) - open/close/unlink 15693 (time 1782361471.86 total 167.27 last 109.49) - open/close/unlink 16722 (time 1782361481.87 total 177.28 last 102.85) - open/close/unlink 17727 (time 1782361491.87 total 187.28 last 100.42) - open/close/unlink 18748 (time 1782361501.89 total 197.30 last 101.92) - open/close/unlink 19777 (time 1782361511.90 total 207.31 last 102.80) - open/close/unlink 20000 (time 1782361514.15 total 209.56 last 99.20) - open/close/unlink 21218 (time 1782361524.15 total 219.57 last 121.73) - open/close/unlink 22124 (time 1782361534.17 total 229.58 last 90.48) - open/close/unlink 23140 (time 1782361544.17 total 239.59 last 101.54) - open/close/unlink 23924 (time 1782361554.18 total 249.59 last 78.38) - open/close/unlink 24827 (time 1782361564.18 total 259.59 last 90.27) - open/close/unlink 25600 (time 1782361574.18 total 269.59 last 77.29) - open/close/unlink 26459 (time 1782361584.19 total 279.60 last 85.82) - open/close/unlink 27258 (time 1782361594.20 total 289.62 last 79.79) - open/close/unlink 28065 (time 1782361604.21 total 299.62 last 80.65) - open/close/unlink 28956 (time 1782361614.22 total 309.64 last 88.97) - open/close/unlink 29805 (time 1782361624.22 total 319.64 last 84.90) - open/close/unlink 30000 (time 1782361626.35 total 321.76 last 91.76) - open/close/unlink 30957 (time 1782361636.36 total 331.77 last 95.59) - open/close/unlink 31993 (time 1782361646.37 total 341.78 last 103.55) - open/close/unlink 33025 (time 1782361656.37 total 351.78 last 103.16) - open/close/unlink 33924 (time 1782361666.39 total 361.80 last 89.75) - open/close/unlink 35018 (time 1782361676.39 total 371.80 last 109.39) - open/close/unlink 35975 (time 1782361686.39 total 381.80 last 95.65) - open/close/unlink 36882 (time 1782361696.39 total 391.81 last 90.68) - open/close/unlink 37814 (time 1782361706.40 total 401.81 last 93.16) - open/close/unlink 38771 (time 1782361716.40 total 411.81 last 95.70) - open/close/unlink 39765 (time 1782361726.40 total 421.81 last 99.36) - open/close/unlink 40000 (time 1782361728.77 total 424.18 last 99.14) - open/close/unlink 40971 (time 1782361738.78 total 434.19 last 97.07) - open/close/unlink 41979 (time 1782361748.78 total 444.19 last 100.75) - open/close/unlink 42978 (time 1782361758.79 total 454.20 last 99.82) - open/close/unlink 43931 (time 1782361768.80 total 464.21 last 95.25) - open/close/unlink 44910 (time 1782361778.80 total 474.21 last 97.89) - open/close/unlink 45877 (time 1782361788.80 total 484.21 last 96.67) - open/close/unlink 46930 (time 1782361798.81 total 494.22 last 105.20) - open/close/unlink 47752 (time 1782361808.82 total 504.23 last 82.14) - open/close/unlink 48716 (time 1782361818.82 total 514.23 last 96.38) - open/close/unlink 49846 (time 1782361828.82 total 524.23 last 112.97) - open/close/unlink 50855 (time 1782361838.83 total 534.24 last 100.83) - open/close/unlink 51870 (time 1782361848.83 total 544.25 last - open/close/unlink 777 (time 1782361314.59 total 10.01 last 77.66) - open/close/unlink 1469 (time 1782361324.60 total 20.01 last 69.15) - open/close/unlink 2281 (time 1782361334.60 total 30.02 last 81.15) - open/close/unlink 3004 (time 1782361344.63 total 40.04 last 72.11) - open/close/unlink 3818 (time 1782361354.64 total 50.05 last 81.31) - open/close/unlink 4652 (time 1782361364.64 total 60.06 last 83.38) - open/close/unlink 5453 (time 1782361374.64 total 70.06 last 80.10) - open/close/unlink 6397 (time 1782361384.65 total 80.06 last 94.36) - open/close/unlink 7174 (time 1782361394.65 total 90.07 last 77.67) - open/close/unlink 8189 (time 1782361404.67 total 100.08 last 101.35) - open/close/unlink 9166 (time 1782361414.67 total 110.08 last 97.68) - open/close/unlink 10000 (time 1782361421.70 total 117.12 last 118.54) - open/close/unlink 11161 (time 1782361431.71 total 127.12 last 116.04) - open/close/unlink 12463 (time 1782361441.71 total 137.13 last 130.14) - open/close/unlink 13485 (time 1782361451.71 total 147.13 last 102.19) - open/close/unlink 14606 (time 1782361461.72 total 157.14 last 112.00) - open/close/unlink 15711 (time 1782361471.73 total 167.14 last 110.42) - open/close/unlink 16733 (time 1782361481.73 total 177.15 last 102.17) - open/close/unlink 17746 (time 1782361491.74 total 187.15 last 101.24) - open/close/unlink 18780 (time 1782361501.75 total 197.16 last 103.29) - open/close/unlink 19806 (time 1782361511.75 total 207.17 last 102.56) - open/close/unlink 20000 (time 1782361513.82 total 209.23 last 93.96) - open/close/unlink 21207 (time 1782361523.82 total 219.24 last 120.64) - open/close/unlink 22113 (time 1782361533.83 total 229.24 last 90.58) - open/close/unlink 23115 (time 1782361543.83 total 239.24 last 100.16) - open/close/unlink 23916 (time 1782361553.84 total 249.26 last 80.02) - open/close/unlink 24809 (time 1782361563.84 total 259.26 last 89.29) - open/close/unlink 25576 (time 1782361573.85 total 269.27 last 76.62) - open/close/unlink 26411 (time 1782361583.85 total 279.27 last 83.47) - open/close/unlink 27229 (time 1782361593.86 total 289.28 last 81.72) - open/close/unlink 28022 (time 1782361603.87 total 299.29 last 79.24) - open/close/unlink 28922 (time 1782361613.88 total 309.29 last 89.96) - open/close/unlink 29763 (time 1782361623.88 total 319.30 last 84.06) - open/close/unlink 30000 (time 1782361626.51 total 321.92 last 90.31) - open/close/unlink 30955 (time 1782361636.51 total 331.92 last 95.50) - open/close/unlink 31991 (time 1782361646.51 total 341.92 last 103.59) - open/close/unlink 33022 (time 1782361656.52 total 351.93 last 103.01) - open/close/unlink 33918 (time 1782361666.52 total 361.93 last 89.57) - open/close/unlink 35010 (time 1782361676.52 total 371.94 last 109.18) - open/close/unlink 35968 (time 1782361686.53 total 381.94 last 95.73) - open/close/unlink 36876 (time 1782361696.54 total 391.95 last 90.73) - open/close/unlink 37805 (time 1782361706.54 total 401.96 last 92.86) - open/close/unlink 38760 (time 1782361716.55 total 411.96 last 95.43) - open/close/unlink 39747 (time 1782361726.56 total 421.97 last 98.62) - open/close/unlink 40000 (time 1782361729.06 total 424.47 last 101.16) - open/close/unlink 40971 (time 1782361739.06 total 434.48 last 97.03) - open/close/unlink 41980 (time 1782361749.07 total 444.48 last 100.84) - open/close/unlink 42979 (time 1782361759.08 total 454.49 last 99.81) - open/close/unlink 43917 (time 1782361769.08 total 464.50 last 93.79) - open/close/unlink 44885 (time 1782361779.09 total 474.50 last 96.74) - open/close/unlink 45867 (time 1782361789.10 total 484.51 last 98.10) - open/close/unlink 46899 (time 1782361799.10 total 494.52 last 103.14) - open/close/unlink 47738 (time 1782361809.11 total 504.52 last 83.86) - open/close/unlink 48687 (time 1782361819.11 total 514.53 last 94.84) - open/close/unlink 49840 (time 1782361829.12 total 524.54 last 115.19) - open/close/unlink 50847 (time 1782361839.13 total 534.55 last 100.61) - open/close/unlink 51869 (time 1782361849.13 total 544.55 last - open/close/unlink 768 (time 1782361314.49 total 10.01 last 76.70) - open/close/unlink 1462 (time 1782361324.51 total 20.03 last 69.27) - open/close/unlink 2279 (time 1782361334.51 total 30.04 last 81.67) - open/close/unlink 3006 (time 1782361344.52 total 40.04 last 72.66) - open/close/unlink 3806 (time 1782361354.52 total 50.05 last 79.93) - open/close/unlink 4634 (time 1782361364.54 total 60.06 last 82.69) - open/close/unlink 5422 (time 1782361374.54 total 70.07 last 78.77) - open/close/unlink 6381 (time 1782361384.54 total 80.07 last 95.87) - open/close/unlink 7162 (time 1782361394.55 total 90.07 last 78.07) - open/close/unlink 8188 (time 1782361404.56 total 100.09 last 102.47) - open/close/unlink 9147 (time 1782361414.56 total 110.09 last 95.88) - open/close/unlink 10000 (time 1782361421.78 total 117.30 last 118.27) - open/close/unlink 11166 (time 1782361431.79 total 127.31 last 116.46) - open/close/unlink 12460 (time 1782361441.79 total 137.31 last 129.39) - open/close/unlink 13482 (time 1782361451.79 total 147.32 last 102.13) - open/close/unlink 14600 (time 1782361461.80 total 157.32 last 111.77) - open/close/unlink 15709 (time 1782361471.81 total 167.33 last 110.76) - open/close/unlink 16731 (time 1782361481.81 total 177.33 last 102.19) - open/close/unlink 17745 (time 1782361491.81 total 187.34 last 101.35) - open/close/unlink 18767 (time 1782361501.85 total 197.37 last 101.84) - open/close/unlink 19790 (time 1782361511.85 total 207.38 last 102.28) - open/close/unlink 20000 (time 1782361514.01 total 209.53 last 97.49) - open/close/unlink 21212 (time 1782361524.01 total 219.53 last 121.20) - open/close/unlink 22117 (time 1782361534.01 total 229.53 last 90.48) - open/close/unlink 23125 (time 1782361544.01 total 239.54 last 100.76) - open/close/unlink 23908 (time 1782361554.02 total 249.54 last 78.27) - open/close/unlink 24797 (time 1782361564.02 total 259.55 last 88.83) - open/close/unlink 25557 (time 1782361574.03 total 269.55 last 75.96) - open/close/unlink 26412 (time 1782361584.04 total 279.56 last 85.44) - open/close/unlink 27211 (time 1782361594.04 total 289.56 last 79.90) - open/close/unlink 28012 (time 1782361604.04 total 299.57 last 80.03) - open/close/unlink 28902 (time 1782361614.05 total 309.57 last 88.98) - open/close/unlink 29749 (time 1782361624.05 total 319.58 last 84.66) - open/close/unlink 30000 (time 1782361626.84 total 322.36 last 90.06) - open/close/unlink 30968 (time 1782361636.84 total 332.37 last 96.76) - open/close/unlink 32004 (time 1782361646.84 total 342.37 last 103.59) - open/close/unlink 33047 (time 1782361656.85 total 352.37 last 104.23) - open/close/unlink 33936 (time 1782361666.86 total 362.39 last 88.81) - open/close/unlink 35036 (time 1782361676.86 total 372.39 last 109.96) - open/close/unlink 35995 (time 1782361686.87 total 382.39 last 95.84) - open/close/unlink 36912 (time 1782361696.87 total 392.40 last 91.67) - open/close/unlink 37856 (time 1782361706.88 total 402.40 last 94.36) - open/close/unlink 38817 (time 1782361716.88 total 412.41 last 96.05) - open/close/unlink 39812 (time 1782361726.88 total 422.41 last 99.50) - open/close/unlink 40804 (time 1782361736.89 total 432.42 last 99.12) - open/close/unlink 41766 (time 1782361746.90 total 442.43 last 96.11) - open/close/unlink 42819 (time 1782361756.91 total 452.43 last 105.22) - open/close/unlink 43764 (time 1782361766.91 total 462.43 last 94.48) - open/close/unlink 44737 (time 1782361776.91 total 472.44 last 97.29) - open/close/unlink 45672 (time 1782361786.92 total 482.44 last 93.44) - open/close/unlink 46752 (time 1782361796.92 total 492.44 last 108.00) - open/close/unlink 47548 (time 1782361806.92 total 502.45 last 79.57) - open/close/unlink 48519 (time 1782361816.92 total 512.45 last 97.08) - open/close/unlink 49637 (time 1782361826.93 total 522.46 last 111.73) - open/close/unlink 50000 (time 1782361830.21 total 525.74 last 110.65) - open/close/unlink 50990 (time 1782361840.21 total 535.74 last 98.97) - open/close/unlink 52009 (time 1782361850.21 total 545.74 last - open/close/unlink 776 (time 1782361314.35 total 10.01 last 77.56) - open/close/unlink 1465 (time 1782361324.36 total 20.02 last 68.83) - open/close/unlink 2281 (time 1782361334.36 total 30.02 last 81.57) - open/close/unlink 3002 (time 1782361344.36 total 40.02 last 72.07) - open/close/unlink 3800 (time 1782361354.37 total 50.02 last 79.80) - open/close/unlink 4626 (time 1782361364.37 total 60.03 last 82.56) - open/close/unlink 5413 (time 1782361374.37 total 70.03 last 78.69) - open/close/unlink 6378 (time 1782361384.37 total 80.03 last 96.50) - open/close/unlink 7162 (time 1782361394.38 total 90.04 last 78.33) - open/close/unlink 8177 (time 1782361404.38 total 100.04 last 101.49) - open/close/unlink 9128 (time 1782361414.38 total 110.04 last 95.08) - open/close/unlink 10000 (time 1782361421.70 total 117.36 last 119.21) - open/close/unlink 11166 (time 1782361431.70 total 127.36 last 116.52) - open/close/unlink 12479 (time 1782361441.72 total 137.38 last 131.13) - open/close/unlink 13502 (time 1782361451.72 total 147.38 last 102.29) - open/close/unlink 14631 (time 1782361461.72 total 157.38 last 112.84) - open/close/unlink 15746 (time 1782361471.72 total 167.38 last 111.49) - open/close/unlink 16760 (time 1782361481.73 total 177.39 last 101.37) - open/close/unlink 17779 (time 1782361491.74 total 187.39 last 101.82) - open/close/unlink 18803 (time 1782361501.74 total 197.39 last 102.39) - open/close/unlink 19833 (time 1782361511.74 total 207.40 last 102.99) - open/close/unlink 20993 (time 1782361521.75 total 217.40 last 115.90) - open/close/unlink 21967 (time 1782361531.75 total 227.41 last 97.37) - open/close/unlink 22955 (time 1782361541.75 total 237.41 last 98.80) - open/close/unlink 23813 (time 1782361551.75 total 247.41 last 85.77) - open/close/unlink 24700 (time 1782361561.76 total 257.42 last 88.62) - open/close/unlink 25469 (time 1782361571.77 total 267.43 last 76.83) - open/close/unlink 26262 (time 1782361581.78 total 277.43 last 79.26) - open/close/unlink 27126 (time 1782361591.79 total 287.44 last 86.31) - open/close/unlink 27907 (time 1782361601.79 total 297.45 last 78.09) - open/close/unlink 28783 (time 1782361611.80 total 307.45 last 87.52) - open/close/unlink 29627 (time 1782361621.80 total 317.46 last 84.38) - open/close/unlink 30000 (time 1782361626.02 total 321.68 last 88.28) - open/close/unlink 30947 (time 1782361636.03 total 331.69 last 94.67) - open/close/unlink 31979 (time 1782361646.04 total 341.69 last 103.11) - open/close/unlink 33008 (time 1782361656.05 total 351.71 last 102.75) - open/close/unlink 33910 (time 1782361666.05 total 361.71 last 90.17) - open/close/unlink 35010 (time 1782361676.05 total 371.71 last 110.00) - open/close/unlink 35987 (time 1782361686.06 total 381.72 last 97.62) - open/close/unlink 36902 (time 1782361696.07 total 391.73 last 91.44) - open/close/unlink 37833 (time 1782361706.07 total 401.73 last 93.10) - open/close/unlink 38777 (time 1782361716.08 total 411.74 last 94.26) - open/close/unlink 39768 (time 1782361726.09 total 421.75 last 99.00) - open/close/unlink 40000 (time 1782361728.46 total 424.12 last 98.07) - open/close/unlink 40984 (time 1782361738.49 total 434.14 last 98.14) - open/close/unlink 41989 (time 1782361748.49 total 444.15 last 100.45) - open/close/unlink 42996 (time 1782361758.50 total 454.16 last 100.63) - open/close/unlink 43931 (time 1782361768.50 total 464.16 last 93.50) - open/close/unlink 44914 (time 1782361778.52 total 474.18 last 98.10) - open/close/unlink 45884 (time 1782361788.54 total 484.20 last 96.81) - open/close/unlink 46950 (time 1782361798.57 total 494.23 last 106.28) - open/close/unlink 47771 (time 1782361808.59 total 504.25 last 81.93) - open/close/unlink 48737 (time 1782361818.59 total 514.25 last 96.60) - open/close/unlink 49855 (time 1782361828.59 total 524.25 last 111.80) - open/close/unlink 50882 (time 1782361838.60 total 534.26 last 102.61) - open/close/unlink 51905 (time 1782361848.60 total 544.26 last 102.26) - open/close/unlink 53006 (time 1782361858.61 total 554.27 last 109.97) - open/close/unlink 54189 (time 1782361868.62 total 564.28 last 118.22) - open/close/unlink 55335 (time 1782361878.62 total 574.28 last 114.59) - open/close/unlink 56482 (time 1782361888.62 total 584.28 last 114.70) - open/close/unlink 57615 (time 1782361898.62 total 594.28 last 113.29) - open/close/unlink 58989 (time 1782361908.62 total 604.28 last 137.39) - open/close/unlink 60000 (time 1782361915.65 total 611.30 last 143.91) - open/close/unlink 61412 (time 1782361925.65 total 621.31 last 141.14) - open/close/unlink 62389 (time 1782361935.66 total 631.32 last 97.58) - open/close/unlink 63431 (time 1782361945.67 total 641.33 last 104.16) - open/close/unlink 64553 (time 1782361955.67 total 651.33 last 112.14) total: 64768 open/close/unlink in 653.69 seconds: 99.08 ops/second 102.27) - open/close/unlink 52974 (time 1782361858.37 total 553.98 last 109.63) - open/close/unlink 54166 (time 1782361868.38 total 563.99 last 119.08) - open/close/unlink 55314 (time 1782361878.38 total 573.99 last 114.74) - open/close/unlink 56474 (time 1782361888.38 total 583.99 last 116.00) - open/close/unlink 57589 (time 1782361898.39 total 594.00 last 111.45) - open/close/unlink 58956 (time 1782361908.39 total 604.00 last 136.63) - open/close/unlink 60000 (time 1782361915.71 total 611.32 last 142.68) - open/close/unlink 61388 (time 1782361925.72 total 621.33 last 138.67) - open/close/unlink 62362 (time 1782361935.72 total 631.33 last 97.38) - open/close/unlink 63397 (time 1782361945.72 total 641.33 last 103.48) - open/close/unlink 64513 (time 1782361955.73 total 651.34 last 111.54) total: 64768 open/close/unlink in 654.69 seconds: 98.93 ops/second 101.90) - open/close/unlink 53174 (time 1782361860.23 total 555.75 last 116.36) - open/close/unlink 54322 (time 1782361870.23 total 565.76 last 114.71) - open/close/unlink 55510 (time 1782361880.24 total 575.76 last 118.76) - open/close/unlink 56618 (time 1782361890.24 total 585.77 last 110.73) - open/close/unlink 57781 (time 1782361900.25 total 595.77 last 116.25) - open/close/unlink 59201 (time 1782361910.25 total 605.78 last 141.96) - open/close/unlink 60000 (time 1782361915.97 total 611.50 last 139.60) - open/close/unlink 61396 (time 1782361925.98 total 621.51 last 139.49) - open/close/unlink 62354 (time 1782361935.98 total 631.51 last 95.77) - open/close/unlink 63398 (time 1782361945.99 total 641.51 last 104.38) - open/close/unlink 64513 (time 1782361955.99 total 651.52 last 111.42) total: 64768 open/close/unlink in 655.16 seconds: 98.86 ops/second 101.45) - open/close/unlink 52985 (time 1782361858.84 total 554.25 last 111.45) - open/close/unlink 54155 (time 1782361868.84 total 564.25 last 116.98) - open/close/unlink 55322 (time 1782361878.84 total 574.25 last 116.67) - open/close/unlink 56468 (time 1782361888.85 total 584.26 last 114.56) - open/close/unlink 57587 (time 1782361898.85 total 594.26 last 111.90) - open/close/unlink 58961 (time 1782361908.85 total 604.26 last 137.33) - open/close/unlink 60000 (time 1782361916.05 total 611.46 last 144.44) - open/close/unlink 61398 (time 1782361926.05 total 621.46 last 139.76) - open/close/unlink 62364 (time 1782361936.05 total 631.46 last 96.56) - open/close/unlink 63408 (time 1782361946.06 total 641.47 last 104.36) - open/close/unlink 64517 (time 1782361956.06 total 651.47 last 110.87) total: 64768 open/close/unlink in 655.12 seconds: 98.86 ops/second 102.17) - open/close/unlink 52990 (time 1782361859.14 total 554.55 last 112.08) - open/close/unlink 54152 (time 1782361869.14 total 564.55 last 116.16) - open/close/unlink 55336 (time 1782361879.14 total 574.56 last 118.37) - open/close/unlink 56466 (time 1782361889.15 total 584.56 last 112.95) - open/close/unlink 57593 (time 1782361899.15 total 594.56 last 112.69) - open/close/unlink 58977 (time 1782361909.15 total 604.56 last 138.39) - open/close/unlink 60000 (time 1782361916.25 total 611.66 last 144.07) - open/close/unlink 61383 (time 1782361926.26 total 621.67 last 138.20) - open/close/unlink 62336 (time 1782361936.28 total 631.69 last 95.11) - open/close/unlink 63398 (time 1782361946.28 total 641.69 last 106.16) - open/close/unlink 64510 (time 1782361956.29 total 651.71 last 111.05) total: 64768 open/close/unlink in 655.65 seconds: 98.78 ops/second Waiting for MDT destroys to complete oleg223-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg223-client: oleg223-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg223-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg223-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg223-server stop mds service on oleg223-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg223-server stop mds service on oleg223-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg223-server unloading modules via unload_modules_local on: 'oleg223-server' oleg223-server: oleg223-server.virtnet: executing unload_modules_local oleg223-server: modules unloaded. pdsh@oleg223-client: oleg223-client: ssh exited with exit code 2 pdsh@oleg223-client: oleg223-server: ssh exited with exit code 2 pdsh@oleg223-client: oleg223-client: ssh exited with exit code 2 pdsh@oleg223-client: oleg223-server: ssh exited with exit code 2