== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 10:29:43 (1780324183) start mds service on oleg412-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg412-server: oleg412-server.virtnet: executing set_default_debug -1 all pdsh@oleg412-client: oleg412-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg412-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg412-server: oleg412-server.virtnet: executing set_default_debug -1 all pdsh@oleg412-client: oleg412-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg412-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg412-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg412-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg412-server: oleg412-server.virtnet: executing set_default_debug -1 all pdsh@oleg412-client: oleg412-server: ssh exited with exit code 1 Started lustre-OST0000 oleg412-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg412-client.virtnet: -o user_xattr,flock 192.168.204.112@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 275 79717 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 433 49567 1% /mnt/lustre[OST:0] filesystem_summary: 50097 530 49567 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 630 (time 1780324237.73 total 10.01 last 62.96) - open/close/unlink 1378 (time 1780324247.74 total 20.01 last 74.79) - open/close/unlink 2084 (time 1780324257.74 total 30.01 last 70.58) - open/close/unlink 2717 (time 1780324267.74 total 40.01 last 63.28) - open/close/unlink 3246 (time 1780324277.76 total 50.03 last 52.81) - open/close/unlink 3821 (time 1780324287.78 total 60.05 last 57.37) - open/close/unlink 4407 (time 1780324297.81 total 70.08 last 58.43) - open/close/unlink 5120 (time 1780324307.82 total 80.09 last 71.25) - open/close/unlink 5855 (time 1780324317.82 total 90.09 last 73.46) - open/close/unlink 6520 (time 1780324327.84 total 100.11 last 66.38) - open/close/unlink 7187 (time 1780324337.85 total 110.12 last 66.63) - open/close/unlink 8014 (time 1780324347.86 total 120.13 last 82.66) - open/close/unlink 8738 (time 1780324357.86 total 130.13 last 72.36) - open/close/unlink 9541 (time 1780324367.90 total 140.17 last 79.97) - open/close/unlink 10000 (time 1780324374.68 total 146.95 last 67.75) - open/close/unlink 10565 (time 1780324384.69 total 156.96 last 56.42) - open/close/unlink 11093 (time 1780324394.71 total 166.98 last 52.72) - open/close/unlink 11677 (time 1780324404.71 total 176.99 last 58.36) - open/close/unlink 12499 (time 1780324414.72 total 186.99 last 82.17) - open/close/unlink 13182 (time 1780324424.72 total 196.99 last 68.26) - open/close/unlink 13972 (time 1780324434.73 total 207.00 last 78.97) - open/close/unlink 14762 (time 1780324444.74 total 217.01 last 78.93) - open/close/unlink 15569 (time 1780324454.75 total 227.03 last 80.55) - open/close/unlink 16354 (time 1780324464.76 total 237.03 last 78.44) - open/close/unlink 17116 (time 1780324474.76 total 247.03 last 76.20) - open/close/unlink 17773 (time 1780324484.77 total 257.04 last 65.64) - open/close/unlink 18397 (time 1780324494.77 total 267.04 last 62.39) - open/close/unlink 19119 (time 1780324504.79 total 277.06 last 72.10) - open/close/unlink 19866 (time 1780324514.79 total 287.06 last 74.68) - open/close/unlink 20000 (time 1780324516.89 total 289.16 last 63.75) - open/close/unlink 20852 (time 1780324526.90 total 299.17 last 85.17) - open/close/unlink 21605 (time 1780324536.90 total 309.17 last 75.24) - open/close/unlink 22381 (time 1780324546.91 total 319.18 last 77.56) - open/close/unlink 23144 (time 1780324556.91 total 329.18 last 76.29) - open/close/unlink 24077 (time 1780324566.93 total 339.20 last 93.12) - open/close/unlink 24731 (time 1780324576.93 total 349.20 last 65.39) - open/close/unlink 25572 (time 1780324586.94 total 359.21 last 84.05) - open/close/unlink 26327 (time 1780324596.94 total 369.21 last 75.44) - open/close/unlink 27082 (time 1780324606.95 total 379.22 last 75.47) - open/close/unlink 27877 (time 1780324616.95 total 389.22 last 79.45) - open/close/unlink 28740 (time 1780324626.96 total 399.23 last 86.25) - open/close/unlink 29635 (time 1780324636.96 total 409.24 last 89.45) - open/close/unlink 30000 (time 1780324641.68 total 413.95 last 77.49) - open/close/unlink 30766 (time 1780324651.68 total 423.95 last 76.57) - open/close/unlink 31681 (time 1780324661.69 total 433.96 last 91.42) - open/close/unlink 32691 (time 1780324671.69 total 443.96 last 100.99) - open/close/unlink 33651 (time 1780324681.69 total 453.96 last 96.00) - open/close/unlink 34517 (time 1780324691.69 total 463.96 last 86.59) - open/close/unlink 35593 (time 1780324701.70 total 473.97 last 107.51) - open/close/unlink 36619 (time 1780324711.71 total 483.98 last 102.52) - open/close/unlink 37598 (time 1780324721.74 total 494.01 last 97.58) - open/close/unlink 38485 (time 1780324731.75 total 504.02 last 88.63) - open/close/unlink 39690 (time 1780324741.75 total 514.02 last 120.45) - open/close/unlink 40000 (time 1780324744.67 total 516.94 last 106.33) - open/close/unlink 41153 (time 1780324754.67 total 526.94 last 115.27) - open/close/unlink 42421 (time 1780324764.67 total 536.94 last 126.80) - open/close/unlink 43509 (time 1780324774.69 total 546.96 last 108.63) - open/ - open/close/unlink 629 (time 1780324237.75 total 10.02 last 62.79) - open/close/unlink 1375 (time 1780324247.76 total 20.02 last 74.55) - open/close/unlink 2082 (time 1780324257.76 total 30.03 last 70.68) - open/close/unlink 2712 (time 1780324267.78 total 40.04 last 62.90) - open/close/unlink 3243 (time 1780324277.78 total 50.05 last 53.07) - open/close/unlink 3812 (time 1780324287.78 total 60.05 last 56.90) - open/close/unlink 4394 (time 1780324297.79 total 70.06 last 58.14) - open/close/unlink 5111 (time 1780324307.81 total 80.07 last 71.61) - open/close/unlink 5852 (time 1780324317.81 total 90.08 last 74.07) - open/close/unlink 6514 (time 1780324327.82 total 100.08 last 66.16) - open/close/unlink 7178 (time 1780324337.82 total 110.09 last 66.40) - open/close/unlink 8003 (time 1780324347.83 total 120.09 last 82.42) - open/close/unlink 8729 (time 1780324357.84 total 130.10 last 72.55) - open/close/unlink 9528 (time 1780324367.85 total 140.12 last 79.76) - open/close/unlink 10000 (time 1780324374.86 total 147.13 last 67.36) - open/close/unlink 10565 (time 1780324384.88 total 157.15 last 56.38) - open/close/unlink 11087 (time 1780324394.89 total 167.16 last 52.16) - open/close/unlink 11679 (time 1780324404.89 total 177.16 last 59.17) - open/close/unlink 12512 (time 1780324414.90 total 187.16 last 83.28) - open/close/unlink 13190 (time 1780324424.91 total 197.17 last 67.73) - open/close/unlink 13981 (time 1780324434.91 total 207.17 last 79.10) - open/close/unlink 14766 (time 1780324444.91 total 217.18 last 78.49) - open/close/unlink 15571 (time 1780324454.91 total 227.18 last 80.46) - open/close/unlink 16361 (time 1780324464.92 total 237.19 last 78.92) - open/close/unlink 17109 (time 1780324474.93 total 247.20 last 74.74) - open/close/unlink 17762 (time 1780324484.95 total 257.22 last 65.17) - open/close/unlink 18393 (time 1780324494.96 total 267.23 last 63.04) - open/close/unlink 19122 (time 1780324504.97 total 277.24 last 72.82) - open/close/unlink 19856 (time 1780324514.98 total 287.25 last 73.30) - open/close/unlink 20000 (time 1780324517.17 total 289.44 last 65.73) - open/close/unlink 20855 (time 1780324527.18 total 299.45 last 85.45) - open/close/unlink 21596 (time 1780324537.19 total 309.45 last 74.05) - open/close/unlink 22373 (time 1780324547.19 total 319.46 last 77.65) - open/close/unlink 23149 (time 1780324557.20 total 329.47 last 77.54) - open/close/unlink 24084 (time 1780324567.21 total 339.48 last 93.42) - open/close/unlink 24740 (time 1780324577.21 total 349.48 last 65.59) - open/close/unlink 25578 (time 1780324587.21 total 359.48 last 83.79) - open/close/unlink 26338 (time 1780324597.21 total 369.48 last 75.99) - open/close/unlink 27082 (time 1780324607.21 total 379.48 last 74.38) - open/close/unlink 27876 (time 1780324617.22 total 389.49 last 79.35) - open/close/unlink 28737 (time 1780324627.23 total 399.49 last 86.05) - open/close/unlink 29625 (time 1780324637.23 total 409.50 last 88.75) - open/close/unlink 30000 (time 1780324642.31 total 414.58 last 73.89) - open/close/unlink 30785 (time 1780324652.32 total 424.58 last 78.44) - open/close/unlink 31703 (time 1780324662.32 total 434.59 last 91.74) - open/close/unlink 32710 (time 1780324672.33 total 444.60 last 100.63) - open/close/unlink 33647 (time 1780324682.33 total 454.60 last 93.65) - open/close/unlink 34526 (time 1780324692.34 total 464.61 last 87.84) - open/close/unlink 35584 (time 1780324702.35 total 474.62 last 105.72) - open/close/unlink 36628 (time 1780324712.35 total 484.62 last 104.38) - open/close/unlink 37575 (time 1780324722.36 total 494.62 last 94.66) - open/close/unlink 38475 (time 1780324732.36 total 504.63 last 89.94) - open/close/unlink 39680 (time 1780324742.37 total 514.64 last 120.41) - open/close/unlink 40000 (time 1780324745.29 total 517.55 last 109.74) - open/close/unlink 41157 (time 1780324755.29 total 527.56 last 115.66) - open/close/unlink 42438 (time 1780324765.30 total 537.56 last 128.02) - open/close/unlink 43491 (time 1780324775.30 total 547.56 last 105.30) - open/ - open/close/unlink 633 (time 1780324237.76 total 10.01 last 63.26) - open/close/unlink 1380 (time 1780324247.76 total 20.01 last 74.66) - open/close/unlink 2081 (time 1780324257.78 total 30.03 last 70.00) - open/close/unlink 2705 (time 1780324267.78 total 40.03 last 62.37) - open/close/unlink 3245 (time 1780324277.79 total 50.04 last 53.97) - open/close/unlink 3815 (time 1780324287.79 total 60.04 last 56.98) - open/close/unlink 4404 (time 1780324297.82 total 70.07 last 58.76) - open/close/unlink 5124 (time 1780324307.82 total 80.07 last 71.96) - open/close/unlink 5864 (time 1780324317.83 total 90.08 last 73.93) - open/close/unlink 6535 (time 1780324327.85 total 100.10 last 66.99) - open/close/unlink 7196 (time 1780324337.85 total 110.10 last 66.10) - open/close/unlink 8009 (time 1780324347.85 total 120.10 last 81.25) - open/close/unlink 8747 (time 1780324357.86 total 130.11 last 73.77) - open/close/unlink 9556 (time 1780324367.89 total 140.14 last 80.63) - open/close/unlink 10000 (time 1780324374.42 total 146.67 last 67.99) - open/close/unlink 10572 (time 1780324384.43 total 156.68 last 57.14) - open/close/unlink 11105 (time 1780324394.45 total 166.70 last 53.21) - open/close/unlink 11683 (time 1780324404.45 total 176.70 last 57.79) - open/close/unlink 12509 (time 1780324414.45 total 186.70 last 82.58) - open/close/unlink 13182 (time 1780324424.45 total 196.71 last 67.29) - open/close/unlink 13982 (time 1780324434.46 total 206.71 last 79.99) - open/close/unlink 14768 (time 1780324444.46 total 216.71 last 78.60) - open/close/unlink 15589 (time 1780324454.47 total 226.72 last 81.95) - open/close/unlink 16361 (time 1780324464.47 total 236.73 last 77.20) - open/close/unlink 17118 (time 1780324474.48 total 246.73 last 75.68) - open/close/unlink 17780 (time 1780324484.48 total 256.73 last 66.19) - open/close/unlink 18416 (time 1780324494.49 total 266.74 last 63.52) - open/close/unlink 19121 (time 1780324504.50 total 276.75 last 70.45) - open/close/unlink 19876 (time 1780324514.50 total 286.75 last 75.45) - open/close/unlink 20669 (time 1780324524.51 total 296.76 last 79.25) - open/close/unlink 21435 (time 1780324534.52 total 306.77 last 76.54) - open/close/unlink 22177 (time 1780324544.52 total 316.77 last 74.16) - open/close/unlink 22953 (time 1780324554.53 total 326.78 last 77.57) - open/close/unlink 23919 (time 1780324564.53 total 336.78 last 96.54) - open/close/unlink 24617 (time 1780324574.54 total 346.79 last 69.75) - open/close/unlink 25359 (time 1780324584.55 total 356.80 last 74.17) - open/close/unlink 26194 (time 1780324594.55 total 366.80 last 83.45) - open/close/unlink 26950 (time 1780324604.55 total 376.80 last 75.60) - open/close/unlink 27718 (time 1780324614.56 total 386.81 last 76.72) - open/close/unlink 28526 (time 1780324624.56 total 396.81 last 80.80) - open/close/unlink 29457 (time 1780324634.57 total 406.82 last 93.07) - open/close/unlink 30000 (time 1780324641.40 total 413.65 last 79.42) - open/close/unlink 30758 (time 1780324651.41 total 423.66 last 75.73) - open/close/unlink 31662 (time 1780324661.42 total 433.67 last 90.35) - open/close/unlink 32675 (time 1780324671.42 total 443.67 last 101.25) - open/close/unlink 33643 (time 1780324681.42 total 453.68 last 96.77) - open/close/unlink 34501 (time 1780324691.43 total 463.68 last 85.75) - open/close/unlink 35565 (time 1780324701.44 total 473.69 last 106.31) - open/close/unlink 36596 (time 1780324711.44 total 483.69 last 103.10) - open/close/unlink 37579 (time 1780324721.44 total 493.69 last 98.28) - open/close/unlink 38442 (time 1780324731.44 total 503.69 last 86.29) - open/close/unlink 39642 (time 1780324741.44 total 513.69 last 120.00) - open/close/unlink 40000 (time 1780324744.80 total 517.05 last 106.71) - open/close/unlink 41166 (time 1780324754.80 total 527.05 last 116.57) - open/close/unlink 42432 (time 1780324764.81 total 537.06 last 126.51) - open/close/unlink 43520 (time 1780324774.83 total 547.08 last 108.59) - open/close/unlink 44574 (time 1780324784.83 total 557.08 last 105.39) - open - open/close/unlink 634 (time 1780324237.64 total 10.00 last 63.38) - open/close/unlink 1379 (time 1780324247.65 total 20.01 last 74.45) - open/close/unlink 2088 (time 1780324257.67 total 30.03 last 70.75) - open/close/unlink 2715 (time 1780324267.67 total 40.03 last 62.69) - open/close/unlink 3249 (time 1780324277.68 total 50.04 last 53.35) - open/close/unlink 3823 (time 1780324287.69 total 60.05 last 57.33) - open/close/unlink 4406 (time 1780324297.70 total 70.06 last 58.27) - open/close/unlink 5120 (time 1780324307.70 total 80.06 last 71.35) - open/close/unlink 5856 (time 1780324317.70 total 90.06 last 73.60) - open/close/unlink 6529 (time 1780324327.71 total 100.07 last 67.25) - open/close/unlink 7197 (time 1780324337.73 total 110.08 last 66.71) - open/close/unlink 8023 (time 1780324347.73 total 120.09 last 82.57) - open/close/unlink 8753 (time 1780324357.74 total 130.10 last 72.91) - open/close/unlink 9557 (time 1780324367.74 total 140.10 last 80.40) - open/close/unlink 10000 (time 1780324374.27 total 146.62 last 67.91) - open/close/unlink 10577 (time 1780324384.28 total 156.63 last 57.64) - open/close/unlink 11099 (time 1780324394.28 total 166.64 last 52.18) - open/close/unlink 11667 (time 1780324404.29 total 176.65 last 56.76) - open/close/unlink 12496 (time 1780324414.29 total 186.65 last 82.87) - open/close/unlink 13162 (time 1780324424.31 total 196.67 last 66.47) - open/close/unlink 13971 (time 1780324434.31 total 206.67 last 80.89) - open/close/unlink 14758 (time 1780324444.32 total 216.68 last 78.64) - open/close/unlink 15570 (time 1780324454.33 total 226.69 last 81.07) - open/close/unlink 16339 (time 1780324464.35 total 236.70 last 76.82) - open/close/unlink 17109 (time 1780324474.36 total 246.71 last 76.92) - open/close/unlink 17773 (time 1780324484.36 total 256.72 last 66.35) - open/close/unlink 18410 (time 1780324494.37 total 266.72 last 63.69) - open/close/unlink 19117 (time 1780324504.38 total 276.73 last 70.63) - open/close/unlink 19870 (time 1780324514.38 total 286.74 last 75.25) - open/close/unlink 20660 (time 1780324524.39 total 296.75 last 78.91) - open/close/unlink 21430 (time 1780324534.41 total 306.77 last 76.89) - open/close/unlink 22177 (time 1780324544.42 total 316.78 last 74.64) - open/close/unlink 22954 (time 1780324554.42 total 326.78 last 77.65) - open/close/unlink 23919 (time 1780324564.48 total 336.84 last 95.96) - open/close/unlink 24620 (time 1780324574.49 total 346.84 last 70.05) - open/close/unlink 25366 (time 1780324584.49 total 356.85 last 74.60) - open/close/unlink 26196 (time 1780324594.49 total 366.85 last 82.98) - open/close/unlink 26952 (time 1780324604.49 total 376.85 last 75.57) - open/close/unlink 27715 (time 1780324614.50 total 386.86 last 76.22) - open/close/unlink 28522 (time 1780324624.50 total 396.86 last 80.70) - open/close/unlink 29454 (time 1780324634.51 total 406.86 last 93.19) - open/close/unlink 30000 (time 1780324641.31 total 413.67 last 80.25) - open/close/unlink 30754 (time 1780324651.32 total 423.68 last 75.34) - open/close/unlink 31650 (time 1780324661.32 total 433.68 last 89.56) - open/close/unlink 32658 (time 1780324671.32 total 443.68 last 100.80) - open/close/unlink 33620 (time 1780324681.33 total 453.69 last 96.10) - open/close/unlink 34468 (time 1780324691.33 total 463.69 last 84.79) - open/close/unlink 35539 (time 1780324701.34 total 473.70 last 107.00) - open/close/unlink 36561 (time 1780324711.35 total 483.71 last 102.16) - open/close/unlink 37550 (time 1780324721.35 total 493.71 last 98.85) - open/close/unlink 38424 (time 1780324731.35 total 503.71 last 87.38) - open/close/unlink 39620 (time 1780324741.36 total 513.72 last 119.51) - open/close/unlink 40000 (time 1780324744.95 total 517.30 last 106.05) - open/close/unlink 41146 (time 1780324754.95 total 527.31 last 114.55) - open/close/unlink 42425 (time 1780324764.95 total 537.31 last 127.90) - open/close/unlink 43497 (time 1780324774.96 total 547.32 last 107.10) - open/close/unlink 44545 (time 1780324784.97 total 557.33 last 104.69) - open - open/close/unlink 625 (time 1780324237.31 total 10.02 last 62.41) - open/close/unlink 1358 (time 1780324247.31 total 20.02 last 73.29) - open/close/unlink 2070 (time 1780324257.33 total 30.03 last 71.12) - open/close/unlink 2696 (time 1780324267.34 total 40.04 last 62.50) - open/close/unlink 3225 (time 1780324277.36 total 50.06 last 52.80) - open/close/unlink 3791 (time 1780324287.37 total 60.07 last 56.55) - open/close/unlink 4373 (time 1780324297.37 total 70.08 last 58.17) - open/close/unlink 5086 (time 1780324307.38 total 80.08 last 71.26) - open/close/unlink 5817 (time 1780324317.39 total 90.10 last 73.00) - open/close/unlink 6492 (time 1780324327.40 total 100.11 last 67.44) - open/close/unlink 7155 (time 1780324337.42 total 110.12 last 66.22) - open/close/unlink 7975 (time 1780324347.42 total 120.12 last 81.98) - open/close/unlink 8693 (time 1780324357.43 total 130.13 last 71.73) - open/close/unlink 9502 (time 1780324367.44 total 140.15 last 80.76) - open/close/unlink 10000 (time 1780324374.86 total 147.56 last 67.14) - open/close/unlink 10564 (time 1780324384.86 total 157.57 last 56.39) - open/close/unlink 11098 (time 1780324394.88 total 167.58 last 53.33) - open/close/unlink 11683 (time 1780324404.88 total 177.59 last 58.46) - open/close/unlink 12514 (time 1780324414.89 total 187.60 last 83.01) - open/close/unlink 13193 (time 1780324424.90 total 197.60 last 67.84) - open/close/unlink 13988 (time 1780324434.91 total 207.61 last 79.48) - open/close/unlink 14772 (time 1780324444.91 total 217.61 last 78.39) - open/close/unlink 15576 (time 1780324454.91 total 227.62 last 80.35) - open/close/unlink 16367 (time 1780324464.91 total 237.62 last 79.10) - open/close/unlink 17123 (time 1780324474.92 total 247.62 last 75.53) - open/close/unlink 17776 (time 1780324484.92 total 257.63 last 65.29) - open/close/unlink 18405 (time 1780324494.93 total 267.63 last 62.85) - open/close/unlink 19130 (time 1780324504.95 total 277.65 last 72.41) - open/close/unlink 19873 (time 1780324514.95 total 287.65 last 74.26) - open/close/unlink 20677 (time 1780324524.96 total 297.66 last 80.35) - open/close/unlink 21440 (time 1780324534.96 total 307.66 last 76.26) - open/close/unlink 22189 (time 1780324544.96 total 317.67 last 74.88) - open/close/unlink 22959 (time 1780324554.96 total 327.67 last 77.00) - open/close/unlink 23927 (time 1780324564.97 total 337.67 last 96.76) - open/close/unlink 24609 (time 1780324574.97 total 347.67 last 68.18) - open/close/unlink 25370 (time 1780324584.98 total 357.68 last 76.07) - open/close/unlink 26183 (time 1780324594.98 total 367.68 last 81.25) - open/close/unlink 26930 (time 1780324604.99 total 377.70 last 74.61) - open/close/unlink 27699 (time 1780324615.00 total 387.70 last 76.89) - open/close/unlink 28514 (time 1780324625.00 total 397.70 last 81.46) - open/close/unlink 29441 (time 1780324635.01 total 407.72 last 92.56) - open/close/unlink 30000 (time 1780324642.17 total 414.87 last 78.13) - open/close/unlink 30772 (time 1780324652.17 total 424.88 last 77.16) - open/close/unlink 31689 (time 1780324662.18 total 434.88 last 91.66) - open/close/unlink 32696 (time 1780324672.18 total 444.88 last 100.68) - open/close/unlink 33644 (time 1780324682.19 total 454.89 last 94.73) - open/close/unlink 34525 (time 1780324692.19 total 464.89 last 88.08) - open/close/unlink 35575 (time 1780324702.20 total 474.90 last 104.89) - open/close/unlink 36614 (time 1780324712.21 total 484.91 last 103.85) - open/close/unlink 37557 (time 1780324722.23 total 494.94 last 94.04) - open/close/unlink 38451 (time 1780324732.24 total 504.94 last 89.36) - open/close/unlink 39651 (time 1780324742.24 total 514.94 last 119.98) - open/close/unlink 40000 (time 1780324745.36 total 518.07 last 111.75) - open/close/unlink 41154 (time 1780324755.37 total 528.07 last 115.35) - open/close/unlink 42443 (time 1780324765.37 total 538.08 last 128.82) - open/close/unlink 43490 (time 1780324775.38 total 548.08 last 104.65) - open/close/unlink 44540 (time 1780324785.38 total 558.08 last 104.97) - open/close/unlink 45733 (time 1780324794.83 total 567.08 last 115.84) - open/close/unlink 47239 (time 1780324804.84 total 577.09 last 150.49) - open/close/unlink 48994 (time 1780324814.84 total 587.09 last 175.50) - open/close/unlink 50000 (time 1780324821.33 total 593.58 last 154.92) - open/close/unlink 51479 (time 1780324831.34 total 603.59 last 147.88) - open/close/unlink 52926 (time 1780324841.34 total 613.59 last 144.65) - open/close/unlink 54143 (time 1780324851.35 total 623.60 last 121.60) - open/close/unlink 55249 (time 1780324861.36 total 633.61 last 110.44) - open/close/unlink 56451 (time 1780324871.36 total 643.62 last 120.17) - open/close/unlink 57516 (time 1780324881.37 total 653.62 last 106.48) - open/close/unlink 58735 (time 1780324891.37 total 663.62 last 121.87) - open/close/unlink 59934 (time 1780324901.38 total 673.63 last 119.79) - open/close/unlink 61326 (time 1780324911.38 total 683.63 last 139.19) - open/close/unlink 62521 (time 1780324921.38 total 693.63 last 119.44) - open/close/unlink 63519 (time 1780324931.39 total 703.64 last 99.72) - open/close/unlink 64396 (time 1780324941.40 total 713.65 last 87.68) total: 64768 open/close/unlink in 717.55 seconds: 90.26 ops/second close/unlink 44557 (time 1780324784.69 total 556.96 last 104.73) - open/close/unlink 45721 (time 1780324794.69 total 566.96 last 116.38) - open/close/unlink 47228 (time 1780324804.69 total 576.97 last 150.69) - open/close/unlink 48966 (time 1780324814.70 total 586.97 last 173.68) - open/close/unlink 50000 (time 1780324821.33 total 593.60 last 155.94) - open/close/unlink 51482 (time 1780324831.34 total 603.61 last 148.09) - open/close/unlink 52932 (time 1780324841.34 total 613.61 last 144.98) - open/close/unlink 54145 (time 1780324851.35 total 623.62 last 121.19) - open/close/unlink 55247 (time 1780324861.36 total 633.64 last 110.04) - open/close/unlink 56426 (time 1780324871.37 total 643.65 last 117.78) - open/close/unlink 57480 (time 1780324881.38 total 653.65 last 105.36) - open/close/unlink 58703 (time 1780324891.38 total 663.65 last 122.28) - open/close/unlink 59904 (time 1780324901.39 total 673.66 last 120.03) - open/close/unlink 61299 (time 1780324911.39 total 683.66 last 139.46) - open/close/unlink 62474 (time 1780324921.39 total 693.66 last 117.46) - open/close/unlink 63471 (time 1780324931.40 total 703.67 last 99.64) - open/close/unlink 64349 (time 1780324941.41 total 713.68 last 87.71) total: 64768 open/close/unlink in 718.62 seconds: 90.13 ops/second /close/unlink 45715 (time 1780324794.97 total 567.33 last 117.00) - open/close/unlink 47221 (time 1780324804.97 total 577.33 last 150.59) - open/close/unlink 48970 (time 1780324814.98 total 587.33 last 174.81) - open/close/unlink 50000 (time 1780324821.45 total 593.81 last 159.09) - open/close/unlink 51487 (time 1780324831.45 total 603.81 last 148.68) - open/close/unlink 52930 (time 1780324841.45 total 613.81 last 144.29) - open/close/unlink 54140 (time 1780324851.46 total 623.82 last 120.91) - open/close/unlink 55231 (time 1780324861.47 total 633.83 last 108.99) - open/close/unlink 56413 (time 1780324871.47 total 643.83 last 118.18) - open/close/unlink 57466 (time 1780324881.47 total 653.83 last 105.30) - open/close/unlink 58685 (time 1780324891.48 total 663.84 last 121.85) - open/close/unlink 59890 (time 1780324901.48 total 673.84 last 120.43) - open/close/unlink 61276 (time 1780324911.48 total 683.84 last 138.56) - open/close/unlink 62462 (time 1780324921.49 total 693.85 last 118.57) - open/close/unlink 63457 (time 1780324931.49 total 703.85 last 99.48) - open/close/unlink 64335 (time 1780324941.49 total 713.85 last 87.77) total: 64768 open/close/unlink in 719.21 seconds: 90.05 ops/second /close/unlink 45742 (time 1780324795.39 total 568.09 last 120.11) - open/close/unlink 47260 (time 1780324805.39 total 578.09 last 151.79) - open/close/unlink 48985 (time 1780324815.39 total 588.09 last 172.50) - open/close/unlink 50000 (time 1780324821.74 total 594.44 last 159.87) - open/close/unlink 51503 (time 1780324831.74 total 604.44 last 150.26) - open/close/unlink 52940 (time 1780324841.75 total 614.45 last 143.63) - open/close/unlink 54151 (time 1780324851.75 total 624.45 last 121.04) - open/close/unlink 55241 (time 1780324861.75 total 634.45 last 109.00) - open/close/unlink 56433 (time 1780324871.76 total 644.46 last 119.11) - open/close/unlink 57486 (time 1780324881.76 total 654.46 last 105.27) - open/close/unlink 58702 (time 1780324891.77 total 664.47 last 121.55) - open/close/unlink 59907 (time 1780324901.77 total 674.47 last 120.46) - open/close/unlink 61308 (time 1780324911.77 total 684.47 last 140.07) - open/close/unlink 62461 (time 1780324921.77 total 694.48 last 115.27) - open/close/unlink 63458 (time 1780324931.77 total 704.48 last 99.70) - open/close/unlink 64329 (time 1780324941.78 total 714.48 last 87.07) total: 64768 open/close/unlink in 720.25 seconds: 89.92 ops/second close/unlink 44551 (time 1780324785.30 total 557.57 last 105.92) - open/close/unlink 45757 (time 1780324795.30 total 567.57 last 120.59) - open/close/unlink 47272 (time 1780324805.31 total 577.57 last 151.46) - open/close/unlink 48987 (time 1780324815.31 total 587.58 last 171.47) - open/close/unlink 50000 (time 1780324821.72 total 593.99 last 157.95) - open/close/unlink 51479 (time 1780324831.73 total 604.00 last 147.80) - open/close/unlink 52927 (time 1780324841.73 total 614.00 last 144.71) - open/close/unlink 54128 (time 1780324851.74 total 624.00 last 120.10) - open/close/unlink 55213 (time 1780324861.74 total 634.01 last 108.45) - open/close/unlink 56395 (time 1780324871.75 total 644.01 last 118.13) - open/close/unlink 57443 (time 1780324881.75 total 654.02 last 104.78) - open/close/unlink 58673 (time 1780324891.75 total 664.02 last 122.96) - open/close/unlink 59883 (time 1780324901.76 total 674.03 last 120.91) - open/close/unlink 61283 (time 1780324911.76 total 684.03 last 139.94) - open/close/unlink 62444 (time 1780324921.76 total 694.03 last 116.10) - open/close/unlink 63435 (time 1780324931.77 total 704.04 last 99.04) - open/close/unlink 64317 (time 1780324941.78 total 714.05 last 88.11) total: 64768 open/close/unlink in 720.09 seconds: 89.94 ops/second Waiting for MDT destroys to complete oleg412-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg412-client: oleg412-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg412-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg412-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg412-server stop mds service on oleg412-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg412-server stop mds service on oleg412-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg412-server unloading modules via unload_modules_local on: 'oleg412-server' oleg412-server: oleg412-server.virtnet: executing unload_modules_local oleg412-server: modules unloaded. pdsh@oleg412-client: oleg412-client: ssh exited with exit code 2 pdsh@oleg412-client: oleg412-server: ssh exited with exit code 2 pdsh@oleg412-client: oleg412-server: ssh exited with exit code 2 pdsh@oleg412-client: oleg412-client: ssh exited with exit code 2