== replay-dual test 31: deadlock on file_remove_privs and occupied mod rpc slots ========================================================== 03:10:19 (1788592219) Failing ost1 on oleg446-server Stopping /mnt/lustre-ost1 (opts:) on oleg446-server Creating to objid 2337 on ost lustre-OST0000... total: 32 open/close in 1.50 seconds: 21.33 ops/second 03:10:28 (1788592228) shut down facet: ost1 facet_host: oleg446-server facet_failover_host: oleg446-server at_max=0 fail_loc=0x80001420 file /mnt/lustre2/d31.replay-dual/mdtdir/f31.replay-dual is not ready, wait 0.5 second... file /mnt/lustre2/d31.replay-dual/mdtdir/f31.replay-dual is ready Failover ost1 to oleg446-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-OST0000 03:10:55 (1788592255) targets are mounted 03:10:55 (1788592255) facet_failover done oleg446-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in IDLE FULL state after 0 sec pids: 72352 72354 72359 72360 72361 72362 72363 72364 72365 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210432 2560 2205824 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210560 2176 2206336 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 5120 7533568 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 523931 397 523534 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 528823 316 528507 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 118332 572 117760 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118299 507 117792 1% /mnt/lustre[OST:1] filesystem_summary: 236265 713 235552 1% /mnt/lustre at_max=600