00010000:00010000:1.0F:1783350091.467649:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0F:1783350092.171178:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1783350092.171208:0:17067:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ea3586a93c0 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:2.0:1783350092.171213:0:17067:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36dcb2400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ea3586a9300 00000020:00080000:2.0:1783350092.171217:0:17067:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36dcb2600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ea37462de00 00000020:00080000:1.0:1783350092.171257:0:17126:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:1.0:1783350092.171335:0:17126:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0F:1783350092.171443:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350092.171462:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350092.171469:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350092.171475:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374603800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350092.171479:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350092.171486:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350092.171502:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:3.0:1783350092.171504:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350092.171509:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350092.171514:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350092.484464:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350093.195531:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659583616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783350093.195597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.195651:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783350093.195658:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659583744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783350093.195682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.195715:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659583616 00000100:00100000:1.0:1783350093.195722:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659583616 00000100:00100000:1.0:1783350093.195765:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659583744 00000100:00100000:1.0:1783350093.195769:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659583744 00000100:00100000:1.0:1783350093.195787:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783350093.195797:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659583616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783350093.195827:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783350093.195868:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659583616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.195875:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783350093.195891:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783350093.195898:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659583744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783350093.195912:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783350093.195934:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659583744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.195940:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1783350093.195955:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783350093.195958:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783350093.195982:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659583744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783350093.196006:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659583616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783350093.196237:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659583872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783350093.196263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.196280:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783350093.196286:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659584000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783350093.196321:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.196357:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659583872 00000100:00100000:1.0:1783350093.196361:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659583872 00000100:00100000:1.0:1783350093.196382:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659584000 00000100:00100000:1.0:1783350093.196385:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659584000 00000100:00100000:1.0:1783350093.196401:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783350093.196408:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659583872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783350093.197689:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783350093.197754:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659583872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1344us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.197764:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783350093.197788:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783350093.197798:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659584000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783350093.197811:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783350093.197842:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659584000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.197849:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1783350093.197871:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783350093.197876:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783350093.197891:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659584128:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.197940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.197983:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659584640:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.198010:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.198031:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659585152:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.198052:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.198085:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783350093.198093:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659584256:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.198118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.198163:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659584768:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.198186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.198215:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659584384:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.198237:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.198254:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659584896:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.198276:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.200618:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659584000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783350093.200656:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659583872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783350093.200693:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783350093.200701:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659584512:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.200755:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.200785:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659585024:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.200805:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350093.200849:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659584128 00000100:00100000:1.0:1783350093.200855:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659584128 00000100:00100000:1.0:1783350093.200900:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783350093.200909:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3646:x1869977659584128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.200984:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3646:x1869977659584128:12345-0@lo:400:kworker.0 Request processed in 75us (3043us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.200991:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783350093.201022:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659584640 00000100:00100000:1.0:1783350093.201026:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659584640 00000100:00100000:1.0:1783350093.201044:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659585152 00000100:00100000:1.0:1783350093.201046:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659585152 00000100:00100000:1.0:1783350093.201065:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659584768 00000100:00100000:1.0:1783350093.201068:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659584768 00000100:00100000:1.0:1783350093.201090:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659584384 00000100:00100000:1.0:1783350093.201092:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659584384 00000100:00100000:1.0:1783350093.201103:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659584896 00000100:00100000:1.0:1783350093.201105:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659584896 00000100:00100000:1.0:1783350093.201115:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659585024 00000100:00100000:1.0:1783350093.201117:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659585024 00000100:00100000:1.0:1783350093.201130:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783350093.201151:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659584640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.201186:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659584640:12345-0@lo:400:kworker.0 Request processed in 50us (3175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.201192:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783350093.201204:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783350093.201210:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659585152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.201238:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659585152:12345-0@lo:400:kworker.0 Request processed in 29us (3184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.201244:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783350093.201254:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783350093.201260:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659584768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.201287:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659584768:12345-0@lo:400:kworker.0 Request processed in 28us (3101us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.201816:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783350093.201834:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783350093.201841:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659584384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.201924:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659584384:12345-0@lo:400:kworker.0 Request processed in 84us (3685us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.201931:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783350093.201944:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783350093.201950:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659584896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.201979:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659584896:12345-0@lo:400:kworker.0 Request processed in 30us (3703us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.201984:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783350093.201994:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783350093.202000:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659585024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.202028:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659585024:12345-0@lo:400:kworker.0 Request processed in 28us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.202034:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783350093.202058:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659584256 00000100:00100000:1.0:1783350093.202063:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659584256 00000100:00100000:1.0:1783350093.202099:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659584512 00000100:00100000:1.0:1783350093.202103:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659584512 00000100:00100000:1.0:1783350093.202120:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783350093.202127:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659584256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.202186:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659584256:12345-0@lo:400:kworker.0 Request processed in 59us (4066us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.202193:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783350093.202213:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783350093.202220:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659584512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.202253:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659584512:12345-0@lo:400:kworker.0 Request processed in 34us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350093.202259:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783350093.202323:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659584256:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.202338:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659584768:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.202348:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659584128:0@lo:400:kworker.0 00000100:00100000:1.0:1783350093.202359:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659584640:0@lo:400:kworker.0 00010000:00080000:1.0:1783350093.202374:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370d65880 x1869977659585152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350093.202385:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659585152:0@lo:400:kworker.0 00000100:00080000:1.0:1783350093.202412:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783350093.202415:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783350093.205679:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659584384:0@lo:400:kworker.0 00010000:00080000:2.0:1783350093.205699:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370d67100 x1869977659584896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350093.205710:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659584896:0@lo:400:kworker.0 00000100:00100000:2.0:1783350093.205737:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659584512:0@lo:400:kworker.0 00000100:00100000:2.0:1783350093.205746:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659585024:0@lo:400:kworker.0 00000100:00100000:3.0:1783350093.409152:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350093.409200:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350093.409218:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350093.409259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350093.409279:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350093.417857:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0F:1783350093.427237:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642740736 00000100:00100000:0.0:1783350093.427263:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642740736 00000100:00100000:0.0:1783350093.427329:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642741120 00000100:00100000:0.0:1783350093.427333:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642741120 00000100:00100000:0.0:1783350093.427346:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642741248 00000100:00100000:0.0:1783350093.427348:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642741248 00000100:00100000:0.0:1783350093.427359:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642740608 00000100:00100000:0.0:1783350093.427362:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642740608 00000100:00100000:0.0:1783350093.427382:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1783350093.427392:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642740608:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350093.427423:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:3.0:1783350093.427435:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2398:x1869977642740736:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:3.0:1783350093.427468:0:18595:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e36aa 00000100:00100000:0.0:1783350093.427476:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642740608:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 83us (18193us total) trans 0 rc 0/0 00000100:00080000:3.0:1783350093.427485:0:18595:0:(import.c:65:import_set_state_nolock()) ffff8ea367399800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783350093.427485:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1783350093.427507:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:0.0:1783350093.427517:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2398:x1869977642741120:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:0.0:1783350093.427530:0:19278:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e36e2 00000001:00000004:3.0:1783350093.427537:0:18595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:0.0:1783350093.427542:0:19278:0:(import.c:65:import_set_state_nolock()) ffff8ea2437dd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783350093.427579:0:19278:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1783350093.427674:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+2:2398:x1869977642740736:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 241us (18545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350093.427682:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:3.0:1783350093.427704:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:0.0:1783350093.427704:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+2:2398:x1869977642741120:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 184us (18499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350093.427713:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2398:x1869977642741248:12345-192.168.203.50@tcp:9:kworker.0 00000100:00100000:0.0:1783350093.427718:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 28 00000020:00000080:3.0:1783350093.427731:0:18595:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e36e9 00000100:00080000:3.0:1783350093.427737:0:18595:0:(import.c:65:import_set_state_nolock()) ffff8ea2437df000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1783350093.427746:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783350093.427751:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1783350093.427759:0:18595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1783350093.427806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350093.427820:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+2:2398:x1869977642741248:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 107us (18598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350093.427828:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:3.0:1783350093.427850:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642740352 00000100:00100000:3.0:1783350093.427854:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642740352 00000100:00100000:0.0:1783350093.427873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350093.427899:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642740992 00000100:00100000:3.0:1783350093.427904:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642740992 00000100:00100000:3.0:1783350093.427921:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642740480 00000100:00100000:3.0:1783350093.427924:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642740480 00000100:00100000:3.0:1783350093.427940:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:3.0:1783350093.427946:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+13:2402:x1869977642740352:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350093.427977:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+13:2402:x1869977642740352:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 30us (18716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350093.427983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350093.427992:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:3.0:1783350093.428023:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642740864 00000100:00100000:3.0:1783350093.428036:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642740864 00000100:00100000:3.0:1783350093.428060:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:3.0:1783350093.428067:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642740992:12345-192.168.203.50@tcp:400:kworker.0 00010000:00010000:0.0:1783350093.428092:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350093.428104:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642740224 00000100:00100000:0.0:1783350093.428108:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642740224 00000100:00100000:3.0:1783350093.428111:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642740992:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 43us (10261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350093.428120:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:3.0:1783350093.428153:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:3.0:1783350093.428161:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2401:x1869977642740480:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350093.428182:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 169 00000100:00100000:3.0:1783350093.428190:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2401:x1869977642740480:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 28us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350093.428195:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2401:x1869977642740224:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350093.428202:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:3.0:1783350093.428219:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:0.0:1783350093.428230:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2401:x1869977642740224:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 39us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350093.428237:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 169 00000100:00080000:0.0:1783350093.428268:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783350093.428271:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783350093.428304:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350093.428310:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350093.428705:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2401:x1869977642740864:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350093.428744:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2401:x1869977642740864:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 518us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350093.428752:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 81 00010000:00010000:2.0:1783350093.509301:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350093.700610:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659585280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350093.700685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350093.700728:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659585408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350093.700750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350093.700790:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659585280 00000100:00100000:2.0:1783350093.700797:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659585280 00000100:00100000:2.0:1783350093.700831:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659585408 00000100:00100000:2.0:1783350093.700833:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659585408 00000100:00100000:2.0:1783350093.700848:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783350093.700855:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659585280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350093.700885:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1783350093.700921:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659585280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350093.700927:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783350093.700951:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783350093.700956:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659585408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783350093.700969:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783350093.700996:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659585408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 40us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350093.701002:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783350093.701065:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659585280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350093.701101:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659585408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783350094.339727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350094.339833:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642741376 00000100:00100000:2.0:1783350094.339843:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642741376 00000100:00100000:2.0:1783350094.339898:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:2.0:1783350094.339908:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+13:15560:x1869977642741376:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783350094.339998:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+13:15560:x1869977642741376:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350094.340007:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:2.0:1783350094.341871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350094.341903:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642741504 00000100:00100000:2.0:1783350094.341911:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642741504 00000100:00100000:2.0:1783350094.341956:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:2.0:1783350094.341966:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:15560:x1869977642741504:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783350094.342080:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:15560:x1869977642741504:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 Request processed in 105us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350094.342087:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:3.0:1783350094.360238:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350094.360336:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642741760 00000100:00100000:0.0:1783350094.360346:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642741760 00000100:00100000:0.0:1783350094.360408:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:0.0:1783350094.360419:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+13:15560:x1869977642741760:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783350094.360930:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+14:15560:x1869977642741760:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 510us (696us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1783350094.360949:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00010000:00010000:0.0:1783350094.533449:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783350094.660776:0:17847:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783350095.557268:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350096.587459:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350097.604377:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350098.308607:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659585664:0@lo:400:kworker.0 00000100:00100000:1.0:1783350098.308654:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659585536:0@lo:400:kworker.0 00000100:00100000:3.0:1783350098.308700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350098.308705:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350098.308781:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659585920:0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.308815:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350098.308845:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659585920 00000100:00100000:0.0:1783350098.308853:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659585920 00000100:00100000:0.0:1783350098.308907:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783350098.308917:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659585920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.308966:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659585920:12345-0@lo:400:kworker.0 Request processed in 51us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350098.308988:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1783350098.309008:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783350098.309126:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659585536 00000100:00100000:0.0:1783350098.309129:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659585536 00000100:00100000:0.0:1783350098.309185:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783350098.309191:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3649:x1869977659585536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.309224:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3649:x1869977659585536:12345-0@lo:400:kworker.0 Request processed in 33us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350098.309230:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783350098.309494:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659585792:0@lo:400:kworker.0 00000100:00100000:1.0:1783350098.309602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350098.309633:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659585792 00000100:00100000:1.0:1783350098.309637:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659585792 00000100:00080000:0.0:1783350098.309665:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783350098.309676:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783350098.309686:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659585792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.309701:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659585664 00000100:00100000:0.0:1783350098.309707:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659585664 00000100:00100000:1.0:1783350098.309728:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659585792:12345-0@lo:400:kworker.0 Request processed in 44us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350098.309743:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783350098.309753:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659585664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.309791:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659585664:12345-0@lo:400:kworker.0 Request processed in 40us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350098.309797:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783350098.310116:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783350098.310299:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659585664:0@lo:400:kworker.0 00000100:00100000:3.0:1783350098.310310:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659586176:0@lo:400:kworker.0 00000100:00100000:3.0:1783350098.310765:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350098.311450:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659586176 00000100:00100000:2.0:1783350098.311460:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659586176 00000100:00100000:2.0:1783350098.311518:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783350098.311527:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659586176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350098.311595:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659586176:12345-0@lo:400:kworker.0 Request processed in 68us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350098.311602:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783350098.316259:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659585920:0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.316274:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659586432:0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.316339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350098.316373:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659586944:0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.316404:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350098.316444:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659587456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783350098.316467:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350098.316484:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783350098.316504:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659587584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783350098.316527:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350098.316570:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659586432 00000100:00100000:0.0:1783350098.316577:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659586432 00000100:00100000:0.0:1783350098.316628:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783350098.316637:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659586432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.316688:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659586432:12345-0@lo:400:kworker.0 Request processed in 51us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350098.316695:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783350098.316716:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659586944 00000100:00100000:0.0:1783350098.316720:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659586944 00000100:00100000:0.0:1783350098.316745:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783350098.316751:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659586944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.316779:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659586944:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350098.316786:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1783350098.316800:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783350098.317925:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783350098.317969:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659586432:0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.317983:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659586944:0@lo:400:kworker.0 00000100:00100000:1.0:1783350098.318087:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659587456 00000100:00100000:1.0:1783350098.318092:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659587456 00000100:00100000:1.0:1783350098.318164:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659587584 00000100:00100000:1.0:1783350098.318168:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659587584 00000100:00100000:1.0:1783350098.318193:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783350098.318202:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659587456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783350098.318228:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783350098.318294:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659587456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350098.318301:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783350098.318315:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783350098.318330:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659587584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783350098.318345:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783350098.318371:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659587584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350098.318377:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783350098.318414:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659587584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783350098.318427:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659587456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783350098.318473:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659585536:0@lo:400:kworker.0 00000100:00100000:1.0:1783350098.318482:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659586048:0@lo:400:kworker.0 00000100:00100000:1.0:1783350098.318511:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350098.318537:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659586560:0@lo:400:kworker.0 00000100:00100000:1.0:1783350098.318559:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350098.318604:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659587072:0@lo:400:kworker.0 00000100:00100000:1.0:1783350098.318627:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350098.318656:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659586048 00000100:00100000:2.0:1783350098.318662:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659586048 00000100:00100000:1.0:1783350098.318672:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659586560 00000100:00100000:1.0:1783350098.318678:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659586560 00000100:00100000:2.0:1783350098.318696:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659587072 00000100:00100000:2.0:1783350098.318701:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659587072 00000100:00100000:1.0:1783350098.318705:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783350098.318713:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659586048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350098.318726:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783350098.318735:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659586560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350098.318777:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659586560:12345-0@lo:400:kworker.0 Request processed in 43us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350098.318783:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783350098.318795:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783350098.318801:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659587072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350098.318830:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659587072:12345-0@lo:400:kworker.0 Request processed in 29us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350098.318836:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783350098.318922:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659586048:12345-0@lo:400:kworker.0 Request processed in 209us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350098.318929:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783350098.318960:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659586048:0@lo:400:kworker.0 00000100:00100000:1.0:1783350098.318972:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659586560:0@lo:400:kworker.0 00010000:00080000:1.0:1783350098.318984:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea24477a300 x1869977659587072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350098.318996:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659587072:0@lo:400:kworker.0 00000001:00080000:2.0:1783350098.319020:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1783350098.319029:0:17067:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:1.0:1783350098.319123:0:17126:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:1.0:1783350098.319133:0:17126:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000100:00080000:0.0:1783350098.319279:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783350098.319283:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783350098.319315:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659585792:0@lo:400:kworker.0 00000100:00100000:3.0:1783350098.319502:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659586176:0@lo:400:kworker.0 00000100:00100000:3.0:1783350098.319521:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659586688:0@lo:400:kworker.0 00000100:00100000:3.0:1783350098.319550:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350098.319600:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659587200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783350098.319625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350098.319738:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659586304:0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.319767:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350098.319794:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659586816:0@lo:400:kworker.0 00000100:00100000:0.0:1783350098.319824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350098.319842:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659587328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783350098.319861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350098.319892:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659587200 00000100:00100000:0.0:1783350098.319896:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659587200 00000100:00100000:0.0:1783350098.319915:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659587328 00000100:00100000:0.0:1783350098.319917:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659587328 00000100:00100000:0.0:1783350098.319929:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783350098.319936:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659587200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783350098.319951:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783350098.319983:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659587200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350098.319990:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783350098.320002:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783350098.320008:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659587328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783350098.320032:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1783350098.320051:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659586688 00000100:00100000:2.0:1783350098.320057:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659586688 00000100:00100000:1.0:1783350098.320096:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659586816 00000100:00100000:1.0:1783350098.320100:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659586816 00000100:00100000:3.0:1783350098.320206:0:19527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659586304 00000100:00100000:3.0:1783350098.320210:0:19527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659586304 00000100:00100000:3.0:1783350098.320238:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783350098.320245:0:19527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659586304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350098.320281:0:19527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659586304:12345-0@lo:400:kworker.0 Request processed in 37us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350098.320287:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783350098.320316:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659586304:0@lo:400:kworker.0 00000100:00100000:3.0:1783350098.320357:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659587200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783350098.320747:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659587328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 737us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350098.320753:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1783350098.320772:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783350098.320775:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783350098.320844:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783350098.320853:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659586688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350098.320893:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659586688:12345-0@lo:400:kworker.0 Request processed in 42us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350098.320899:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783350098.320911:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783350098.320917:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659586816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350098.320957:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659586816:12345-0@lo:400:kworker.0 Request processed in 40us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350098.320963:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1783350098.321281:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36ccea680 x1869977659586816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350098.321294:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659586816:0@lo:400:kworker.0 00000100:00100000:3.0:1783350098.321310:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659587328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783350098.321353:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659586688:0@lo:400:kworker.0 00000100:00100000:2.0:1783350098.520725:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350098.520772:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350098.520805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350098.520858:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350098.520886:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350098.520912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350098.520935:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642742016 00000100:00100000:2.0:1783350098.520944:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642742016 00000100:00100000:2.0:1783350098.520990:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642742528 00000100:00100000:2.0:1783350098.520993:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642742528 00000100:00100000:2.0:1783350098.521007:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642742144 00000100:00100000:2.0:1783350098.521009:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642742144 00000100:00100000:2.0:1783350098.521020:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642742400 00000100:00100000:2.0:1783350098.521023:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642742400 00000100:00100000:2.0:1783350098.521047:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:2.0:1783350098.521056:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+13:2402:x1869977642742016:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350098.521178:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+13:2402:x1869977642742016:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 79us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350098.521186:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:2.0:1783350098.521203:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 89 00000100:00100000:2.0:1783350098.521210:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642742528:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350098.521236:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642742528:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350098.521243:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 89 00000100:00100000:2.0:1783350098.521446:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 90 00000100:00100000:2.0:1783350098.521457:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642742144:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350098.521484:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642742144:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 30us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350098.521491:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 90 00000100:00100000:2.0:1783350098.521513:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:2.0:1783350098.521520:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2402:x1869977642742400:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350098.521546:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2402:x1869977642742400:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350098.521552:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:3.0:1783350098.521818:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642742272 00000100:00100000:3.0:1783350098.521824:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642742272 00000100:00100000:3.0:1783350098.521871:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:3.0:1783350098.521888:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642742272:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350098.521918:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642742272:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 41us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350098.521931:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:0.0:1783350098.523002:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642741888 00000100:00100000:0.0:1783350098.523012:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642741888 00000100:00100000:0.0:1783350098.523077:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 171 00000100:00100000:0.0:1783350098.523087:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2402:x1869977642741888:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350098.523184:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2402:x1869977642741888:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 99us (2325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350098.523201:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 171 00000100:00080000:0.0:1783350098.523493:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783350098.523498:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783350098.523501:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783350098.628446:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350098.823952:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659587712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350098.824022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350098.824110:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659587712 00000100:00100000:0.0:1783350098.824120:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659587712 00000100:00100000:0.0:1783350098.824201:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783350098.824210:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659587712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783350098.824263:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1783350098.824312:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659587712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350098.824320:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783350098.825590:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659587712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350098.831244:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783350098.831277:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659587840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350098.831364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350098.831816:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659587840 00000100:00100000:1.0:1783350098.831826:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659587840 00000100:00100000:1.0:1783350098.831881:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783350098.831891:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659587840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783350098.831925:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783350098.831990:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659587840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350098.831997:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783350098.832123:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659587840:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1783350099.346698:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000020:00000080:1.0:1783350099.346707:0:18590:0:(genops.c:906:class_export_put()) final put ffff8ea2437de000/07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000020:00000080:0.0:1783350099.346773:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2437de000/07a332e1-ec8f-4f86-8530-dd43a8d09e28 for lustre-OST0000 00000020:00000080:0.0:1783350099.346825:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea2437dd000 for lustre-OST0000 00000001:00100000:1.0:1783350099.347117:0:19408:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000020:00000080:1.0:1783350099.347121:0:19408:0:(genops.c:906:class_export_put()) final put ffff8ea2437de800/07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000001:00100000:1.0:1783350099.347162:0:19408:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8a2801b7-a361-434c-b0c3-f6ccaa904300 00000020:00000080:1.0:1783350099.347165:0:19408:0:(genops.c:906:class_export_put()) final put ffff8ea36739f000/8a2801b7-a361-434c-b0c3-f6ccaa904300 00000020:00000080:0.0:1783350099.347231:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2437de800/07a332e1-ec8f-4f86-8530-dd43a8d09e28 for lustre-OST0001 00000020:00000080:0.0:1783350099.347261:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36739f000/8a2801b7-a361-434c-b0c3-f6ccaa904300 for lustre-OST0001 00000020:00000080:0.0:1783350099.347276:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea2437df000 for lustre-OST0001 00000020:00000080:0.0:1783350099.347286:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea367399800 for lustre-OST0001 00000001:02000400:1.0:1783350099.530396:0:20478:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 11:01:36 (1783350096) 00010000:00010000:2.0:1783350099.653522:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783350099.845971:0:17125:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783350099.845978:0:17125:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783350099.845997:0:17125:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783350099.846004:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1783350100.685918:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350101.714265:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350102.724923:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350103.428680:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659588352:0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.428747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350103.428797:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659588864:0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.428820:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350103.428834:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659589376:0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.428857:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350103.428890:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1783350103.428895:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659588224:0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.428922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350103.428944:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659588736:0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.428964:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350103.428978:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659589248:0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.429006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350103.429020:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659589760:0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.429038:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350103.429076:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659588224 00000100:00100000:0.0:1783350103.429082:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659588224 00000100:00100000:0.0:1783350103.429127:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783350103.429161:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3647:x1869977659588224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.429211:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3647:x1869977659588224:12345-0@lo:400:kworker.0 Request processed in 77us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350103.429230:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783350103.429261:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659589376 00000100:00100000:0.0:1783350103.429265:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659589376 00000100:00100000:0.0:1783350103.429339:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659588736 00000100:00100000:0.0:1783350103.429342:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659588736 00000100:00100000:0.0:1783350103.429355:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659589248 00000100:00100000:0.0:1783350103.429357:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659589248 00000100:00100000:0.0:1783350103.429366:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659589760 00000100:00100000:0.0:1783350103.429368:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659589760 00000100:00100000:0.0:1783350103.429380:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783350103.429386:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659589376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.429416:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659589376:12345-0@lo:400:kworker.0 Request processed in 30us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350103.429428:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783350103.429439:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783350103.429444:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659588736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.429469:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659588736:12345-0@lo:400:kworker.0 Request processed in 25us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350103.429475:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783350103.429485:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783350103.429491:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659589248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.429513:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659589248:12345-0@lo:400:kworker.0 Request processed in 23us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350103.429519:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783350103.429529:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783350103.429534:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659589760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.429557:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659589760:12345-0@lo:400:kworker.0 Request processed in 23us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350103.429563:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1783350103.429581:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783350103.429584:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783350103.429603:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659588224:0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.429616:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659588736:0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.429624:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659589248:0@lo:400:kworker.0 00010000:00080000:0.0:1783350103.429635:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36ce0b800 x1869977659589760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350103.429657:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659589760:0@lo:400:kworker.0 00000100:00100000:0.0:1783350103.429668:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659589376:0@lo:400:kworker.0 00000100:00100000:2.0:1783350103.429983:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659588352 00000100:00100000:2.0:1783350103.429988:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659588352 00000100:00100000:2.0:1783350103.430033:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659588864 00000100:00100000:2.0:1783350103.430036:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659588864 00000100:00100000:2.0:1783350103.430052:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783350103.430058:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659588352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350103.430104:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659588352:12345-0@lo:400:kworker.0 Request processed in 45us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350103.430110:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783350103.430124:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783350103.430129:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659588864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350103.430189:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659588864:12345-0@lo:400:kworker.0 Request processed in 60us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350103.430195:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783350103.430238:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659588352:0@lo:400:kworker.0 00000100:00100000:2.0:1783350103.430247:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659588864:0@lo:400:kworker.0 00000100:00100000:1.0:1783350103.430437:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659587968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783350103.430471:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350103.430493:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659588480:0@lo:400:kworker.0 00000100:00100000:1.0:1783350103.430516:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350103.430535:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659588992:0@lo:400:kworker.0 00000100:00100000:1.0:1783350103.430556:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350103.430572:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659589504:0@lo:400:kworker.0 00000100:00100000:1.0:1783350103.430606:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350103.430627:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1783350103.430633:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659588096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783350103.430664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350103.430683:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659588608:0@lo:400:kworker.0 00000100:00100000:1.0:1783350103.430703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350103.430716:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659589120:0@lo:400:kworker.0 00000100:00100000:1.0:1783350103.430732:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350103.430744:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659589632:0@lo:400:kworker.0 00000100:00100000:1.0:1783350103.430762:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350103.430804:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659589504 00000100:00100000:1.0:1783350103.430808:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659589504 00000100:00100000:1.0:1783350103.430836:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659589632 00000100:00100000:1.0:1783350103.430838:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659589632 00000100:00100000:1.0:1783350103.430853:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783350103.430858:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659589504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350103.430893:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659589504:12345-0@lo:400:kworker.0 Request processed in 34us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350103.430899:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783350103.430912:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783350103.430918:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659589632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350103.430942:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659589632:12345-0@lo:400:kworker.0 Request processed in 25us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350103.430948:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783350103.430966:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659587968 00000100:00100000:1.0:1783350103.430970:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659587968 00000100:00100000:1.0:1783350103.430993:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659588096 00000100:00100000:1.0:1783350103.431005:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659588096 00000100:00100000:1.0:1783350103.431019:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783350103.431025:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659587968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783350103.431045:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783350103.431075:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659587968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350103.431086:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783350103.431096:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783350103.431103:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659588096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783350103.431116:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783350103.431199:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659588096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350103.431205:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783350103.431664:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659589888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783350103.431695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350103.437489:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659588480 00000100:00100000:3.0:1783350103.437505:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659588480 00000100:00100000:3.0:1783350103.437571:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659588992 00000100:00100000:3.0:1783350103.437574:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659588992 00000100:00100000:3.0:1783350103.437591:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659588608 00000100:00100000:3.0:1783350103.437593:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659588608 00000100:00100000:3.0:1783350103.437605:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659589120 00000100:00100000:3.0:1783350103.437608:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659589120 00000100:00100000:3.0:1783350103.437630:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783350103.437639:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659588480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350103.437729:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659588480:12345-0@lo:400:kworker.0 Request processed in 90us (7211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350103.437737:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783350103.437752:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783350103.437758:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659588992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350103.437788:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659588992:12345-0@lo:400:kworker.0 Request processed in 30us (7231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350103.437794:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783350103.437804:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783350103.437809:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659588608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350103.437837:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659588608:12345-0@lo:400:kworker.0 Request processed in 28us (7133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350103.437858:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783350103.437870:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783350103.437875:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659589120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350103.437904:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659589120:12345-0@lo:400:kworker.0 Request processed in 29us (7170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350103.437910:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783350103.438060:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783350103.438077:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659590016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783350103.438180:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659589888 00000100:00100000:0.0:1783350103.438185:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659589888 00000100:00100000:0.0:1783350103.438211:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783350103.438218:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659589888:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783350103.438555:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783350103.438589:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783350103.438593:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783350103.438596:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783350103.438598:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783350103.438635:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659588096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783350103.438648:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659588608:0@lo:400:kworker.0 00000100:00100000:3.0:1783350103.438658:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659589120:0@lo:400:kworker.0 00000100:00100000:3.0:1783350103.438670:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659589632:0@lo:400:kworker.0 00000100:00100000:3.0:1783350103.438682:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659587968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783350103.438691:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659588480:0@lo:400:kworker.0 00000100:00100000:3.0:1783350103.438700:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659588992:0@lo:400:kworker.0 00010000:00080000:3.0:1783350103.438713:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36ce0bb80 x1869977659589504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350103.438725:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659589504:0@lo:400:kworker.0 00000100:00100000:3.0:1783350103.438781:0:18598:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1783350103.438790:0:18598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1783350103.438895:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659590016 00000100:00100000:3.0:1783350103.438898:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659590016 00000100:00100000:3.0:1783350103.438975:0:20587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783350103.438982:0:20587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659590016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783350103.439020:0:20587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783350103.439058:0:20587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659590016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350103.439065:0:20587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783350103.439103:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659590016:0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783350103.440366:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783350103.440430:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659589888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2210us (8731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350103.440437:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783350103.440550:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659589888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783350103.653185:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350103.653232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350103.653260:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350103.653293:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350103.653319:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350103.653342:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350103.653367:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642743040 00000100:00100000:2.0:1783350103.653375:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642743040 00000100:00100000:2.0:1783350103.653432:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:2.0:1783350103.653442:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2399:x1869977642743040:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350103.653511:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2399:x1869977642743040:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 69us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350103.653519:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00080000:3.0:1783350103.653937:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350103.653952:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642742784 00000100:00100000:3.0:1783350103.653956:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642742784 00000100:00100000:3.0:1783350103.653989:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642742912 00000100:00100000:3.0:1783350103.653992:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642742912 00000100:00100000:3.0:1783350103.654014:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642743168 00000100:00100000:3.0:1783350103.654017:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642743168 00000100:00100000:3.0:1783350103.654027:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642743296 00000100:00100000:3.0:1783350103.654029:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642743296 00000100:00100000:3.0:1783350103.654042:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 98 00000100:00100000:3.0:1783350103.654048:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+13:2399:x1869977642742784:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350103.654085:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+13:2399:x1869977642742784:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 36us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350103.654092:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 98 00000100:00100000:3.0:1783350103.654105:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 99 00000100:00100000:3.0:1783350103.654124:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2400:x1869977642742912:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350103.654174:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2400:x1869977642742912:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 51us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350103.654181:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 99 00000100:00100000:3.0:1783350103.654192:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 100 00000100:00100000:3.0:1783350103.654198:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2400:x1869977642743168:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350103.654228:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2400:x1869977642743168:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 19us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350103.654234:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 100 00000100:00100000:3.0:1783350103.654246:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00100000:3.0:1783350103.654253:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2399:x1869977642743296:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350103.654276:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2399:x1869977642743296:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350103.654282:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00080000:3.0:1783350103.654297:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783350103.654300:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783350103.655197:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642742656 00000100:00100000:0.0:1783350103.655205:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642742656 00000100:00100000:0.0:1783350103.655251:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 173 00000100:00100000:0.0:1783350103.655259:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2400:x1869977642742656:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350103.655297:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2400:x1869977642742656:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 40us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350103.655304:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 173 00010000:00010000:0.0:1783350103.748865:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350103.940431:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659590144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350103.940501:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350103.940594:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659590144 00000100:00100000:1.0:1783350103.940602:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659590144 00000100:00100000:1.0:1783350103.940655:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783350103.940664:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659590144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783350103.940698:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783350103.940745:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659590144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350103.940753:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783350103.940910:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659590144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350103.941133:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783350103.941158:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659590272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350103.941199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350103.941358:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659590272 00000100:00100000:0.0:1783350103.941364:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659590272 00000100:00100000:0.0:1783350103.941394:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783350103.941401:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659590272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783350103.941418:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1783350103.941460:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659590272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350103.941473:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783350103.941542:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659590272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783350104.343204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350104.343272:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642743552 00000100:00100000:1.0:1783350104.343281:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642743552 00000100:00100000:1.0:1783350104.343341:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:1.0:1783350104.343350:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+13:16322:x1869977642743552:12345-192.168.203.50@tcp:35:umount.0 00000001:00080000:1.0:1783350104.343589:0:17090:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1783350104.343670:0:17090:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:1.0:1783350104.343794:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+16:16322:x1869977642743552:12345-192.168.203.50@tcp:35:umount.0 Request processed in 444us (597us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1783350104.343803:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000020:00080000:1.0:1783350104.343808:0:17090:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1783350104.348530:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350104.348630:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642743680 00000100:00100000:0.0:1783350104.348639:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642743680 00000100:00100000:0.0:1783350104.348705:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1783350104.348715:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2400:x1869977642743680:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350104.348731:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350104.348750:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e3680 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded25a expref: 13 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350104.348767:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350104.348826:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:2400:x1869977642743680:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 111us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350104.348834:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:3.0:1783350104.348919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350104.349245:0:19527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642744064 00000100:00100000:0.0:1783350104.349251:0:19527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642744064 00000100:00100000:0.0:1783350104.349286:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:0.0:1783350104.349294:0:19527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2398:x1869977642744064:12345-192.168.203.50@tcp:9:umount.0 00000020:00000080:0.0:1783350104.349325:0:19527:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e36a3 00000100:00080000:0.0:1783350104.349333:0:19527:0:(import.c:65:import_set_state_nolock()) ffff8ea241d23000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783350104.349386:0:19527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1783350104.349512:0:19527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a2801b7-a361-434c-b0c3-f6ccaa904300+2:2398:x1869977642744064:12345-192.168.203.50@tcp:9:umount.0 Request processed in 218us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350104.349520:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 30 00010000:00010000:2.0:1783350104.349605:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350104.350505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350104.350577:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642743808 00000100:00100000:0.0:1783350104.350584:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642743808 00000100:00100000:0.0:1783350104.350648:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:0.0:1783350104.350658:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243254c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:2399:x1869977642743808:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350104.350683:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350104.350702:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e3687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded28b expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350104.350717:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350104.350761:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243254c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:2399:x1869977642743808:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 105us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350104.350768:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:2.0:1783350104.356485:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350104.356564:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350104.356725:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642743936 00000100:00100000:1.0:1783350104.356735:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642743936 00000100:00100000:3.0:1783350104.356743:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642744960 00000100:00100000:3.0:1783350104.356746:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642744960 00000100:00100000:3.0:1783350104.356881:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:3.0:1783350104.356891:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+16:2398:x1869977642744960:12345-192.168.203.50@tcp:39:umount.0 00000020:00000080:3.0:1783350104.356923:0:17088:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3695 00000020:00010000:3.0:1783350104.356938:0:17088:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ea2435c4800: total 0 00000100:00080000:3.0:1783350104.356956:0:17088:0:(import.c:65:import_set_state_nolock()) ffff8ea2435c7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783350104.357003:0:17088:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1783350104.357122:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:1.0:1783350104.357129:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:2400:x1869977642743936:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783350104.357158:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350104.357175:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e3744 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded341 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350104.357180:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+15:2398:x1869977642744960:12345-192.168.203.50@tcp:39:umount.0 Request processed in 291us (615us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1783350104.357188:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 67 00010000:00010000:1.0:1783350104.357191:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350104.357209:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:2400:x1869977642743936:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 81us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350104.357215:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000020:00010000:0.0:1783350104.357249:0:17075:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ea2435c4800: total 0 00010000:00010000:0.0:1783350104.357252:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350104.357303:0:17075:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ea2435c4800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1783350104.357328:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:0.0:1783350104.357331:0:17075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783350104.357338:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cca00/0xd05e6ae1590e3760 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded348 expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350104.357358:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:0.0:1783350104.357361:0:17075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783350104.357365:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e3840 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded387 expref: 13 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350104.357381:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:0.0:1783350104.357384:0:17075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783350104.357387:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602e00/0xd05e6ae1590e38ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3c6 expref: 12 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350104.357400:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:0.0:1783350104.357403:0:17075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783350104.357414:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b1 expref: 11 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350104.357430:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2431f9f00) 00010000:00010000:0.0:1783350104.357432:0:17075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783350104.357436:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e37bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded35d expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350104.357449:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:0.0:1783350104.357451:0:17075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783350104.357455:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e394a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3db expref: 9 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350104.357471:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:0.0:1783350104.357474:0:17075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783350104.357477:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e39ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3fe expref: 8 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350104.357492:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea2424c5900) 00010000:00010000:0.0:1783350104.357494:0:17075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783350104.357498:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc000/0xd05e6ae1590e377c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded34f expref: 7 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350104.357510:0:17075:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ea2435c4800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1783350104.357526:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350104.357528:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350104.357530:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350104.368980:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350104.369076:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642745088 00000100:00100000:0.0:1783350104.369093:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642745088 00000100:00100000:0.0:1783350104.369185:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:0.0:1783350104.369249:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2398:x1869977642745088:12345-192.168.203.50@tcp:39:umount.0 00000020:00000080:0.0:1783350104.369380:0:17089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e369c 00000100:00080000:0.0:1783350104.369398:0:17089:0:(import.c:65:import_set_state_nolock()) ffff8ea2435c3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783350104.369423:0:17089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1783350104.369540:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350104.369630:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+3:2398:x1869977642745088:12345-192.168.203.50@tcp:39:umount.0 Request processed in 384us (656us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783350104.369638:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 68 00010000:00010000:2.0:1783350104.773249:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783350104.965131:0:17847:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783350105.799419:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350106.516735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350106.516813:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350106.517010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350106.524915:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642745216 00000100:00100000:3.0:1783350106.524928:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642745216 00000100:00100000:3.0:1783350106.525320:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642745472 00000100:00100000:3.0:1783350106.525324:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642745472 00000100:00100000:3.0:1783350106.525341:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642745344 00000100:00100000:3.0:1783350106.525343:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642745344 00000100:00100000:3.0:1783350106.525363:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:3.0:1783350106.525372:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:2399:x1869977642745216:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783350106.525387:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783350106.525405:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e36bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded2ca expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350106.525424:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783350106.525493:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:2399:x1869977642745216:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 122us (8768us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350106.525500:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:3.0:1783350106.525517:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:3.0:1783350106.525524:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d738a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:2399:x1869977642745472:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783350106.525531:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783350106.525540:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e373d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded33a expref: 10 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350106.525568:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783350106.525588:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d738a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02fc5821-de16-4655-b2ee-a46099f9f1d8+9:2399:x1869977642745472:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 65us (8774us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350106.525595:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:3.0:1783350106.525607:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:3.0:1783350106.525613:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02fc5821-de16-4655-b2ee-a46099f9f1d8+8:2399:x1869977642745344:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783350106.525620:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783350106.525628:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8e800/0xd05e6ae1590e36c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded2fb expref: 8 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350106.526564:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783350106.526602:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02fc5821-de16-4655-b2ee-a46099f9f1d8+7:2399:x1869977642745344:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 986us (9591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350106.526610:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:3.0:1783350106.527094:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350106.528537:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642745728 00000100:00100000:1.0:1783350106.528550:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642745728 00000100:00100000:1.0:1783350106.528622:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:1.0:1783350106.528643:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2398:x1869977642745728:12345-192.168.203.50@tcp:39:umount.0 00000020:00000080:1.0:1783350106.528681:0:19423:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e36d4 00000020:00010000:1.0:1783350106.528701:0:19423:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ea374652800: total 0 00000100:00080000:1.0:1783350106.528706:0:19423:0:(import.c:65:import_set_state_nolock()) ffff8ea374650000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783350106.528728:0:19423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:1.0:1783350106.528893:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2398:x1869977642745728:12345-192.168.203.50@tcp:39:umount.0 Request processed in 263us (1801us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1783350106.528901:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 69 00000020:00010000:1.0:1783350106.528921:0:19530:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ea374652800: total 0 00010000:00010000:1.0:1783350106.528991:0:19530:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ea374652800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783350106.529027:0:19530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2431f9f00) 00010000:00010000:1.0:1783350106.529031:0:19530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783350106.529037:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e37c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded364 expref: 4 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350106.529059:0:19530:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ea374652800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783350106.529070:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350106.529071:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350106.529073:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783350106.529796:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783350106.548067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350106.548163:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642745856 00000100:00100000:2.0:1783350106.548173:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642745856 00000100:00100000:2.0:1783350106.548255:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:2.0:1783350106.548267:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2398:x1869977642745856:12345-192.168.203.50@tcp:39:umount.0 00000020:00000080:2.0:1783350106.548309:0:17087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e36db 00000100:00080000:2.0:1783350106.548318:0:17087:0:(import.c:65:import_set_state_nolock()) ffff8ea374651000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783350106.548349:0:17087:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1783350106.548490:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+3:2398:x1869977642745856:12345-192.168.203.50@tcp:39:umount.0 Request processed in 225us (431us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783350106.548497:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 70 00010000:00010000:1.0:1783350106.548852:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783350106.548956:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783350106.577055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350106.577186:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642746112 00000100:00100000:0.0:1783350106.577196:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642746112 00000100:00100000:0.0:1783350106.577256:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 174 00000100:00100000:0.0:1783350106.577266:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+7:2398:x1869977642746112:12345-192.168.203.50@tcp:251:umount.0 00000020:00000080:0.0:1783350106.577310:0:17079:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3672 00000020:00010000:0.0:1783350106.577318:0:17079:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ea36739c000: total 0 00000100:00080000:0.0:1783350106.577322:0:17079:0:(import.c:65:import_set_state_nolock()) ffff8ea36739d800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783350106.577389:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+3:2398:x1869977642746112:12345-192.168.203.50@tcp:251:umount.0 Request processed in 124us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350106.577397:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 174 00000020:00010000:1.0:1783350106.577518:0:17075:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ea36739c000: total 0 00010000:00010000:1.0:1783350106.577650:0:17075:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ea36739c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783350106.577686:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3679 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded253 expref: 2 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350106.577700:0:17075:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ea36739c000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1783350106.577711:0:17075:0:(genops.c:906:class_export_put()) final put ffff8ea36739c000/02fc5821-de16-4655-b2ee-a46099f9f1d8 00010000:00010000:1.0:1783350106.577728:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350106.577730:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350106.577743:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783350106.577923:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36739c000/02fc5821-de16-4655-b2ee-a46099f9f1d8 for MGS 00000020:00000080:2.0:1783350106.577964:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36739d800 for MGS 00010000:00010000:1.0:1783350106.824656:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350107.844360:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783350108.198659:0:20674:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783350108.213367:0:20674:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1783350108.213796:0:20674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.213811:0:20674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.213819:0:20674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.213827:0:20674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.213855:0:20674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783350108.213860:0:20674:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783350108.213887:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783350108.213892:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783350108.213898:0:20674:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783350108.213921:0:20674:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783350108.213969:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659590400:0@lo:39:umount.0 00000100:00100000:3.0:1783350108.214101:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783350108.214895:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350108.214903:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.214912:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364aa00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783350108.214915:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.214937:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350108.214945:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350108.214951:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783350108.214954:0:17075:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783350108.214957:0:17075:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783350108.214995:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.215001:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783350108.215023:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.215029:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.215040:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350108.215041:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350108.215043:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350108.215056:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659590528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783350108.215094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350108.215393:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659590528 00000100:00100000:3.0:1783350108.215401:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659590528 00000100:00100000:3.0:1783350108.215450:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783350108.215459:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3647:x1869977659590528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783350108.215487:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783350108.215502:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea24364ac00/0xd05e6ae1590e323c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e3235 expref: 24 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350108.215528:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783350108.215561:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:3647:x1869977659590528:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350108.215569:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783350108.215610:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659590528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350108.215691:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659590400 00000100:00100000:1.0:1783350108.215695:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659590400 00000100:00100000:1.0:1783350108.215731:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783350108.215738:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869977659590400:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783350108.215759:0:19423:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3266 00000100:00080000:1.0:1783350108.215766:0:19423:0:(import.c:65:import_set_state_nolock()) ffff8ea36ccd8800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783350108.215900:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1869977659590400:12345-0@lo:39:umount.0 Request processed in 163us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350108.215913:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1783350108.215920:0:19423:0:(genops.c:906:class_export_put()) final put ffff8ea36ccdc000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1783350108.215939:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783350108.216898:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36ccdc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783350108.216955:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36ccd8800 for lustre-MDT0000 00000100:00080000:3.0:1783350108.217004:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783350108.217016:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659590400:0@lo:39:umount.0 00000100:00080000:1.0:1783350108.217701:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783350108.217706:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783350108.217711:0:20674:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783350108.220649:0:20674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.220667:0:20674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.220674:0:20674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.220680:0:20674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.220747:0:20674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350108.220753:0:20674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.220759:0:20674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.220764:0:20674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.220770:0:20674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.220899:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783350108.220907:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.220914:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783350108.220924:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.220932:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350108.220940:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350108.220946:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783350108.220948:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1783350108.220994:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.221000:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783350108.221035:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.221042:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.221056:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350108.221059:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.221065:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783350108.221067:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.221072:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350108.221088:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350108.221093:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783350108.221095:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1783350108.221107:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.221112:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783350108.221118:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350108.221125:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350108.221127:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350108.221129:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350108.221211:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659590656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783350108.221365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350108.221448:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783350108.221454:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659590784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783350108.221478:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783350108.221695:0:20674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783350108.221701:0:20674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350108.221714:0:20674:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783350108.221805:0:20674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.221814:0:20674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.221820:0:20674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.221826:0:20674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.221840:0:20674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350108.221847:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350108.221852:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.221858:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8de00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350108.221861:0:19530:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.221869:0:19530:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783350108.221889:0:19530:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350108.221895:0:19530:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783350108.221897:0:19530:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783350108.221899:0:19530:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783350108.221915:0:19530:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.221921:0:19530:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783350108.221939:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.221945:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.221955:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350108.221956:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350108.221958:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350108.221982:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659590912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350108.222014:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783350108.222044:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350108.222375:0:20674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350108.222384:0:20674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350108.222391:0:20674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350108.222404:0:20674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350108.222418:0:20674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783350108.222422:0:20674:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1783350108.222425:0:20674:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1783350108.222469:0:20674:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783350108.222473:0:20674:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1783350108.222477:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783350108.222483:0:20674:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1783350108.222487:0:20674:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ea347514000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783350108.222493:0:20674:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ea2437ae000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783350108.222498:0:20674:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ea36d6f2000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783350108.222502:0:20674:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ea375e39000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783350108.222509:0:20674:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8ea374652800 07a332e1-ec8f-4f86-8530-dd43a8d09e28 192.168.203.50@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1783350108.222514:0:20674:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8ea2435c4800 8a2801b7-a361-434c-b0c3-f6ccaa904300 192.168.203.50@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1783350108.222518:0:20674:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8ea36d143380) has exports, disconnecting them 00000020:00080000:0.0:1783350108.222522:0:20674:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ea347514000), last request at 1783350103 00000020:00000080:0.0:1783350108.222528:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e349d 00000100:00080000:0.0:1783350108.222543:0:20674:0:(import.c:65:import_set_state_nolock()) ffff8ea241d25000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783350108.222585:0:20674:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea347514000): rc 0 00000020:00000080:0.0:1783350108.222588:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea347514000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783350108.222597:0:20674:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ea2437ae000), last request at 1783350103 00000020:00000080:0.0:1783350108.222600:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e340a 00000100:00080000:0.0:1783350108.222604:0:20674:0:(import.c:65:import_set_state_nolock()) ffff8ea2437ab800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783350108.222624:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea347514000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783350108.222660:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea241d25000 for lustre-MDT0000 00010000:00010000:0.0:1783350108.222669:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350108.222674:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350108.222680:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350108.222684:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350108.222692:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350108.222698:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350108.222703:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783350108.222705:0:17075:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783350108.222706:0:17075:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1783350108.222725:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350108.222730:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350108.222739:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350108.222745:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350108.222754:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350108.222756:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350108.222763:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783350108.222774:0:20674:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea2437ae000): rc 0 00000020:00000080:0.0:1783350108.222777:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea2437ae000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1783350108.222797:0:20674:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ea36d6f2000), last request at 1783350032 00000020:00000080:0.0:1783350108.222800:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3354 00000100:00080000:0.0:1783350108.222804:0:20674:0:(import.c:65:import_set_state_nolock()) ffff8ea36d6f6800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783350108.222815:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2437ae000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783350108.222838:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea2437ab800 for lustre-MDT0000 00010000:00010000:0.0:1783350108.222845:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783350108.222851:0:20674:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea36d6f2000): rc 0 00000020:00000080:0.0:1783350108.222854:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea36d6f2000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1783350108.222861:0:20674:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ea375e39000), last request at 1783350032 00000020:00000080:0.0:1783350108.222864:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e32eb 00000100:00080000:0.0:1783350108.222867:0:20674:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3f800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783350108.222876:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d6f2000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783350108.222895:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36d6f6800 for lustre-MDT0000 00010000:00010000:0.0:1783350108.222902:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1783350108.222908:0:20674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:0.0:1783350108.223038:0:20674:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea375e39000): rc 0 00000004:00000080:0.0:1783350108.223045:0:20674:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9d9847de7ae0 00000100:00080000:0.0:1783350108.223064:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783350108.223067:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783350108.224388:0:20674:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783350108.224415:0:20674:0:(import.c:65:import_set_state_nolock()) ffff8ea345adf000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783350108.224600:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783350108.224604:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1783350108.224616:0:20674:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783350108.224682:0:20674:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783350108.224693:0:20674:0:(import.c:65:import_set_state_nolock()) ffff8ea243259000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783350108.224711:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783350108.224713:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1783350108.224728:0:20674:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783350108.224861:0:20674:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783350108.224873:0:20674:0:(import.c:65:import_set_state_nolock()) ffff8ea36d970000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783350108.224914:0:20674:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8ea36d143380) has no exports 00000100:00100000:3.0:1783350108.225070:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659591040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783350108.225126:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659591168:0@lo:39:umount.0 00000100:00100000:3.0:1783350108.225204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350108.225228:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659591296:0@lo:9:umount.0 00000100:00100000:3.0:1783350108.225431:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350108.225451:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659591424:0@lo:9:umount.0 00000100:00100000:3.0:1783350108.225470:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350108.225503:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659591168 00000100:00100000:3.0:1783350108.225510:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659591168 00000100:00100000:3.0:1783350108.225561:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783350108.225568:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869977659591168:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783350108.225593:0:17093:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e337e 00000100:00080000:3.0:1783350108.225601:0:17093:0:(import.c:65:import_set_state_nolock()) ffff8ea36d6f3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783350108.225620:0:17093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1783350108.225728:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3645:x1869977659591168:12345-0@lo:39:umount.0 Request processed in 159us (523us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1783350108.225735:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783350108.225757:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659591296 00000100:00100000:3.0:1783350108.225761:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659591296 00000100:00100000:3.0:1783350108.225796:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659591424 00000100:00100000:3.0:1783350108.225798:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659591424 00000100:00100000:3.0:1783350108.225816:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783350108.225822:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869977659591296:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783350108.225835:0:18595:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e34ea 00000100:00080000:3.0:1783350108.225840:0:18595:0:(import.c:65:import_set_state_nolock()) ffff8ea36739a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783350108.225872:0:18595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1783350108.225948:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3645:x1869977659591296:12345-0@lo:9:umount.0 Request processed in 125us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350108.225954:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783350108.225981:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783350108.225987:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869977659591424:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783350108.225998:0:18595:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e34dc 00000100:00080000:3.0:1783350108.226003:0:18595:0:(import.c:65:import_set_state_nolock()) ffff8ea36739e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783350108.226019:0:18595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1783350108.226092:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3645:x1869977659591424:12345-0@lo:9:umount.0 Request processed in 105us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350108.226098:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1783350108.226129:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783350108.226165:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783350108.226176:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783350108.226219:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea345adf000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783350108.226226:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659591168:0@lo:39:umount.0 00000100:00080000:3.0:1783350108.226236:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243259000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783350108.226644:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783350108.226647:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783350108.226652:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659591296:0@lo:9:umount.0 00000100:00080000:3.0:1783350108.226667:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d970000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783350108.226674:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783350108.226676:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783350108.226678:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659591424:0@lo:9:umount.0 00000100:00100000:1.0:1783350108.227491:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659590656 00000100:00100000:1.0:1783350108.227499:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659590656 00000100:00100000:1.0:1783350108.227536:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659590784 00000100:00100000:1.0:1783350108.227539:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659590784 00000100:00100000:1.0:1783350108.227552:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659590912 00000100:00100000:1.0:1783350108.227555:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659590912 00000100:00100000:1.0:1783350108.227570:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783350108.227578:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d774e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+25:3648:x1869977659590656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350108.227607:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350108.227624:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3417c6800/0xd05e6ae1590e318d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e3186 expref: 25 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.227638:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350108.227683:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d774e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3648:x1869977659590656:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (6318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350108.227690:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783350108.227705:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783350108.227710:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243257c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:3648:x1869977659590784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350108.227717:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350108.227727:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3417c7800/0xd05e6ae1590e34d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e34ce expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.227735:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350108.227755:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243257c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:3648:x1869977659590784:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (6276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350108.227761:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783350108.227807:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783350108.227813:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:3646:x1869977659590912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350108.227820:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350108.227829:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e3736 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e372f expref: 21 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.227838:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350108.227863:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:3646:x1869977659590912:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (5848us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350108.227877:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783350108.227900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350108.227925:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659591040 00000100:00100000:1.0:1783350108.227929:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659591040 00000100:00100000:1.0:1783350108.227946:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783350108.227951:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:3647:x1869977659591040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350108.227957:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350108.227979:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3417c7600/0xd05e6ae1590e317f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e3178 expref: 20 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350108.227988:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350108.228014:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:3647:x1869977659591040:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350108.228019:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783350108.228047:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659591040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350108.228066:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350108.228078:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659590912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350108.228095:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659590784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350108.228103:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659590656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783350108.228725:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783350108.236911:0:20674:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8ea36d143380) has no exports 00000020:00000080:0.0:1783350108.294078:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e31d3 00000020:00000080:0.0:1783350108.294094:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea357ed9800/lustre-QMT0000_UUID 00000020:01000000:0.0:1783350108.294116:0:20674:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783350108.294427:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea357ed9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1783350108.294582:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350108.294591:0:20674:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783350108.294596:0:20674:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8ea24351b380) has no exports 00000020:00000080:1.0:1783350108.294881:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e31cc 00000020:00000080:1.0:1783350108.294886:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea357f73800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783350108.294940:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350108.294948:0:20674:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783350108.294976:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea36d919800/lustre-QMT0000_UUID 00000020:00000080:1.0:1783350108.294978:0:20674:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d919800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1783350108.294985:0:20674:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1783350108.295124:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea357f73800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1783350108.548546:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659591552:0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.548612:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350108.548651:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659592064:0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.548676:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350108.548697:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783350108.548702:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659591680:0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.548726:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350108.548744:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659592192:0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.548776:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350108.548823:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659591808:0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.548844:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350108.548858:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659592320:0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.548875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350108.548891:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783350108.548897:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659591936:0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.548915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350108.548928:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659592448:0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.548944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350108.548978:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659591680 00000100:00100000:1.0:1783350108.548985:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659591680 00000100:00100000:1.0:1783350108.549068:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659591808 00000100:00100000:1.0:1783350108.549070:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659591808 00000100:00100000:1.0:1783350108.549089:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783350108.549113:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659591680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.549207:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659591680:12345-0@lo:400:kworker.0 Request processed in 95us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350108.549214:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783350108.549230:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783350108.549236:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659591808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.549265:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659591808:12345-0@lo:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350108.549271:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783350108.549286:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659592064 00000100:00100000:1.0:1783350108.549289:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659592064 00000100:00100000:1.0:1783350108.549302:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659592192 00000100:00100000:1.0:1783350108.549305:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659592192 00000100:00100000:1.0:1783350108.549317:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659592320 00000100:00100000:1.0:1783350108.549319:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659592320 00000100:00100000:1.0:1783350108.549326:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659591936 00000100:00100000:1.0:1783350108.549328:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659591936 00000100:00100000:1.0:1783350108.549334:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659592448 00000100:00100000:1.0:1783350108.549336:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659592448 00000100:00100000:1.0:1783350108.549349:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783350108.549355:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659592192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.549385:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659592192:12345-0@lo:400:kworker.0 Request processed in 30us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350108.549391:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783350108.549402:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783350108.549408:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659592448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.549432:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659592448:12345-0@lo:400:kworker.0 Request processed in 24us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350108.549447:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783350108.549460:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783350108.549464:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1869977659592064:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783350108.549469:0:19423:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783350108.549493:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1869977659592064:12345-0@lo:400:kworker.0 Request processed in 28us (816us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783350108.549499:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783350108.549510:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783350108.549514:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1869977659592320:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783350108.549518:0:19423:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783350108.549537:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1869977659592320:12345-0@lo:400:kworker.0 Request processed in 22us (661us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783350108.549542:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783350108.549553:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783350108.549556:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1869977659591936:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783350108.549560:0:19423:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783350108.549579:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1869977659591936:12345-0@lo:400:kworker.0 Request processed in 22us (663us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783350108.549591:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1783350108.549624:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783350108.549629:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ea36d6f7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783350108.549633:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1783350108.550454:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659592576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783350108.550497:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350108.550533:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659591680:0@lo:400:kworker.0 00010000:00080000:2.0:1783350108.550548:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36d775f80 x1869977659592192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350108.550558:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659592192:0@lo:400:kworker.0 00000100:00080000:2.0:1783350108.550568:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783350108.550572:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ea347503800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783350108.550575:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783350108.550580:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ea347503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783350108.550595:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 484 00000100:00080000:2.0:1783350108.550601:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ea347503800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350108.550620:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36ce0b800 x1869977659592704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783350108.550634:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659592064:0@lo:400:kworker.0 00000100:00100000:0.0:1783350108.550780:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659592832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783350108.550809:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350108.556586:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659591552 00000100:00100000:3.0:1783350108.556601:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659591552 00000100:00100000:3.0:1783350108.556662:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783350108.556670:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1869977659591552:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783350108.556678:0:17092:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783350108.556768:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1869977659591552:12345-0@lo:400:kworker.0 Request processed in 98us (8155us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783350108.556776:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1783350108.556810:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783350108.556815:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783350108.556818:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350108.556834:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659592576 00000100:00100000:3.0:1783350108.556838:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659592576 00000100:00100000:3.0:1783350108.556864:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659592832 00000100:00100000:3.0:1783350108.556881:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659592832 00000100:00100000:3.0:1783350108.556898:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783350108.556904:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659592576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783350108.556930:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783350108.556978:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659592576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (6480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350108.556985:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783350108.557001:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783350108.557007:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659592832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783350108.557022:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783350108.557053:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659592832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (6243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350108.557053:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659592704:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1783350108.557059:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783350108.557093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350108.557103:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659592832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783350108.557126:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659592704 00000100:00100000:2.0:1783350108.557129:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659592704 00000100:00100000:2.0:1783350108.557174:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783350108.557178:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869977659592704:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1783350108.557191:0:19423:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783350108.557270:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659592576:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783350108.557284:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783350108.557288:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783350108.557291:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783350108.557297:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783350108.557301:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:0.0:1783350108.557306:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ea375e3d800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350108.557332:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36ccebb80 x1869977659592960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783350108.557358:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659591552:0@lo:400:kworker.0 00000100:00100000:3.0:1783350108.557931:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659592960:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1783350108.557987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350108.558071:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659592960 00000100:00100000:0.0:1783350108.558076:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659592960 00000100:00100000:0.0:1783350108.558107:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783350108.558113:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869977659592960:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1783350108.558174:0:17828:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783350108.558210:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869977659592960:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 96us (223us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783350108.558217:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1783350108.558342:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350108.558347:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783350108.558350:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659592960:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783350108.576473:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869977659592704:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 19285us (19371us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783350108.576487:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1783350108.577387:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea347503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350108.577396:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783350108.577400:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659592704:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1783350108.591949:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ea36d6f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350108.591974:0:3646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:1.0:1783350108.591984:0:3646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ea36d6f7000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350108.592033:0:3646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d738000 x1869977659593088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783350108.592068:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659591936:0@lo:400:kworker.0 00010000:00080000:1.0:1783350108.592101:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36d777b80 x1869977659592448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350108.592112:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659592448:0@lo:400:kworker.0 00000100:00100000:1.0:1783350108.592155:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659591808:0@lo:400:kworker.0 00000100:00080000:1.0:1783350108.592169:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783350108.592173:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ea347506000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783350108.592176:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783350108.592179:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ea347506000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350108.592183:0:3646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1783350108.592187:0:3646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ea347506000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350108.592199:0:3646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d73a300 x1869977659593216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783350108.592209:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659592320:0@lo:400:kworker.0 00000100:00100000:0.0:1783350108.592772:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659593088:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783350108.592841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350108.592880:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659593216:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783350108.592902:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350108.592946:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659593088 00000100:00100000:0.0:1783350108.592954:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659593088 00000100:00100000:0.0:1783350108.592999:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659593216 00000100:00100000:0.0:1783350108.593002:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659593216 00000100:00100000:0.0:1783350108.593019:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783350108.593025:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659593088:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1783350108.593041:0:17088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783350108.593082:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659593088:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 55us (241us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783350108.593090:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783350108.593106:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783350108.593111:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659593216:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1783350108.593118:0:17088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783350108.593177:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659593216:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 64us (273us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783350108.593198:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1783350108.593237:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d6f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350108.594853:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783350108.594861:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659593088:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1783350108.594894:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea347506000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350108.594898:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783350108.594901:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659593216:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1783350108.868822:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350109.892609:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783350110.088762:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783350110.088770:0:17067:0:(genops.c:906:class_export_put()) final put ffff8ea375e39000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1783350110.088797:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000001:00080000:0.0:1783350110.088807:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1783350110.088810:0:17067:0:(genops.c:906:class_export_put()) final put ffff8ea374652800/07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000001:00100000:0.0:1783350110.088815:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8a2801b7-a361-434c-b0c3-f6ccaa904300 00000001:00080000:0.0:1783350110.088820:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1783350110.088825:0:17067:0:(genops.c:906:class_export_put()) final put ffff8ea2435c4800/8a2801b7-a361-434c-b0c3-f6ccaa904300 00000001:00100000:3.0:1783350110.088892:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783350110.088899:0:17820:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1783350110.088902:0:17820:0:(genops.c:906:class_export_put()) final put ffff8ea347510800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783350110.088907:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000001:00080000:3.0:1783350110.088910:0:17820:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1783350110.088925:0:17820:0:(genops.c:906:class_export_put()) final put ffff8ea374650800/07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000001:00100000:3.0:1783350110.088930:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8a2801b7-a361-434c-b0c3-f6ccaa904300 00000001:00080000:3.0:1783350110.088933:0:17820:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1783350110.088935:0:17820:0:(genops.c:906:class_export_put()) final put ffff8ea2435c5000/8a2801b7-a361-434c-b0c3-f6ccaa904300 00000020:00000080:1.0:1783350110.091266:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e39000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1783350110.091328:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea374652800/07a332e1-ec8f-4f86-8530-dd43a8d09e28 for lustre-MDT0000 00000020:00000080:1.0:1783350110.091364:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2435c4800/8a2801b7-a361-434c-b0c3-f6ccaa904300 for lustre-MDT0000 00000020:00000080:1.0:1783350110.091387:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea347510800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1783350110.091408:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea374650800/07a332e1-ec8f-4f86-8530-dd43a8d09e28 for lustre-MDT0001 00000020:00000080:1.0:1783350110.091452:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2435c5000/8a2801b7-a361-434c-b0c3-f6ccaa904300 for lustre-MDT0001 00000020:00000080:1.0:1783350110.091470:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea375e3f800 for lustre-MDT0000 00000020:00000080:1.0:1783350110.091474:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea374650000 for lustre-MDT0000 00000020:00000080:1.0:1783350110.091477:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea2435c7800 for lustre-MDT0000 00000020:00000080:1.0:1783350110.091483:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36d6f3800 for lustre-MDT0001 00000020:00000080:1.0:1783350110.091486:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea374651000 for lustre-MDT0001 00000020:00000080:1.0:1783350110.091495:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea2435c3000 for lustre-MDT0001 00000001:00100000:1.0:1783350110.093124:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783350110.093132:0:18590:0:(genops.c:906:class_export_put()) final put ffff8ea367398000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783350110.093192:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a2801b7-a361-434c-b0c3-f6ccaa904300 00000020:00000080:1.0:1783350110.093195:0:18590:0:(genops.c:906:class_export_put()) final put ffff8ea241d27000/8a2801b7-a361-434c-b0c3-f6ccaa904300 00000020:00000080:0.0:1783350110.093356:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea367398000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783350110.093398:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea241d27000/8a2801b7-a361-434c-b0c3-f6ccaa904300 for lustre-OST0000 00000020:00000080:0.0:1783350110.093412:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36739a800 for lustre-OST0000 00000020:00000080:0.0:1783350110.093416:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea241d23000 for lustre-OST0000 00000020:01000000:2.0:1783350110.340467:0:20674:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea2410aaa80 - data ffff8ea3711cd288/ffff8ea2424f7000 00000020:01000000:2.0:1783350110.340639:0:20674:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea24326f4e0 - data ffff8ea242029948/ffff8ea376495000 00000001:00000004:2.0:1783350110.347735:0:20674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1783350110.414679:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783350110.414687:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783350110.414698:0:20674:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ea37f5cbb80 x1869977659591168/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783350118 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350110.414718:0:20674:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783350110.418618:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783350110.418626:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1783350110.418743:0:20674:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783350110.418762:0:20674:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783350110.419202:0:17111:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783350110.419207:0:17111:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1783350110.419218:0:17111:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1783350110.420031:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783350110.420036:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1783350110.420054:0:20674:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783350110.420057:0:20674:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783350110.420579:0:17113:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783350110.420583:0:17113:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1783350110.420594:0:17113:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1783350110.422339:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e319b 00000020:00000080:2.0:1783350110.422350:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea36d977000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783350110.422533:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d977000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783350110.425438:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e31b0 00000020:00000080:2.0:1783350110.425452:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea36d975800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783350110.425460:0:20674:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783350110.425466:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783350110.425474:0:20674:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783350110.425478:0:20674:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8ea36d1419c0) has no exports 00000004:01000000:2.0:1783350110.425634:0:20674:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783350110.425641:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3212 00000020:00000080:2.0:1783350110.425645:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea2437db000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783350110.425648:0:20674:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783350110.425652:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783350110.425655:0:20674:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783350110.425657:0:20674:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8ea349e33380) has no exports 00000020:00000080:2.0:1783350110.425662:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e320b 00000020:00000080:2.0:1783350110.425665:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea36d971800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1783350110.426713:0:20674:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783350110.426740:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783350110.426744:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1783350110.426751:0:20674:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783350110.426754:0:20674:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783350110.426788:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783350110.426797:0:20674:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783350110.426803:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e31fd 00000020:00000080:0.0:1783350110.426811:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea24325b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783350110.426816:0:20674:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783350110.426820:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783350110.426823:0:20674:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783350110.426826:0:20674:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8ea37f4599c0) has no exports 00000020:00000080:0.0:1783350110.426831:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e31f6 00000020:00000080:0.0:1783350110.426834:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea24325d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783350110.427055:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d975800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1783350110.427068:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2437db000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783350110.427076:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d971800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783350110.427084:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36d970000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783350110.427092:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea24325e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783350110.427095:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24325e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783350110.427101:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783350110.427200:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24325b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783350110.427205:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24325d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783350110.427526:0:20674:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783350110.427531:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783350110.427533:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1783350110.427537:0:20674:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783350110.427539:0:20674:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783350110.427576:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783350110.427582:0:20674:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1783350110.427593:0:20674:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783350110.427681:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e31e8 00000020:00000080:0.0:1783350110.427687:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea24325c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783350110.427691:0:20674:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1783350110.427695:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783350110.427699:0:20674:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783350110.427702:0:20674:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff8ea37f45cd40) has no exports 00000020:00000080:0.0:1783350110.427706:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e31e1 00000020:00000080:0.0:1783350110.427709:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea345ade000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783350110.428270:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea243259000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783350110.428278:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea24325b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783350110.428280:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24325b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783350110.428285:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783350110.428339:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24325c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783350110.428343:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea345ade000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783350110.429274:0:20674:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1783350110.429278:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783350110.429282:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783350110.429288:0:20674:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783350110.429331:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350110.429340:0:20674:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783350110.429361:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350110.429364:0:20674:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783350110.429369:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea36d975000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783350110.429372:0:20674:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d975000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1783350110.429397:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea345adf000 for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783350110.429408:0:20674:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783350110.429502:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea2434da000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783350110.429508:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2434da000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1783350110.429512:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783350110.429680:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e31b7 00000020:00000080:1.0:1783350110.429686:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea349fe5800/lustre-MDD0000_UUID 00000020:01000000:1.0:1783350110.429696:0:20674:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783350110.429699:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350110.429704:0:20674:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783350110.429707:0:20674:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8ea36d144d40) has no exports 00000020:00000080:1.0:1783350110.429788:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350110.429792:0:20674:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783350110.429796:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e31be 00000020:00000080:1.0:1783350110.429799:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea349fe4000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783350110.429808:0:20674:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea37f5b5800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783350110.429811:0:20674:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea37f5b5800 3 00000020:01000004:1.0:1783350110.429814:0:20674:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ea37f5b5800 from lustre-MDT0000 00000020:00000080:1.0:1783350110.429861:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350110.429865:0:20674:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783350110.429867:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea36d973800/lustre-MDT0000_UUID 00000020:00000080:1.0:1783350110.429869:0:20674:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d973800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783350110.429875:0:20674:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1783350110.429904:0:20674:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1783350110.429907:0:20674:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783350110.429917:0:20674:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783350110.429919:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350110.429921:0:20674:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783350110.429927:0:20674:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8ea349fe6000 7ee7701a-0ad8-4622-a3a4-e9603bf4c749 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783350110.429932:0:20674:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8ea24351cd40) has exports, disconnecting them 00000020:00080000:1.0:1783350110.429935:0:20674:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ea349fe6000), last request at 1783350016 00000020:00000080:1.0:1783350110.429958:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3163 00000020:00010000:1.0:1783350110.429961:0:20674:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ea349fe6000: total 2 00000100:00080000:1.0:1783350110.429965:0:20674:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe3800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783350110.429974:0:20674:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea349fe6000): rc 0 00000020:00080000:1.0:1783350110.429977:0:20674:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8ea24351cd40) has no exports 00000100:00100000:3.0:1783350110.430026:0:17081:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ea36d916c00:17081] 1 exiting: rc = 0 00000020:00010000:2.0:1783350110.430076:0:17076:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ea349fe6000: total 2 00010000:00010000:2.0:1783350110.430080:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350110.430111:0:17076:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ea349fe6000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1783350110.431963:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3417c6a00/0xd05e6ae1590e3290 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e3289 expref: 14 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.432914:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8c600/0xd05e6ae1590e3171 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e316a expref: 13 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.432925:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e345e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e3457 expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.432938:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea24364bc00/0xd05e6ae1590e370c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e3705 expref: 11 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.432957:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e3282 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e327b expref: 10 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.432967:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8d800/0xd05e6ae1590e33ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e33e7 expref: 9 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.432975:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e371a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e3713 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.432983:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea340030200/0xd05e6ae1590e333f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e3338 expref: 7 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.432995:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8da00/0xd05e6ae1590e3728 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e3721 expref: 6 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.433005:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea340031800/0xd05e6ae1590e329e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e3297 expref: 5 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.433014:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3488 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e3481 expref: 4 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.433039:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e34c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e34c0 expref: 3 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.433051:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e33c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e33bd expref: 2 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350110.433062:0:17076:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ea349fe6000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1783350110.433094:0:17076:0:(genops.c:906:class_export_put()) final put ffff8ea349fe6000/7ee7701a-0ad8-4622-a3a4-e9603bf4c749 00010000:00010000:2.0:1783350110.433264:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350110.433267:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350110.433269:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350110.433298:0:17082:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ea36ccd5c00:17082] 2 exiting: rc = 0 00000020:00000080:2.0:1783350110.433376:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea349fe5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783350110.433382:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea36d976800/lustre-MDD0000_UUID 00000020:00000080:2.0:1783350110.433384:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d976800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1783350110.433388:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1783350110.433442:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea349fe4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783350110.433447:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea349fe6000/7ee7701a-0ad8-4622-a3a4-e9603bf4c749 for MGS 00000020:00000080:2.0:1783350110.434442:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea349fe3800 for MGS 00000100:00100000:1.0:1783350110.434712:0:17079:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ea36d916600:17079] 0 exiting: rc = 1 00000100:00100000:2.0:1783350110.435273:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435280:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435285:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435290:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435296:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435301:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435307:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435312:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435317:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435322:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435346:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435352:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435357:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435362:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435368:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435373:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435382:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435388:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435393:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435398:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435405:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435410:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435414:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435419:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435425:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435430:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435435:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435440:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435445:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435450:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435455:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435460:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435466:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435472:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435477:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435482:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435661:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435669:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435674:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435678:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435683:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435688:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435692:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435697:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435702:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435713:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435718:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435789:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435796:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435802:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435806:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435811:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435815:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435819:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435823:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435828:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435832:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435837:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435841:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435846:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435850:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435855:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435860:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350110.435865:0:20674:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1783350110.438110:0:20674:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea34534a960 - data ffff8ea3502cb6c0/ffff8ea36d69fc00 00000020:01000000:2.0:1783350110.439038:0:20674:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea3514c47e0 - data ffff8ea371160510/ffff8ea380372000 00000020:00000080:2.0:1783350110.440063:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3147 00000020:00000080:2.0:1783350110.440074:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea37f5b1800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783350110.440097:0:20674:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea37f5b5800 from MGS, refs=2 00000020:01000004:2.0:1783350110.440101:0:20674:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea37f5b5800 2 00000020:01000004:2.0:1783350110.440104:0:20674:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ea37f5b5800 from MGS 00000020:00000080:2.0:1783350110.440123:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783350110.440130:0:20674:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783350110.440132:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea37f5b7800/MGS 00000020:00000080:2.0:1783350110.440149:0:20674:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f5b7800/MGS for MGS 00000020:01000000:2.0:1783350110.440156:0:20674:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1783350110.440332:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f5b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783350110.440704:0:20674:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783350110.440708:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783350110.440714:0:20674:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783350110.440916:0:20674:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ea349fe9000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783350110.440922:0:20674:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff8ea241dcb380) has exports, disconnecting them 00000020:00080000:2.0:1783350110.440927:0:20674:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ea349fe9000), last request at 1783350017 00000020:00000080:2.0:1783350110.440931:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e324a 00000020:00080000:2.0:1783350110.440954:0:20674:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea349fe9000): rc 0 00000020:00000080:2.0:1783350110.440958:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea349fe9000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783350110.441025:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea349fe9000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1783350110.456180:0:20674:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1783350110.456190:0:20674:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783350110.456194:0:20674:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783350110.456201:0:20674:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783350110.456238:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea349fe8800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783350110.456395:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350110.456404:0:20674:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1783350110.456408:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea349fec000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783350110.456412:0:20674:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea349fec000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1783350110.456421:0:20674:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783350110.456502:0:20674:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea37f5b5800 1 00000020:00000080:1.0:1783350110.456508:0:20674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3139 00000020:00000080:1.0:1783350110.456515:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea37f5b6800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1783350110.456524:0:20674:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783350110.456532:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f5b6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783350110.456541:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350110.456556:0:20674:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783350110.456560:0:20674:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8ea36d140000) has no exports 00000020:00000080:1.0:1783350110.542352:0:20674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350110.542365:0:20674:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783350110.542371:0:20674:0:(genops.c:906:class_export_put()) final put ffff8ea243ada000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783350110.542376:0:20674:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea243ada000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783350110.542387:0:20674:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783350110.542499:0:20674:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ea243adc000 00000020:02000400:1.0:1783350110.542553:0:20674:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783350110.917316:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350111.943314:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350112.965224:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783350113.670482:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783350113.670489:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783350113.670492:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783350113.670500:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 549 00000100:00080000:3.0:1783350113.670506:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783350113.670523:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ea375e3d800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350113.670532:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783350113.670549:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659593344:0@lo:400:kworker.0 00000400:00000100:3.0:1783350113.670597:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869977659593344 offset 0 length 224: 4 00000100:00100000:3.0:1783350113.670660:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d776680 x1869977659593472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350113.670692:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659593600:0@lo:400:kworker.0 00000100:00100000:3.0:1783350113.670722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350113.670755:0:19527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659593600 00000100:00100000:3.0:1783350113.670762:0:19527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659593600 00000100:00100000:3.0:1783350113.670812:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783350113.670821:0:19527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659593600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350113.670870:0:19527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659593600:12345-0@lo:400:kworker.0 Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350113.670878:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1783350113.670909:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350113.670966:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659593600:0@lo:400:kworker.0 00000100:00080000:3.0:1783350113.671000:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783350113.671004:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783350113.671006:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea36d6f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783350113.671011:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 549 00000100:00080000:3.0:1783350113.671014:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783350113.671017:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ea36d6f7000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350113.671022:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783350113.671031:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659593728:0@lo:400:kworker.0 00000100:00100000:3.0:1783350113.671057:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350113.671085:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659593728 00000100:00100000:3.0:1783350113.671089:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659593728 00000100:00100000:3.0:1783350113.671115:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783350113.671121:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659593728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350113.671188:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659593728:12345-0@lo:400:kworker.0 Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350113.671195:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1783350113.671211:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783350113.671227:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659593728:0@lo:400:kworker.0 00000100:00100000:3.0:1783350113.671251:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d774000 x1869977659593856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783350113.671262:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783350113.671265:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783350113.671267:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea347503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783350113.671270:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 549 00000100:00080000:3.0:1783350113.671279:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783350113.671284:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ea347503800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350113.671295:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d774380 x1869977659593984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783350113.671314:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783350113.671317:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783350113.671319:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea347506000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783350113.671321:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 549 00000100:00080000:3.0:1783350113.671324:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783350113.671326:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ea347506000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350113.671333:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659594112:0@lo:400:kworker.0 00000100:00100000:3.0:1783350113.671359:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350113.671390:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d774a80 x1869977659594240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350113.671412:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783350113.671418:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659594368:0@lo:400:kworker.0 00000100:00100000:3.0:1783350113.671444:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350113.671797:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659593472:0@lo:38:kworker.0 00000100:00100000:0.0:1783350113.671828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350113.671849:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659593856:0@lo:38:kworker.0 00000100:00100000:0.0:1783350113.671869:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350113.671884:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659593984:0@lo:38:kworker.0 00000100:00100000:0.0:1783350113.671904:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350113.671928:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659594240:0@lo:38:kworker.0 00000100:00100000:0.0:1783350113.671949:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350113.671976:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659594112 00000100:00100000:0.0:1783350113.671981:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659594112 00000100:00100000:0.0:1783350113.672013:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659594368 00000100:00100000:0.0:1783350113.672016:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659594368 00000100:00100000:0.0:1783350113.672027:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659593856 00000100:00100000:0.0:1783350113.672030:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659593856 00000100:00100000:0.0:1783350113.672037:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659593984 00000100:00100000:0.0:1783350113.672039:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659593984 00000100:00100000:0.0:1783350113.672045:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659594240 00000100:00100000:0.0:1783350113.672047:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659594240 00000100:00100000:0.0:1783350113.672057:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783350113.672064:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659594112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350113.672106:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659594112:12345-0@lo:400:kworker.0 Request processed in 42us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350113.672113:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783350113.672126:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783350113.672132:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659594368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350113.672195:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659594368:12345-0@lo:400:kworker.0 Request processed in 63us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350113.672214:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783350113.672228:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783350113.672233:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659593856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783350113.672255:0:17088:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783350113.675223:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659594496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783350113.675295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783350113.675344:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8ea36d777100 x1869977659594368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350113.675359:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659594368:0@lo:400:kworker.0 00000100:00100000:3.0:1783350113.675397:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659594496 00000100:00100000:3.0:1783350113.675403:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659594496 00000100:00100000:3.0:1783350113.675461:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783350113.675469:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659594496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783350113.675499:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783350113.675557:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659594496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350113.675565:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783350113.675603:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659594496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783350113.676212:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783350113.676219:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869977659593984:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783350113.676238:0:19423:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783350113.676300:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869977659593984:12345-0@lo:38:kworker.0 Request processed in 79us (4395us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783350113.676307:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783350113.676324:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783350113.676329:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869977659594240:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783350113.676339:0:19423:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783350113.676364:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869977659594240:12345-0@lo:38:kworker.0 Request processed in 34us (4414us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783350113.676370:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783350113.676391:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659593472 00000100:00100000:2.0:1783350113.676396:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659593472 00000100:00100000:2.0:1783350113.676425:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783350113.676429:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659593472:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783350113.676439:0:17093:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783350113.676465:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659593472:12345-0@lo:38:kworker.0 Request processed in 34us (4636us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783350113.676481:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1783350113.676624:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350113.676631:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783350113.676635:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659593472:0@lo:38:kworker.0 00000100:00080000:3.0:1783350113.676645:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea347503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350113.676649:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783350113.676652:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659593984:0@lo:38:kworker.0 00000100:00080000:3.0:1783350113.676659:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea347506000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350113.676662:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783350113.676665:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659594240:0@lo:38:kworker.0 00000100:00100000:2.0:1783350113.676820:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659594624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783350113.676853:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350113.677001:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659594624 00000100:00100000:3.0:1783350113.677006:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659594624 00000100:00100000:3.0:1783350113.677036:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783350113.677043:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659594624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783350113.677065:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1783350113.680076:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783350113.680163:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8ea36d777b80 x1869977659594112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350113.680180:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659594112:0@lo:400:kworker.0 00000100:00100000:3.0:1783350113.682376:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659594624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5325us (5515us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350113.682389:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783350113.685622:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659594624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783350113.696795:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659593856:12345-0@lo:38:kworker.0 Request processed in 24552us (24916us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783350113.696809:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1783350113.700004:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d6f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350113.700028:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783350113.700033:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659593856:0@lo:38:kworker.0 00010000:00010000:1.0:1783350113.991993:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783350114.180846:0:17847:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1783350114.196204:0:19408:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783350114.196215:0:19408:0:(genops.c:906:class_export_put()) final put ffff8ea36739f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783350114.196387:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36739f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783350114.196427:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36739e000 for lustre-OST0001 00000020:01000004:2.0:1783350114.221758:0:20875:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783350114.232842:0:20875:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1783350114.232895:0:20875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.232910:0:20875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.232929:0:20875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.232936:0:20875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.232963:0:20875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783350114.232968:0:20875:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783350114.232998:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783350114.233002:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783350114.233007:0:20875:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783350114.233012:0:20875:0:(import.c:65:import_set_state_nolock()) ffff8ea36d6f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783350114.233016:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783350114.233037:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783350114.233041:0:20875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783350114.233960:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350114.233969:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350114.233979:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350114.233983:0:19530:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350114.233992:0:19530:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783350114.234011:0:19530:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350114.234016:0:19530:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783350114.234028:0:19530:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783350114.234030:0:19530:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783350114.234074:0:19530:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350114.234080:0:19530:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783350114.234111:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350114.234119:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350114.234130:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350114.234132:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350114.234134:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350114.234274:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783350114.234292:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659594752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350114.234355:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350114.234420:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659594752 00000100:00100000:1.0:1783350114.234427:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659594752 00000100:00100000:1.0:1783350114.234464:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783350114.234471:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1869977659594752:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783350114.234476:0:17073:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783350114 with bad export cookie 15014555723794100579 00010000:00010000:0.0:1783350114.239355:0:20875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239374:0:20875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239381:0:20875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239388:0:20875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239415:0:20875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350114.239421:0:20875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239428:0:20875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239434:0:20875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239440:0:20875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239462:0:20875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783350114.239469:0:20875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239493:0:20875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239499:0:20875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239505:0:20875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239518:0:20875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783350114.239524:0:20875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239530:0:20875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239535:0:20875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239541:0:20875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350114.239546:0:20875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1783350114.239549:0:20875:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1783350114.239583:0:20875:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1783350114.239587:0:20875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1783350114.239591:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783350114.239596:0:20875:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783350114.239603:0:20875:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8ea241d22000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783350114.239614:0:20875:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8ea243736800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783350114.239619:0:20875:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff8ea349e30000) has exports, disconnecting them 00000020:00080000:0.0:1783350114.239623:0:20875:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ea241d22000), last request at 1783350113 00000020:00000080:0.0:1783350114.239631:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e34b2 00000100:00080000:0.0:1783350114.239648:0:20875:0:(import.c:65:import_set_state_nolock()) ffff8ea241d26800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783350114.239691:0:20875:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea241d22000): rc 0 00000020:00000080:0.0:1783350114.239694:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea241d22000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1783350114.239703:0:20875:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ea243736800), last request at 1783350113 00000020:00000080:0.0:1783350114.239705:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3418 00000100:00080000:0.0:1783350114.239710:0:20875:0:(import.c:65:import_set_state_nolock()) ffff8ea243732000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783350114.239716:0:20875:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea243736800): rc 0 00000020:00000080:0.0:1783350114.239718:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea243736800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1783350114.239725:0:20875:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9d9841cffae0 00000100:00080000:0.0:1783350114.239743:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783350114.239747:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1783350114.240742:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783350114.240752:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.240761:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783350114.240765:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.240773:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350114.240780:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350114.240786:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783350114.240788:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1783350114.240790:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1783350114.240828:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.240835:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783350114.240858:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.240879:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.240892:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783350114.240895:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.240902:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7400 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783350114.240904:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.240910:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350114.240925:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350114.240930:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783350114.240932:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783350114.240933:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783350114.240946:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.240952:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783350114.240958:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.240964:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.240986:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783350114.240989:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.240993:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fa00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783350114.240996:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.241003:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350114.241008:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350114.241013:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783350114.241015:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783350114.241017:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783350114.241030:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.241036:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783350114.241227:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.241235:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.241244:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350114.241248:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.241259:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783350114.241263:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.241270:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350114.241276:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350114.241281:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783350114.241283:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783350114.241285:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783350114.241300:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.241306:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783350114.241311:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.241317:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350114.241328:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350114.241329:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350114.241331:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350114.241349:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659594880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783350114.241412:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350114.241460:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783350114.241473:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659595008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783350114.241523:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350114.241554:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659595264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783350114.241576:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350114.241587:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783350114.241591:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ce0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659595136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783350114.241610:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350114.241635:0:17074:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783350114.241642:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1783350114.241656:0:17072:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783350114.241663:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659594880 00000100:00100000:2.0:1783350114.241669:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659594880 00000100:00100000:2.0:1783350114.241692:0:17072:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783350114.241696:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659595008 00000100:00100000:2.0:1783350114.241698:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659595008 00000100:00100000:2.0:1783350114.241704:0:17072:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783350114.241708:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659595264 00000100:00100000:2.0:1783350114.241710:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659595264 00000100:00100000:2.0:1783350114.241716:0:17072:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783350114.241719:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659595136 00000100:00100000:2.0:1783350114.241721:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659595136 00010000:00010000:3.0:1783350114.242364:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783350114.242375:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea241d22000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1783350114.242420:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea243736800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1783350114.242438:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea241d26800 for lustre-MDT0001 00000020:00000080:3.0:1783350114.242443:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea243732000 for lustre-MDT0001 00000100:00080000:0.0:1783350114.244463:0:20875:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783350114.244474:0:20875:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1783350114.244741:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350114.247700:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783350114.247712:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ce0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1869977659594880:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783350114.247720:0:20876:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783350114 with bad export cookie 15014555723794100579 00000100:00100000:2.0:1783350114.247813:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ce0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1869977659594880:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (6400us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783350114.247820:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783350114.247839:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783350114.247843:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1869977659595008:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783350114.247862:0:20876:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783350114 with bad export cookie 15014555723794100579 00000100:00100000:2.0:1783350114.247889:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1869977659595008:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (6366us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783350114.247895:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783350114.247907:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783350114.247911:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1869977659595264:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783350114.247926:0:20876:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783350114 with bad export cookie 15014555723794100579 00000100:00100000:2.0:1783350114.247956:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1869977659595264:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (6379us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783350114.247962:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1783350114.247998:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783350114.248004:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8ea3461c6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783350114.248008:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1783350114.248060:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1783350114.250116:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1869977659594752:12345-0@lo:103:ldlm_bl.0 Request processed in 15640us (15757us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783350114.250171:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1783350114.250217:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1783350114.254593:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783350114.254606:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243257050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1869977659595136:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783350114.254614:0:20876:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783350114 with bad export cookie 15014555723794100579 00000100:00100000:3.0:1783350114.254704:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243257050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1869977659595136:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (13091us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783350114.254711:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1783350114.262644:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.150@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783350114.262649:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783350114.262658:0:3649:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea36d777800 x1869977659593344/t0(0) o400->MGC192.168.203.150@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783350129 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350114.262682:0:3649:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea36d738000 x1869977659594752/t0(0) o103->MGC192.168.203.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783350130 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350114.262692:0:3649:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea36ce08700 x1869977659594880/t0(0) o103->MGC192.168.203.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783350130 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350114.262700:0:3649:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea36ce08a80 x1869977659595008/t0(0) o103->MGC192.168.203.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783350130 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350114.262709:0:3649:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea36ce0b800 x1869977659595264/t0(0) o103->MGC192.168.203.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783350130 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350114.262717:0:3649:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea36ce0ad80 x1869977659595136/t0(0) o103->MGC192.168.203.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783350130 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783350114.262741:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783350114.262744:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783350114.262745:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783350114.262831:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659593344:0@lo:400:kworker.0 00000100:00080000:0.0:1783350114.262887:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ea3461c6000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1783350114.262901:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659594880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350114.262937:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659595008:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1783350114.263099:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783350114.263103:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1783350114.263116:0:20875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783350114.263212:0:20875:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783350114.263235:0:20875:0:(import.c:65:import_set_state_nolock()) ffff8ea24271f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783350114.263258:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783350114.263261:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1783350114.263273:0:20875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783350114.263338:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659595392:0@lo:9:umount.0 00000100:00100000:0.0:1783350114.263402:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350114.263445:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659595392 00000100:00100000:0.0:1783350114.263453:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659595392 00000100:00100000:0.0:1783350114.263498:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783350114.263755:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869977659595392:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783350114.263780:0:18594:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3442 00000100:00080000:0.0:1783350114.263789:0:18594:0:(import.c:65:import_set_state_nolock()) ffff8ea243736000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783350114.263831:0:18594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1783350114.263979:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3645:x1869977659595392:12345-0@lo:9:umount.0 Request processed in 472us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350114.263987:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1783350114.264026:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24271f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783350114.264035:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783350114.264036:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783350114.264040:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659595392:0@lo:9:umount.0 00000100:00080000:0.0:1783350114.264073:0:20875:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783350114.264085:0:20875:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783350114.264103:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659595520:0@lo:9:umount.0 00000100:00100000:0.0:1783350114.264128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350114.264288:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659595520 00000100:00100000:0.0:1783350114.264293:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659595520 00000100:00100000:0.0:1783350114.264319:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783350114.264325:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1869977659595520:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783350114.264349:0:19278:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e34e3 00000100:00080000:0.0:1783350114.264355:0:19278:0:(import.c:65:import_set_state_nolock()) ffff8ea2435c1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783350114.264377:0:19278:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1783350114.264458:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3645:x1869977659595520:12345-0@lo:9:umount.0 Request processed in 132us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350114.264464:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1783350114.264484:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783350114.264500:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783350114.264609:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783350114.264611:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783350114.264614:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659595520:0@lo:9:umount.0 00000020:00080000:0.0:1783350114.264665:0:20875:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8ea349e30000) has no exports 00000100:00080000:1.0:1783350114.264786:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ea3461c6000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1783350114.264808:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659594752:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1783350114.264934:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8ea3461c6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783350114.264940:0:3649:0:(import.c:512:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1783350114.264946:0:3649:0:(import.c:626:import_select_connection()) MGC192.168.203.150@tcp: import ffff8ea3461c6000 using connection 192.168.203.150@tcp/0@lo 00010000:00010000:2.0:1783350114.264954:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350114.264977:0:3649:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37b5d7100 x1869977659595648/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783350114.265014:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659595136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783350114.265019:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ce0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659595264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350114.265074:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3645:1869977659595648:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1783350114.265099:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869977659595648 offset 0 length 520: 4 00000020:00080000:1.0:1783350114.273839:0:20875:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8ea349e30000) has no exports 00000020:01000000:2.0:1783350114.322963:0:20875:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea2410aa8a0 - data ffff8ea3711cd438/ffff8ea241d31000 00000020:01000000:2.0:1783350114.323405:0:20875:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea36cd9f540 - data ffff8ea3502a3438/ffff8ea36d6ed800 00000001:00000004:0.0:1783350114.336776:0:20875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1783350114.398692:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783350114.398702:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783350114.398709:0:20875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783350114.401229:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783350114.401236:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1783350114.401476:0:20875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783350114.401479:0:20875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783350114.402541:0:17829:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783350114.402547:0:17829:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1783350114.402555:0:17829:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1783350114.403012:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783350114.403017:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1783350114.403034:0:20875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783350114.403036:0:20875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783350114.403309:0:17831:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783350114.403312:0:17831:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1783350114.403320:0:17831:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1783350114.405862:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e32ac 00000020:00000080:1.0:1783350114.405874:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea242719800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783350114.407019:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e32c1 00000020:00000080:1.0:1783350114.407027:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea24325a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783350114.409824:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea242719800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1783350114.409997:0:20875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1783350114.410007:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350114.410015:0:20875:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783350114.410019:0:20875:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8ea349e34d40) has no exports 00000004:01000000:1.0:1783350114.410207:0:20875:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783350114.410219:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3315 00000020:00000080:1.0:1783350114.410226:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea37f4e7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783350114.410427:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24325a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1783350114.410495:0:20875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783350114.410500:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350114.410505:0:20875:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783350114.410508:0:20875:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8ea349f88000) has no exports 00000020:00000080:1.0:1783350114.410515:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e330e 00000020:00000080:1.0:1783350114.410519:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea37f4e3000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783350114.410602:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f4e7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1783350114.410994:0:20875:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1783350114.411009:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783350114.411014:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1783350114.411019:0:20875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783350114.411021:0:20875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783350114.411114:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f4e3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783350114.411345:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350114.411352:0:20875:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783350114.411358:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3300 00000020:00000080:1.0:1783350114.411364:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea37f4e5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783350114.411417:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea349fe1800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1783350114.411427:0:37:0:(genops.c:906:class_export_put()) final put ffff8ea37f4e2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783350114.411429:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f4e2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1783350114.411434:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783350114.411858:0:20875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783350114.411863:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350114.411868:0:20875:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783350114.411871:0:20875:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8ea349f8b380) has no exports 00000020:00000080:1.0:1783350114.411876:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e32f9 00000020:00000080:1.0:1783350114.411880:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea24271d000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783350114.411900:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f4e5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1783350114.412320:0:20875:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1783350114.412325:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783350114.412328:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1783350114.412332:0:20875:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783350114.412334:0:20875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783350114.412483:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24271d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783350114.412652:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350114.412659:0:20875:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1783350114.412671:0:20875:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783350114.412677:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e32e4 00000020:00000080:1.0:1783350114.412683:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea37f56b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783350114.412701:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea24271f000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783350114.412707:0:37:0:(genops.c:906:class_export_put()) final put ffff8ea37f568800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783350114.412710:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f568800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1783350114.412714:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783350114.412882:0:20875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1783350114.412887:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350114.412891:0:20875:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783350114.412894:0:20875:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff8ea37f45b380) has no exports 00000020:00000080:1.0:1783350114.412899:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e32dd 00000020:00000080:1.0:1783350114.412903:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea375e39800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783350114.412924:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f56b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783350114.414032:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e39800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1783350114.429923:0:20875:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1783350114.429931:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783350114.429944:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783350114.429950:0:20875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783350114.430003:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350114.430014:0:20875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783350114.430039:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350114.430042:0:20875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783350114.430047:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea2434df800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783350114.430051:0:20875:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2434df800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1783350114.430059:0:20875:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783350114.430102:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea375e3d800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783350114.430109:0:37:0:(genops.c:906:class_export_put()) final put ffff8ea36ccde800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783350114.430111:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36ccde800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1783350114.430118:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783350114.430227:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e32c8 00000020:00000080:1.0:1783350114.430235:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea24325d800/lustre-MDD0001_UUID 00000020:01000000:1.0:1783350114.430314:0:20875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1783350114.430319:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350114.430324:0:20875:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783350114.430327:0:20875:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8ea349e319c0) has no exports 00000020:00000080:1.0:1783350114.430353:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350114.430357:0:20875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1783350114.430361:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e32cf 00000020:00000080:1.0:1783350114.430366:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea24325c000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1783350114.430378:0:20875:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea348c55800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1783350114.430381:0:20875:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea348c55800 2 00000020:01000004:1.0:1783350114.430384:0:20875:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ea348c55800 from lustre-MDT0001 00000020:00000080:1.0:1783350114.430401:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350114.430404:0:20875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1783350114.430406:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea24271b800/lustre-MDT0001_UUID 00000020:00000080:1.0:1783350114.430408:0:20875:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24271b800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1783350114.430414:0:20875:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1783350114.430441:0:20875:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:00000080:3.0:1783350114.430442:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24325d800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1783350114.430444:0:20875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1783350114.430445:0:37:0:(genops.c:906:class_export_put()) final put ffff8ea2434de800/lustre-MDD0001_UUID 00000020:00000080:3.0:1783350114.430447:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2434de800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1783350114.430447:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350114.430450:0:20875:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:01000000:3.0:1783350114.430451:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00080000:1.0:1783350114.430456:0:20875:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8ea36d6f4800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783350114.430466:0:20875:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff8ea241dc99c0) has exports, disconnecting them 00000020:00080000:1.0:1783350114.430470:0:20875:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8ea36d6f4800), last request at 1783350032 00000020:00000080:1.0:1783350114.430474:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e334d 00000020:00080000:1.0:1783350114.430483:0:20875:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea36d6f4800): rc 0 00000020:00000080:1.0:1783350114.430487:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea36d6f4800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1783350114.430544:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24325c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783350114.430548:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d6f4800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1783350114.438702:0:20875:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1783350114.438710:0:20875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783350114.438888:0:20875:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783350114.438896:0:20875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783350114.438942:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36d6f7000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783350114.439055:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350114.439064:0:20875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1783350114.439069:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea359381000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1783350114.439072:0:20875:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea359381000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1783350114.439077:0:20875:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1783350114.439172:0:20875:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea348c55800 1 00000020:00000080:1.0:1783350114.439177:0:20875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3274 00000020:00000080:1.0:1783350114.439183:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea36ccdd000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1783350114.439191:0:20875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1783350114.439195:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350114.439200:0:20875:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783350114.439203:0:20875:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff8ea241dccd40) has no exports 00000020:00000080:0.0:1783350114.439276:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36ccdd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783350114.483131:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783350114.483173:0:20875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1783350114.483180:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea348c54000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783350114.483185:0:20875:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea348c54000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1783350114.483198:0:20875:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1783350114.483318:0:20875:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ea348c53800 00000020:01000000:3.0:1783350114.483346:0:20875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783350114.483350:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783350114.483354:0:20875:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783350114.483358:0:20875:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8ea2435199c0) has no exports 00000100:00100000:2.0:1783350114.484601:0:19423:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8ea2439c4a00:19423] 3 exiting: rc = 0 00000100:00100000:2.0:1783350114.484865:0:17087:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8ea241da2800:17087] 0 exiting: rc = 1 00000100:00100000:1.0:1783350114.484938:0:17089:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8ea36ccd4400:17089] 2 exiting: rc = 0 00000100:00100000:2.0:1783350114.484948:0:17088:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8ea379182a00:17088] 1 exiting: rc = 0 00000100:00100000:3.0:1783350114.485451:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485460:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485465:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485471:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485475:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485480:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485485:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485489:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485494:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485498:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485503:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485508:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485513:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485518:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485523:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485528:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485533:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485538:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485545:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485550:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485556:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485560:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485566:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485571:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485577:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485582:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485587:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485592:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485598:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485603:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485608:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485630:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485635:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485640:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485646:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485656:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485661:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485667:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485672:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485678:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485683:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485688:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485694:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485700:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485709:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485714:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485721:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485727:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485732:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485737:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485742:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485747:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485754:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485759:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485766:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485772:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485777:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485783:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485788:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485793:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485798:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485804:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485809:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.485814:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.490345:0:17090:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8ea243769c00:17090] 0 exiting: rc = 1 00000100:00100000:2.0:1783350114.490523:0:17091:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8ea243769e00:17091] 1 exiting: rc = 0 00000100:00100000:3.0:1783350114.491040:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491048:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491068:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491073:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491077:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491082:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491087:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491093:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491098:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491104:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491109:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491114:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491118:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491260:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491268:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491274:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491280:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491285:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491290:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491294:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491299:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491303:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491308:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491315:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491319:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491325:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491329:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491334:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491339:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491345:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491350:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491355:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491360:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491364:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491370:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491374:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491378:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491390:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491395:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491400:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491405:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491410:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491415:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491421:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491426:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491430:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491436:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491440:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491446:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491451:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491456:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491461:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491466:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491471:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491476:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491481:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491485:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491491:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491496:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491501:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491506:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491512:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491517:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.491522:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.492258:0:17092:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8ea345af1a00:17092] 0 exiting: rc = 1 00000100:00100000:2.0:1783350114.492349:0:17093:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8ea243768800:17093] 1 exiting: rc = 0 00000100:00100000:1.0:1783350114.493336:0:17828:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8ea36cf1ae00:17828] 2 exiting: rc = 0 00000100:00100000:3.0:1783350114.494956:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.494966:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.494971:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495001:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495010:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495017:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495023:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495029:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495046:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495053:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495059:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495065:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495071:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495076:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495082:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495104:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495113:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495361:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495372:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495378:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495384:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495389:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495394:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495399:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495404:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495409:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495415:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495438:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495444:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495449:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495455:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495460:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495466:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495471:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495478:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495484:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495491:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495496:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495501:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495520:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495527:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495532:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495538:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495551:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495558:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495564:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495571:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495577:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495583:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495589:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495595:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495617:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495623:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495630:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495636:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495642:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495648:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495653:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495660:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495665:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495672:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495677:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495683:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.495689:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.505904:0:17094:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8ea243768c00:17094] 0 exiting: rc = 1 00000100:00100000:3.0:1783350114.506094:0:17095:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8ea243769a00:17095] 1 exiting: rc = 0 00000100:00100000:2.0:1783350114.506613:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506621:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506626:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506631:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506637:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506643:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506648:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506653:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506657:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506677:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506683:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506688:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506693:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506697:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506702:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506707:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506711:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506716:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506722:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506727:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506732:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506736:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506740:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506745:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506750:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506755:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506760:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506766:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506771:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506776:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506780:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506786:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506790:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506796:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506807:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506811:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506817:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506822:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506827:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506832:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506837:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506842:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506848:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506853:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506867:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506872:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506877:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506882:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506887:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506892:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506898:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506903:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506908:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506925:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506931:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506937:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506942:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506947:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506952:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506957:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506962:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506967:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506972:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350114.506978:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.508038:0:17096:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8ea345af1400:17096] 0 exiting: rc = 1 00000100:00100000:1.0:1783350114.508501:0:17097:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8ea2434b7600:17097] 1 exiting: rc = 0 00000100:00100000:0.0:1783350114.508586:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508593:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508598:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508604:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508609:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508614:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508618:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508624:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508641:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508647:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508652:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508658:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508663:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508668:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508673:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508678:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508683:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508689:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508694:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508699:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508704:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508709:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508714:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508719:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508724:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508729:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508733:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508738:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508742:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508747:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508752:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508757:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508762:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508768:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508773:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508779:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508784:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508789:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508794:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508799:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508804:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508809:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508813:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508826:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508831:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508836:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508840:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508846:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508851:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508855:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508861:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508866:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508870:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508874:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508879:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508884:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508888:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508892:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508897:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508902:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508907:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508921:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508927:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.508933:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.509931:0:17098:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8ea2434b7a00:17098] 0 exiting: rc = 1 00000100:00100000:3.0:1783350114.510018:0:17099:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8ea35ba6cc00:17099] 1 exiting: rc = 0 00000100:00100000:0.0:1783350114.510395:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510402:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510407:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510413:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510419:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510424:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510429:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510434:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510439:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510443:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510448:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510453:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510459:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510464:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510482:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510487:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510491:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510497:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510502:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510507:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510512:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510517:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510521:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510526:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.510531:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.515989:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516000:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516005:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516011:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516015:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516021:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516026:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516030:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516035:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516042:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516048:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516052:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516058:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516063:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516068:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516072:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516077:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516081:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516086:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516091:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516097:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516101:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516106:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516110:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516268:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516273:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516279:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516284:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516288:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516293:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516298:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516303:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516308:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516314:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516318:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516323:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516328:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516333:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350114.516337:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350114.517565:0:17100:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8ea375dfb600:17100] 0 exiting: rc = 1 00000100:00100000:1.0:1783350114.517820:0:17101:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8ea375dfb800:17101] 1 exiting: rc = 0 00000100:00100000:0.0:1783350114.518035:0:17102:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8ea375dfae00:17102] 2 exiting: rc = 0 00000100:00100000:1.0:1783350114.518216:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518224:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518229:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518245:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518250:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518255:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518260:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518265:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518270:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518283:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518302:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518309:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518314:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518319:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518324:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518329:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518335:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518340:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518345:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518350:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518357:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518361:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518367:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518372:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518377:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518382:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518387:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518391:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518396:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518401:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518406:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518411:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518416:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518437:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518443:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518449:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518454:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518459:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518470:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518475:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518480:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518486:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518491:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518496:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518501:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518507:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518512:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518517:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518523:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518528:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518533:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518538:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518544:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518550:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518555:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518560:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518565:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518571:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518578:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518589:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518594:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518600:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518606:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350114.518612:0:20875:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783350114.523113:0:20875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350114.523754:0:20875:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1783350114.523760:0:20875:0:(genops.c:906:class_export_put()) final put ffff8ea3461c1000/MDS_uuid 00000020:00000080:1.0:1783350114.523766:0:20875:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea3461c1000/MDS_uuid for MDS 00000020:01000000:1.0:1783350114.523772:0:20875:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1783350114.523980:0:20875:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1783350115.014298:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350116.037875:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350117.061978:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350118.091470:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783350118.501833:0:21077:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783350118.520422:0:21077:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1783350118.520476:0:21077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350118.520490:0:21077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350118.520498:0:21077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350118.520504:0:21077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350118.520580:0:21077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783350118.520587:0:21077:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783350118.520611:0:21077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783350118.520615:0:21077:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783350118.520620:0:21077:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783350118.520625:0:21077:0:(import.c:65:import_set_state_nolock()) ffff8ea347503800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1783350118.520630:0:21077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783350118.520632:0:21077:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783350118.520635:0:21077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783350118.522585:0:21077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783350118.522593:0:21077:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783350118.522602:0:21077:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783350118.522629:0:21077:0:(import.c:65:import_set_state_nolock()) ffff8ea34778f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783350118.523047:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869977659595776:0@lo:39:umount.0 00000400:00000100:3.0:1783350118.523102:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659595776 offset 0 length 224: 4 00010000:00010000:0.0:1783350118.524023:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350118.524034:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350118.524044:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350118.524049:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350118.524059:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350118.524065:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350118.524088:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783350118.524091:0:17075:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783350118.524094:0:17075:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783350118.524109:0:17075:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea3461c6000 00010000:00010000:0.0:1783350118.524113:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350118.524119:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350118.524132:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350118.524227:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350118.524229:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783350118.788310:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783350118.788320:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783350118.788323:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783350118.788327:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783350118.788331:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea347506000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783350118.788340:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 554 00000100:00080000:2.0:1783350118.788345:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783350118.788353:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ea347506000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350118.788391:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37b5d4700 x1869977659595904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783350118.788531:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659596032:0@lo:400:kworker.0 00000400:00000100:0.0:1783350118.788585:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659596032 offset 0 length 224: 4 00000100:00100000:3.0:1783350118.789639:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659595904:0@lo:38:kworker.0 00000400:00000100:3.0:1783350118.789682:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659595904 offset 0 length 520: 4 00010000:00010000:2.0:1783350119.108930:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783350119.812410:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783350119.812421:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350119.812435:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783350119.812439:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783350119.812503:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783350119.812524:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659596160:0@lo:400:kworker.0 00000400:00000100:1.0:1783350119.812573:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659596160 offset 0 length 224: 4 00010000:00010000:0.0:1783350120.132374:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783350120.327347:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783350120.327461:0:18590:0:(genops.c:906:class_export_put()) final put ffff8ea243734800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1783350120.329430:0:19408:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783350120.329438:0:19408:0:(genops.c:906:class_export_put()) final put ffff8ea2435c5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783350120.331282:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea243734800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783350120.331456:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea243736000 for lustre-OST0000 00000020:00000080:3.0:1783350120.331781:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2435c5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783350120.331967:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea2435c1800 for lustre-OST0001 00010000:00010000:0.0:1783350121.158364:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350122.180350:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350123.205037:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783350123.844282:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783350123.844292:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350123.844295:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783350123.844298:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783350123.844449:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783350123.844469:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659596288:0@lo:400:kworker.0 00000400:00000100:3.0:1783350123.844528:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659596288 offset 0 length 224: 4 00010000:00010000:0.0:1783350124.228367:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350124.932536:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350114/real 1783350114] req@ffff8ea37b5d7100 x1869977659595648/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783350124 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350124.932568:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea37b5d7100 x1869977659595648/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783350124 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783350124.932587:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea3461c6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350124.932617:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1783350124.932639:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3645:1869977659595648:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1783350124.933730:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783350124.933737:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783350124.933741:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea3461c6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783350124.933746:0:36:0:(import.c:512:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 555 00000100:00080000:3.0:1783350124.933752:0:36:0:(import.c:591:import_select_connection()) MGC192.168.203.150@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783350124.933758:0:36:0:(import.c:626:import_select_connection()) MGC192.168.203.150@tcp: import ffff8ea3461c6000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350124.933788:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d776a00 x1869977659596416/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783350124.933815:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783350124.933819:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783350124.933951:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783350124.933970:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659596544:0@lo:400:kworker.0 00000400:00000100:1.0:1783350124.934019:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659596544 offset 0 length 224: 4 00000100:00100000:0.0:1783350124.936845:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3645:1869977659596416:0@lo:250:kworker.0 00000400:00000100:0.0:1783350124.936901:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869977659596416 offset 0 length 520: 4 00010000:00010000:2.0:1783350125.253187:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350126.280035:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350127.302325:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350128.004254:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350118/real 1783350118] req@ffff8ea37b5d5f80 x1869977659595776/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783350128 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350128.004283:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea37b5d5f80 x1869977659595776/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783350128 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783350128.004302:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea34778f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783350128.004325:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869977659595776:0@lo:39:umount.0 00000100:00080000:0.0:1783350128.004426:0:21077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783350128.004431:0:21077:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783350128.004436:0:21077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783350128.006007:0:21077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350128.006025:0:21077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350128.006033:0:21077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350128.006040:0:21077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350128.006070:0:21077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350128.006078:0:21077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350128.006085:0:21077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350128.006090:0:21077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350128.006114:0:21077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350128.006222:0:21077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783350128.006229:0:21077:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1783350128.006263:0:21077:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1783350128.006267:0:21077:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1783350128.006272:0:21077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783350128.006277:0:21077:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783350128.006281:0:21077:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff8ea241dc8000) has no exports 00000020:00080000:0.0:1783350128.006304:0:21077:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff8ea241dc8000) has no exports 00000020:01000000:0.0:1783350128.010447:0:21077:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea2433eb540 - data ffff8ea3711e7e58/ffff8ea34775b800 00000020:01000000:0.0:1783350128.015778:0:21077:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea342d59c00 - data ffff8ea350276000/ffff8ea36d69f400 00010000:00010000:1.0:1783350128.016688:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783350128.016700:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350128.016712:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7a00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350128.016716:0:19530:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350128.016728:0:19530:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783350128.016759:0:19530:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350128.016766:0:19530:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783350128.016769:0:19530:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1783350128.016772:0:19530:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1783350128.016792:0:19530:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea3461c6000 00010000:00010000:1.0:1783350128.016796:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350128.016803:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350128.016828:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350128.016832:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350128.016838:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8dc00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350128.016841:0:19530:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350128.016848:0:19530:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783350128.016854:0:19530:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350128.016860:0:19530:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783350128.016862:0:19530:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783350128.016870:0:19530:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783350128.016878:0:19530:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea3461c6000 00010000:00010000:1.0:1783350128.016881:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350128.016887:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350128.016896:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350128.016898:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350128.016900:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350128.017910:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1783350128.046863:0:21077:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783350128.062476:0:21077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e33d2 00000020:00000080:3.0:1783350128.062488:0:21077:0:(genops.c:906:class_export_put()) final put ffff8ea359383000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1783350128.062509:0:21077:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea347517800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1783350128.062512:0:21077:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea347517800 2 00000020:01000004:3.0:1783350128.062515:0:21077:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ea347517800 from lustre-OST0000 00000020:00000080:3.0:1783350128.062551:0:21077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783350128.062561:0:21077:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1783350128.062565:0:21077:0:(genops.c:906:class_export_put()) final put ffff8ea347505800/lustre-OST0000_UUID 00000020:00000080:3.0:1783350128.062568:0:21077:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea347505800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1783350128.062573:0:21077:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1783350128.062627:0:21077:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1783350128.062631:0:21077:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783350128.062643:0:21077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783350128.062647:0:21077:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783350128.062654:0:21077:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ea2437af800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783350128.062660:0:21077:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff8ea370df8000) has exports, disconnecting them 00000020:00080000:3.0:1783350128.062665:0:21077:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ea2437af800), last request at 1783350044 00000020:00000080:3.0:1783350128.062669:0:21077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e33fc 00000020:00080000:3.0:1783350128.062679:0:21077:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea2437af800): rc 0 00000020:00000080:3.0:1783350128.062684:0:21077:0:(genops.c:906:class_export_put()) final put ffff8ea2437af800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783350128.063260:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea359383000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783350128.063276:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2437af800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783350128.064272:0:21077:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783350128.064280:0:21077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783350128.064285:0:21077:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783350128.064291:0:21077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783350128.064462:0:21077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783350128.064470:0:21077:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1783350128.064475:0:21077:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1783350128.064479:0:21077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783350128.064483:0:21077:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783350128.064490:0:21077:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8ea347788800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783350128.064496:0:21077:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff8ea349f8cd40) has exports, disconnecting them 00000020:00080000:0.0:1783350128.064499:0:21077:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8ea347788800), last request at 1783350044 00000020:00000080:0.0:1783350128.064503:0:21077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3411 00000020:00080000:0.0:1783350128.064517:0:21077:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea347788800): rc 0 00000020:00000080:0.0:1783350128.064521:0:21077:0:(genops.c:906:class_export_put()) final put ffff8ea347788800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783350128.067489:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea347503800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783350128.067505:0:36:0:(genops.c:906:class_export_put()) final put ffff8ea359380000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1783350128.067508:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea359380000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1783350128.067515:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1783350128.067579:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea347788800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1783350128.077470:0:21077:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783350128.077481:0:21077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783350128.077485:0:21077:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783350128.077493:0:21077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783350128.077648:0:21077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783350128.077657:0:21077:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1783350128.077663:0:21077:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea347517800 1 00000020:00000080:3.0:1783350128.077670:0:21077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e33af 00000020:00000080:3.0:1783350128.077678:0:21077:0:(genops.c:906:class_export_put()) final put ffff8ea37f562000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1783350128.077683:0:21077:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1783350128.077689:0:21077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783350128.077693:0:21077:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783350128.077696:0:21077:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff8ea349f899c0) has no exports 00000020:00000080:3.0:1783350128.079374:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea34778f000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783350128.079387:0:36:0:(genops.c:906:class_export_put()) final put ffff8ea347789000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1783350128.079390:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea347789000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1783350128.079415:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1783350128.079491:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f562000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783350128.209621:0:21077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783350128.209636:0:21077:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1783350128.209642:0:21077:0:(genops.c:906:class_export_put()) final put ffff8ea347511800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1783350128.209647:0:21077:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea347511800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1783350128.209658:0:21077:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1783350128.209773:0:21077:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ea347513800 00000020:02000400:0.0:1783350128.209826:0:21077:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1783350128.328240:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350129.348418:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783350130.054378:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783350130.054387:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783350130.054390:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783350130.054394:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783350130.054643:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659596672:0@lo:400:kworker.0 00000400:00000100:2.0:1783350130.054696:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659596672 offset 0 length 224: 4 00010000:00010000:2.0:1783350130.376217:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350131.396542:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783350132.394983:0:21279:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783350132.418502:0:21279:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1783350132.418589:0:21279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350132.418604:0:21279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350132.418626:0:21279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350132.418633:0:21279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350132.418687:0:21279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783350132.418695:0:21279:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783350132.418723:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783350132.418735:0:21279:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea37b5d4700 x1869977659595904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783350138 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350132.418756:0:21279:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783350132.418762:0:21279:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783350132.418767:0:21279:0:(import.c:65:import_set_state_nolock()) ffff8ea347506000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1783350132.418771:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783350132.418785:0:21279:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea37b5d4700 x1869977659595904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783350138 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350132.418792:0:21279:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783350132.418795:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:3.0:1783350132.419260:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659595904:0@lo:38:kworker.0 00000100:00080000:2.0:1783350132.421074:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783350132.421091:0:21279:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea37b5d7b80 x1869977659596032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350134 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350132.421126:0:21279:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea36d738000 x1869977659596160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350135 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350132.421350:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659596160:0@lo:400:kworker.0 00000100:00100000:2.0:1783350132.421391:0:21279:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea36d73b100 x1869977659596288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350139 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350132.421413:0:21279:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea36d775880 x1869977659596544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350140 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350132.421444:0:21279:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea37b5d5f80 x1869977659596672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350146 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350132.421451:0:21279:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783350132.421456:0:21279:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783350132.421494:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659596288:0@lo:400:kworker.0 00010000:00010000:1.0:1783350132.421546:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350132.421555:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350132.421565:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6e00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350132.421569:0:19530:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350132.421580:0:19530:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783350132.421587:0:19530:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350132.421593:0:19530:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783350132.421596:0:19530:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783350132.421598:0:19530:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783350132.421620:0:19530:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea3461c6000 00010000:00010000:1.0:1783350132.421624:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350132.421630:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350132.421643:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350132.421645:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350132.421647:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350132.421663:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659596544:0@lo:400:kworker.0 00000100:00100000:3.0:1783350132.425305:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659596032:0@lo:400:kworker.0 00000100:00100000:3.0:1783350132.425342:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659596672:0@lo:400:kworker.0 00010000:00010000:3.0:1783350132.425412:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783350132.425578:0:21279:0:(import.c:65:import_set_state_nolock()) ffff8ea367399000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783350132.426438:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869977659596800:0@lo:39:umount.0 00000400:00000100:3.0:1783350132.426497:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659596800 offset 0 length 224: 4 00010000:00010000:0.0:1783350133.444424:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350134.470349:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783350135.172289:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783350135.172300:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783350135.492309:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350136.516366:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350137.542559:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350138.564280:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350139.588806:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350139.589484:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350124/real 1783350124] req@ffff8ea36d776a00 x1869977659596416/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783350139 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350139.589516:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea36d776a00 x1869977659596416/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783350139 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783350139.589535:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea3461c6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350139.589614:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783350139.589619:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3645:1869977659596416:0@lo:250:kworker.0 00000100:00080000:0.0:1783350139.592782:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783350139.592791:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783350139.592795:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea3461c6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783350139.592802:0:37:0:(import.c:512:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 565 00000100:00080000:0.0:1783350139.592807:0:37:0:(import.c:591:import_select_connection()) MGC192.168.203.150@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783350139.592813:0:37:0:(import.c:626:import_select_connection()) MGC192.168.203.150@tcp: import ffff8ea3461c6000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350139.592847:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f53ad80 x1869977659596928/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350139.592944:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3645:1869977659596928:0@lo:250:kworker.0 00000400:00000100:3.0:1783350139.592987:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869977659596928 offset 0 length 520: 4 00010000:00010000:1.0:1783350140.612760:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350141.636518:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350142.660447:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350142.660524:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350132/real 1783350132] req@ffff8ea37b5d5880 x1869977659596800/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783350142 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350142.660553:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea37b5d5880 x1869977659596800/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783350142 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783350142.660573:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea367399000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783350142.660595:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869977659596800:0@lo:39:umount.0 00000100:00080000:1.0:1783350142.660730:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783350142.660736:0:21279:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783350142.660740:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783350142.662060:0:21279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350142.662075:0:21279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350142.662083:0:21279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350142.662089:0:21279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350142.662197:0:21279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350142.662219:0:21279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350142.662226:0:21279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350142.662233:0:21279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350142.662240:0:21279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350142.665598:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783350142.665621:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350142.665634:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350142.665638:0:19530:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350142.665664:0:19530:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350142.665671:0:19530:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350142.665684:0:19530:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783350142.665687:0:19530:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1783350142.665709:0:19530:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea3461c6000 00010000:00010000:0.0:1783350142.665713:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350142.665720:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350142.665738:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350142.665742:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350142.665747:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350142.665750:0:19530:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350142.665757:0:19530:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350142.665763:0:19530:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350142.665776:0:19530:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783350142.665778:0:19530:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1783350142.665783:0:19530:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea3461c6000 00010000:00010000:0.0:1783350142.665785:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350142.665792:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350142.665793:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350142.665795:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350142.667604:0:21279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783350142.668734:0:21279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350142.668761:0:21279:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1783350142.668769:0:21279:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1783350142.668772:0:21279:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1783350142.668803:0:21279:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1783350142.668807:0:21279:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1783350142.668817:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350142.668822:0:21279:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783350142.668826:0:21279:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff8ea242448000) has no exports 00000020:00080000:1.0:1783350142.668850:0:21279:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff8ea242448000) has no exports 00010000:00010000:3.0:1783350142.672291:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783350142.673062:0:21279:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea34534a4e0 - data ffff8ea350007798/ffff8ea374614400 00000020:01000000:1.0:1783350142.674081:0:21279:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea34534aba0 - data ffff8ea371277288/ffff8ea36d46f800 00100000:10000000:1.0:1783350142.684889:0:21279:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783350142.698361:0:21279:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e346c 00000020:00000080:2.0:1783350142.698373:0:21279:0:(genops.c:906:class_export_put()) final put ffff8ea2435c7000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1783350142.698393:0:21279:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea34778c000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1783350142.698396:0:21279:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea34778c000 2 00000020:01000004:2.0:1783350142.698399:0:21279:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ea34778c000 from lustre-OST0001 00000020:00000080:2.0:1783350142.698427:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783350142.698444:0:21279:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1783350142.698447:0:21279:0:(genops.c:906:class_export_put()) final put ffff8ea243737800/lustre-OST0001_UUID 00000020:00000080:2.0:1783350142.698450:0:21279:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea243737800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1783350142.698461:0:21279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1783350142.698538:0:21279:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS 00010000:00010000:2.0:1783350142.698553:0:21279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340031400/0xd05e6ae1590e327b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e3282 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350142.698563:0:21279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031400/0xd05e6ae1590e327b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e3282 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350142.698570:0:21279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1783350142.698573:0:21279:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1783350142.698576:0:21279:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1783350142.698589:0:21279:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea3461c6000 00010000:00010000:2.0:1783350142.698593:0:21279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340031400/0xd05e6ae1590e327b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e3282 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350142.698607:0:21279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350142.698830:0:21279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350142.698837:0:21279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783350142.698839:0:21279:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1783350142.698841:0:21279:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1783350142.698851:0:21279:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea3461c6000 00010000:00010000:2.0:1783350142.698854:0:21279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783350142.698871:0:21279:0:(import.c:65:import_set_state_nolock()) ffff8ea3461c6000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1783350142.698880:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783350142.698882:0:21279:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783350142.698884:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783350142.698888:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783350142.698898:0:21279:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea37f53ad80 x1869977659596928/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783350159 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783350142.699029:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783350142.699033:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000020:00000080:1.0:1783350142.699078:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2435c7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1783350142.705368:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3645:1869977659596928:0@lo:250:kworker.0 10000000:01000000:2.0:1783350142.705480:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783350142.705493:0:21279:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3155 00000020:00000080:2.0:1783350142.705502:0:21279:0:(genops.c:906:class_export_put()) final put ffff8ea3461c2000/7ee7701a-0ad8-4622-a3a4-e9603bf4c749 00000020:01000000:2.0:1783350142.705523:0:21279:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.150@tcp (flags='') 00000020:00000080:2.0:1783350142.705533:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783350142.705540:0:21279:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783350142.705544:0:21279:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8ea243518000) has no exports 00000020:00000080:1.0:1783350142.705604:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea3461c2000/7ee7701a-0ad8-4622-a3a4-e9603bf4c749 for MGC192.168.203.150@tcp 10000000:01000000:3.0:1783350142.705891:0:17084:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1783350142.706052:0:21279:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.150@tcp: client import never connected 00000100:00080000:2.0:1783350142.706056:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1783350142.706059:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783350142.706062:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1783350142.706064:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783350142.706119:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783350142.706125:0:21279:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.150@tcp (uuid 7ee7701a-0ad8-4622-a3a4-e9603bf4c749) 00000020:01000000:2.0:1783350142.706132:0:21279:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783350142.706164:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783350142.706179:0:21279:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783350142.706185:0:21279:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8ea2437ac000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783350142.706190:0:21279:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff8ea370dfb380) has exports, disconnecting them 00000020:00080000:2.0:1783350142.706195:0:21279:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8ea2437ac000), last request at 1783350060 00000020:00000080:2.0:1783350142.706200:0:21279:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3496 00000020:00080000:2.0:1783350142.706212:0:21279:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea2437ac000): rc 0 00000020:00000080:2.0:1783350142.706216:0:21279:0:(genops.c:906:class_export_put()) final put ffff8ea2437ac000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1783350142.706953:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea3461c6000 for MGC192.168.203.150@tcp 00000020:00000080:1.0:1783350142.706965:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea37f5b3000/7ee7701a-0ad8-4622-a3a4-e9603bf4c749 00000020:00000080:1.0:1783350142.706968:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f5b3000/7ee7701a-0ad8-4622-a3a4-e9603bf4c749 for MGC192.168.203.150@tcp 00000020:01000000:1.0:1783350142.706974:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.150@tcp (7ee7701a-0ad8-4622-a3a4-e9603bf4c749) 00000020:00000080:1.0:1783350142.707251:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2437ac000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1783350142.708368:0:21279:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1783350142.708375:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783350142.708379:0:21279:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783350142.708386:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783350142.708522:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783350142.708531:0:21279:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1783350142.708536:0:21279:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783350142.708541:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783350142.708544:0:21279:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783350142.708551:0:21279:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8ea36739b800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783350142.708558:0:21279:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff8ea24244cd40) has exports, disconnecting them 00000020:00080000:3.0:1783350142.708562:0:21279:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8ea36739b800), last request at 1783350060 00000020:00000080:3.0:1783350142.708566:0:21279:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e34ab 00000020:00080000:3.0:1783350142.708579:0:21279:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea36739b800): rc 0 00000020:00000080:3.0:1783350142.708587:0:21279:0:(genops.c:906:class_export_put()) final put ffff8ea36739b800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1783350142.709080:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea347506000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1783350142.709090:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea2437ac800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1783350142.709093:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2437ac800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1783350142.709099:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1783350142.709185:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36739b800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1783350142.711217:0:21279:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1783350142.711225:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783350142.711229:0:21279:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783350142.711236:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783350142.711263:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea367399000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1783350142.713843:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1783350142.718303:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1783350142.725323:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1783350142.732470:0:17071:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8ea241da0800:17071] 1 exiting: rc = 0 00000100:00100000:3.0:1783350142.735559:0:17070:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8ea34b41a600:17070] 0 exiting: rc = 1 00000100:00100000:1.0:1783350142.743709:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.744994:0:17074:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8ea345bd5a00:17074] 2 exiting: rc = 0 00000100:00100000:2.0:1783350142.745381:0:17072:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8ea36daa6a00:17072] 0 exiting: rc = 1 00000100:00100000:3.0:1783350142.753059:0:20876:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8ea241da3600:20876] 3 exiting: rc = 0 00000100:00100000:3.0:1783350142.753301:0:17073:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8ea345bd5000:17073] 1 exiting: rc = 0 00000100:00100000:1.0:1783350142.753838:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.753848:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.753855:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.753864:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.753872:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.753882:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.753895:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.753902:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.753985:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.753993:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754009:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754013:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754018:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754023:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754028:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754032:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754037:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754043:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754048:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754055:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754062:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754070:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754080:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754090:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754097:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754102:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754107:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754111:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754116:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754121:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754126:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754130:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754157:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754163:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754168:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754173:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754178:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754183:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754188:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754193:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754198:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754204:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754208:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754213:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754217:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754230:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754234:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754239:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754244:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754250:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754254:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754259:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754263:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754267:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754272:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754276:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754281:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754285:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754290:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754294:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754298:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754303:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754308:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.754312:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783350142.755017:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350142.755027:0:21279:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1783350142.755032:0:21279:0:(genops.c:906:class_export_put()) final put ffff8ea2435c6800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1783350142.755036:0:21279:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2435c6800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1783350142.755041:0:21279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1783350142.755085:0:21279:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea34778c000 1 00000020:00000080:1.0:1783350142.755091:0:21279:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e3450 00000020:00000080:1.0:1783350142.755096:0:21279:0:(genops.c:906:class_export_put()) final put ffff8ea2437a8000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1783350142.755106:0:21279:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1783350142.755116:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2437a8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1783350142.755126:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350142.755131:0:21279:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783350142.755134:0:21279:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff8ea37b540000) has no exports 00000020:00000080:1.0:1783350142.817242:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350142.817264:0:21279:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1783350142.817269:0:21279:0:(genops.c:906:class_export_put()) final put ffff8ea34778a800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1783350142.817274:0:21279:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea34778a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1783350142.817283:0:21279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1783350142.817626:0:21279:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ea347788000 00000020:01000000:1.0:1783350142.817653:0:21279:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1783350142.817657:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783350142.817660:0:21279:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783350142.817665:0:21279:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff8ea37f458000) has no exports 00000020:00000080:1.0:1783350142.817687:0:21279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783350142.817693:0:21279:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1783350142.817704:0:21279:0:(genops.c:906:class_export_put()) final put ffff8ea37f563800/OSS_uuid 00000020:00000080:1.0:1783350142.817707:0:21279:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f563800/OSS_uuid for OSS 00000020:01000000:1.0:1783350142.817710:0:21279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1783350142.817733:0:17083:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1783350142.818800:0:18594:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8ea36d910a00:18594] 0 exiting: rc = 1 00000100:00100000:3.0:1783350142.818809:0:18596:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8ea3454bde00:18596] 2 exiting: rc = 0 00000100:00100000:0.0:1783350142.818887:0:19527:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8ea241d01c00:19527] 4 exiting: rc = 0 00000100:00100000:0.0:1783350142.818942:0:19278:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8ea241db7e00:19278] 3 exiting: rc = 0 00000100:00100000:0.0:1783350142.818992:0:18595:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8ea36d910200:18595] 1 exiting: rc = 0 00000100:00100000:1.0:1783350142.822449:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.822462:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.822468:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.822472:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.822477:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.822484:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.822489:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.822493:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.822498:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.822503:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.822507:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.823975:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.823993:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.823999:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824004:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824010:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824015:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824020:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824026:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824032:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824070:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824075:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824081:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824086:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824092:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824097:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824103:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824108:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824113:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824119:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824124:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824128:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824133:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824166:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824172:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824178:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824184:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824198:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824203:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824209:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824214:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824220:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824225:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824231:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824244:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824250:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824255:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824260:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824265:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824270:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824276:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824281:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824286:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824292:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.824297:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.826489:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.826520:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.826526:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.826531:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.826536:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.826541:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.826546:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.826550:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.826555:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783350142.838175:0:18597:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8ea375dcde00:18597] 0 exiting: rc = 1 00000100:00100000:3.0:1783350142.838264:0:18598:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8ea351b04200:18598] 1 exiting: rc = 0 00000100:00100000:3.0:1783350142.838331:0:20587:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8ea375e21400:20587] 2 exiting: rc = 0 00000100:00100000:1.0:1783350142.848106:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848116:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848121:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848126:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848132:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848151:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848157:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848162:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848167:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848173:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848178:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848183:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848188:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848192:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848196:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848201:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848206:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848211:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848216:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848221:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848226:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848231:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848236:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848240:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848244:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848249:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848268:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848274:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848280:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848285:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848290:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848295:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848300:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848306:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848321:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848326:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848331:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848336:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848341:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848346:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848352:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848359:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848365:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848371:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848377:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848384:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848391:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848400:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848406:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848411:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848416:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848426:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848431:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848437:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848442:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848446:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848451:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848456:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848461:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848466:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848470:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848481:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848486:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.848495:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350142.850538:0:18599:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8ea36d6a5600:18599] 0 exiting: rc = 1 00000100:00100000:0.0:1783350142.851034:0:18601:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8ea34774e400:18601] 2 exiting: rc = 0 00000100:00100000:1.0:1783350142.852801:0:18600:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8ea36d840e00:18600] 1 exiting: rc = 0 00000100:00100000:1.0:1783350142.852904:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.852912:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854019:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854030:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854037:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854043:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854049:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854055:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854061:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854067:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854073:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854079:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854085:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854090:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854096:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854102:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854124:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854130:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854147:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854154:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854159:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854165:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854171:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854176:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854182:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854187:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854193:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854198:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854203:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854208:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854213:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854234:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854240:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854245:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854250:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854255:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854261:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854267:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854272:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854278:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854298:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.854305:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857449:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857469:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857473:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857478:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857483:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857489:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857495:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857500:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857507:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857512:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857517:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857523:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857528:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857534:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857540:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857545:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857550:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857556:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857561:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857566:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857571:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.857576:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783350142.868391:0:18602:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8ea347750400:18602] 0 exiting: rc = 1 00000100:00100000:1.0:1783350142.871910:0:18603:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8ea34774ee00:18603] 1 exiting: rc = 0 00000100:00100000:1.0:1783350142.872210:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872232:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872236:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872241:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872246:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872252:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872263:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872271:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872276:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872281:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872287:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872292:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872296:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872301:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872306:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872861:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872870:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872876:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872881:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872886:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872892:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872896:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872901:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872906:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872910:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872915:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872932:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872937:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872943:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872948:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872953:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872958:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872963:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872968:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872971:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872976:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872990:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872994:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.872999:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873004:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873009:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873015:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873020:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873026:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873031:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873037:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873042:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873047:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873053:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873058:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873063:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873068:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873073:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873078:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873084:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873089:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873095:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873100:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873104:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873109:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873114:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873119:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873123:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.873160:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783350142.877433:0:18604:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8ea34774f800:18604] 0 exiting: rc = 1 00000100:00100000:2.0:1783350142.877521:0:18605:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8ea34774f400:18605] 1 exiting: rc = 0 00000100:00100000:1.0:1783350142.877703:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877713:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877726:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877733:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877739:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877744:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877750:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877791:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877806:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877819:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877827:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877837:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877848:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877857:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877864:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877870:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877879:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877889:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877902:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877988:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.877995:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878000:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878006:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878012:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878017:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878023:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878028:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878034:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878039:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878045:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878052:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878072:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878079:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878086:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878092:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878098:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878105:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878111:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878117:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878123:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878128:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878133:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878163:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878250:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878257:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878262:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878267:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878274:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878280:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878286:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878291:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878297:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878303:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878317:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878323:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878344:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878352:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878359:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878366:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878375:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878383:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878390:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878395:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783350142.878401:0:21279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1783350142.890322:0:21279:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783350162.122739:0:22045:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783350172.233234:0:22644:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783350172.233241:0:22644:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783350172.233243:0:22644:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783350172.233353:0:22644:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ea37464f800 00000020:01000004:2.0:1783350172.233369:0:22644:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783350172.233376:0:22644:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783350172.233390:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ea37b543380) 00000020:00000080:2.0:1783350172.233403:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783350172.354045:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783350172.359352:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783350172.359930:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783350172.361786:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783350172.362070:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783350172.362263:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783350172.362442:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783350172.362629:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783350172.367243:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783350172.367676:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783350172.367971:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783350172.368163:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1783350172.374626:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1783350172.375425:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783350172.380720:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1783350172.392568:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.392780:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.393010:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.393268:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.393478:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.394300:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.394585:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.395073:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.395548:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.395770:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.396025:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.396273:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.396511:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.396747:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.396948:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.397236:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.397626:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.397821:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.398040:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.404844:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.405444:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.405724:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.406000:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.406232:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.406401:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.406725:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.406886:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1783350172.407287:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.407494:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.407720:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1783350172.407915:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783350172.409483:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783350172.410277:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1783350172.410683:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1783350172.411341:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1783350172.411942:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1783350172.412216:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1783350172.412409:0:22644:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1783350172.413132:0:22644:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783350172.413415:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783350172.413421:0:22644:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783350172.413431:0:22644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e39c8 00000020:01000004:2.0:1783350172.413437:0:22644:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783350172.413442:0:22644:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783350172.413447:0:22644:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea37464f800 from MGS 00000020:01000004:2.0:1783350172.413451:0:22644:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783350172.413461:0:22644:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ea37b544d40) 00000020:00000080:2.0:1783350172.413480:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783350172.413538:0:22644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea37464f800 from MGS, refs=2 00080000:01000000:2.0:1783350172.413552:0:22644:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783350172.413557:0:22644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e39d6 00000100:00100000:2.0:1783350172.413881:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783350172.414038:0:22644:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783350172.414044:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783350172.414766:0:22644:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783350172.414774:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783350172.415446:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783350172.415585:0:22644:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783350172.415591:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783350172.416117:0:22644:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783350172.416124:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783350172.416519:0:22644:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783350172.416527:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1783350172.417258:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350172.417261:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350172.417263:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350172.417580:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350172.417582:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350172.417584:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350172.418127:0:22644:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1783350172.424353:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1783350172.425314:0:22644:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1783350172.426003:0:22656:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783350172.426037:0:22644:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783350172.426073:0:22644:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783350172.426582:0:22644:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783350172.426896:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783350172.427032:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783350172.427037:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783350172.429966:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783350172.429976:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783350172.430432:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783350172.430437:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783350172.431038:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783350172.431057:0:22644:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.150@tcp' 00000020:01000004:1.0:1783350172.431059:0:22644:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783350172.431083:0:22644:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.150@tcp (typ=mgc) 00000020:00000080:1.0:1783350172.431095:0:22644:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.150@tcp (ffff8ea370dfb380) 00000020:00000080:1.0:1783350172.431107:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783350172.431203:0:22644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea2437ab800@MGC192.168.203.150@tcp: add connection 192.168.203.150@tcp at head 00010000:00010000:1.0:1783350172.431335:0:22644:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.150@tcp-0 is initialized 00000040:01000000:1.0:1783350172.431340:0:22644:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 1 is initialized 00000100:00080000:0.0:1783350172.431455:0:22660:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1783350172.440426:0:22662:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783350172.440527:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.150@tcp (uuid 2239a5ab-360a-4f19-bf1f-f81ba58e2cb8) 00000020:00000080:1.0:1783350172.440549:0:22644:0:(genops.c:1406:class_connect()) connect: client 2239a5ab-360a-4f19-bf1f-f81ba58e2cb8, cookie 0xd05e6ae1590e39e4 00000100:00080000:1.0:1783350172.440561:0:22644:0:(import.c:512:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783350172.440567:0:22644:0:(import.c:626:import_select_connection()) MGC192.168.203.150@tcp: import ffff8ea2437ab800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350172.440606:0:22644:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d739180 x1869977659597056/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350172.440630:0:22644:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 2239a5ab-360a-4f19-bf1f-f81ba58e2cb8->MGS 00000020:01000004:1.0:1783350172.440651:0:22644:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783350172.440656:0:22644:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783350172.440669:0:22644:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8ea370df99c0) 00000020:00000080:1.0:1783350172.440680:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783350172.445841:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3645:1869977659597056:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783350172.445926:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350172.447333:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659597056 00000100:00100000:2.0:1783350172.447344:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659597056 00000100:00100000:2.0:1783350172.447375:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783350172.447382:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1869977659597056:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783350172.447407:0:22657:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 2239a5ab-360a-4f19-bf1f-f81ba58e2cb8@0@lo t0 exp 0000000000000000 cur 613 last 0 00000020:00000080:2.0:1783350172.447431:0:22657:0:(genops.c:1406:class_connect()) connect: client 2239a5ab-360a-4f19-bf1f-f81ba58e2cb8, cookie 0xd05e6ae1590e39f2 00000100:00080000:2.0:1783350172.447551:0:22657:0:(import.c:65:import_set_state_nolock()) ffff8ea243adc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783350172.447613:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+5:3645:x1869977659597056:12345-0@lo:250:mount.lustre.0 Request processed in 230us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350172.447620:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783350172.451534:0:3645:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783350172.451548:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.150@tcp: connect to target with instance 0 00000100:00080000:3.0:1783350172.451556:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783350172.451561:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783350172.451565:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea2437ab800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783350172.451568:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783350172.451580:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783350172.451588:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3645:1869977659597056:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783350172.457643:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783350172.458572:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783350172.458580:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1783350172.461170:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783350172.461181:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783350172.461533:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783350172.461539:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783350172.462251:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783350172.462392:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783350172.462398:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783350172.463218:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783350172.463225:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1783350172.512044:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783350172.512254:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1783350172.512267:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783350172.513294:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783350172.513304:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783350172.513954:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783350172.514092:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783350172.514096:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1783350172.514937:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783350172.514946:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1783350172.515681:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783350172.515966:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783350172.515971:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1783350172.516426:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783350172.516433:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783350172.521774:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783350172.521946:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783350172.521953:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783350172.522697:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783350172.522706:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783350172.546845:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783350172.547061:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783350172.547069:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783350172.552984:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783350172.552999:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783350172.554769:0:22644:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783350172.554783:0:22644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783350172.557691:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783350172.557722:0:22644:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783350172.557790:0:22644:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783350172.557961:0:22644:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783350172.557996:0:22644:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.150@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783350172.558000:0:22644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783350172.558002:0:22644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783350172.558003:0:22644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783350172.558004:0:22644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783350172.558005:0:22644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783350172.558006:0:22644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783350172.558007:0:22644:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783350172.558008:0:22644:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783350172.558010:0:22644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783350172.558077:0:22644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783350172.558080:0:22644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783350172.558082:0:22644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783350172.558084:0:22644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783350172.558085:0:22644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783350172.558086:0:22644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783350172.558092:0:22644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783350172.558094:0:22644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783350172.558178:0:22644:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783350172.558180:0:22644:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783350172.558182:0:22644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783350172.558183:0:22644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783350172.558209:0:22644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783350172.558230:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597184:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783350172.558308:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350172.558398:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea35931a840 going to sleep for 11 seconds 00000100:00100000:0.0:1783350172.558490:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659597184 00000100:00100000:0.0:1783350172.558497:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659597184 00000100:00100000:0.0:1783350172.558543:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350172.558551:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+5:22644:x1869977659597184:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783350172.558598:0:22659:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783350172.558601:0:22659:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783350172.558604:0:22659:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1783350172.559098:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783350172.559822:0:22659:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1783350172.560959:0:22681:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783350172.560965:0:22681:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1783350172.560968:0:22681:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783350172.560971:0:22681:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783350172.561123:0:22681:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1783350172.564609:0:22659:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783350172.564621:0:22659:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783350172.568235:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+5:22644:x1869977659597184:12345-0@lo:253:mount.lustre.0 Request processed in 9675us (9917us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350172.568248:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783350172.568400:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597184:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783350172.568416:0:22644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783350172.568420:0:22644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783350172.568421:0:22644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783350172.568423:0:22644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783350172.568424:0:22644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783350172.568425:0:22644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783350172.568426:0:22644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783350172.568427:0:22644:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783350172.568429:0:22644:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783350172.568430:0:22644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783350172.568432:0:22644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783350172.568462:0:22644:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea37464f800 from lustre-MDT0000 10000000:01000000:1.0:1783350172.568499:0:22644:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783350172.568502:0:22644:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783350172.568506:0:22644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ea370dfb380 10000000:01000000:1.0:1783350172.568509:0:22644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783350172.568515:0:22644:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ea370dfb380 from 1 10000000:01000000:1.0:1783350172.568518:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783350172.568554:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.568564:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.568589:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350172.568609:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783350172.568644:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350172.568853:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea361840cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350172.569328:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659597312 00000100:00100000:2.0:1783350172.569335:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659597312 00000100:00100000:2.0:1783350172.569416:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783350172.569425:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+5:22644:x1869977659597312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350172.569439:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350172.569473:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e3a00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e39f9 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.569496:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e3a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e39f9 expref: 6 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.569505:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e3a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e39f9 expref: 6 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.569514:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8ee00, rc 0) 00000100:00100000:2.0:1783350172.569565:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+6:22644:x1869977659597312:12345-0@lo:101:mount.lustre.0 Request processed in 142us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350172.569572:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783350172.569639:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350172.569653:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.569661:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350172.569727:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350172.569757:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350172.569882:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350172.570034:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659597440 00000100:00100000:1.0:1783350172.570038:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659597440 00000100:00100000:1.0:1783350172.570058:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783350172.570064:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+6:22644:x1869977659597440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350172.570156:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+6:22644:x1869977659597440:12345-0@lo:501:mount.lustre.0 Request processed in 72us (380us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783350172.570163:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783350172.570229:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597440:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783350172.570257:0:22644:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783350172.570274:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.570297:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350172.570305:0:22644:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea37464f800 10000000:01000000:3.0:1783350172.570309:0:22644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783350172.570314:0:22644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ea37464f800 10000000:01000000:3.0:1783350172.570316:0:22644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783350172.570320:0:22644:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8ea37464f800 from 1 10000000:01000000:3.0:1783350172.570322:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783350172.570342:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e3a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.570350:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e3a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.570357:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e3a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350172.570368:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350172.570393:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350172.570409:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350172.570479:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659597568 00000100:00100000:1.0:1783350172.570483:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659597568 00000100:00100000:1.0:1783350172.570499:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783350172.570504:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+6:22644:x1869977659597568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350172.570510:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350172.570520:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea374603800/0xd05e6ae1590e3a0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3a07 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.570534:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea374603800/0xd05e6ae1590e3a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3a07 expref: 7 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.570542:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea374603800/0xd05e6ae1590e3a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3a07 expref: 7 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.570557:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374603800, rc 0) 00000100:00100000:1.0:1783350172.570592:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+7:22644:x1869977659597568:12345-0@lo:101:mount.lustre.0 Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350172.570597:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783350172.570667:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350172.570678:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e3a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a0e expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.570684:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e3a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3a0e expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350172.570713:0:22644:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783350172.570725:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e3a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a0e expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.570732:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e3a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a0e expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350172.570738:0:22644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783350172.570742:0:22644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783350172.570746:0:22644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ea37464f800 10000000:01000000:3.0:1783350172.570748:0:22644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783350172.570751:0:22644:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783350172.570753:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783350172.570765:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e3a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.570771:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e3a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.570778:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e3a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350172.570790:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350172.570814:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350172.570825:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350172.570937:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659597696 00000100:00100000:1.0:1783350172.570941:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659597696 00000100:00100000:1.0:1783350172.570957:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783350172.570962:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+7:22644:x1869977659597696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350172.570969:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350172.570975:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea374603600/0xd05e6ae1590e3a1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3a15 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.570988:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea374603600/0xd05e6ae1590e3a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3a15 expref: 8 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.570996:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea374603600/0xd05e6ae1590e3a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3a15 expref: 8 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.571003:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374603600, rc 0) 00000100:00100000:1.0:1783350172.571033:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+8:22644:x1869977659597696:12345-0@lo:101:mount.lustre.0 Request processed in 71us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350172.571039:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783350172.571183:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350172.571193:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e3a15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a1c expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.571207:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e3a15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3a1c expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350172.571245:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350172.571266:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350172.571290:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350172.571330:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659597824 00000100:00100000:1.0:1783350172.571334:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659597824 00000100:00100000:1.0:1783350172.571350:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783350172.571355:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+8:22644:x1869977659597824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350172.571459:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+9:22644:x1869977659597824:12345-0@lo:501:mount.lustre.0 Request processed in 103us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350172.571481:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783350172.571542:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350172.571577:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783350172.571609:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350172.571627:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350172.571668:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659597952 00000100:00100000:1.0:1783350172.571672:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659597952 00000100:00100000:1.0:1783350172.571696:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783350172.571703:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+9:22644:x1869977659597952:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350172.572400:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+9:22644:x1869977659597952:12345-0@lo:503:mount.lustre.0 Request processed in 695us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350172.572408:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783350172.572535:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659597952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350172.573046:0:22682:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22682:1869977659598080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783350172.573089:0:22682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350172.573161:0:22682:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3463be180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350172.573272:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659598080 00000100:00100000:2.0:1783350172.573278:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659598080 00000100:00100000:3.0:1783350172.573414:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783350172.573422:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+9:22682:x1869977659598080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783350172.574027:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+9:22682:x1869977659598080:12345-0@lo:502:llog_process_th.0 Request processed in 603us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350172.574034:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783350172.574091:0:22682:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22682:1869977659598080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783350172.574117:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350172.574127:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.574129:0:22682:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783350172.574149:0:22682:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783350172.574152:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783350172.574165:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ea370dfcd40) 00000020:00000080:1.0:1783350172.574182:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783350172.574186:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783350172.574262:0:22682:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783350172.574268:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e3a2a 00000020:00000080:1.0:1783350172.574457:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783350172.574461:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350172.574464:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.574479:0:22682:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783350172.574482:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350172.574493:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.574494:0:22682:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783350172.574498:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783350172.574505:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ea370df8000) 00000020:00000080:1.0:1783350172.574514:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783350172.574518:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783350172.574519:0:22682:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783350172.574522:0:22682:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783350172.574528:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783350172.574571:0:22682:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea37464f800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783350172.574582:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ea241dc8000) 00000020:00000080:1.0:1783350172.574590:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783350172.574631:0:22682:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783350172.574636:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e3a3f 00000020:00000080:1.0:1783350172.574839:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783350172.574845:0:22682:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783350172.574849:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd05e6ae1590e3a46 00080000:01000000:1.0:1783350172.574853:0:22682:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783350172.574856:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e3a4d 00010000:00010000:2.0:1783350172.662245:0:22682:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783350172.662682:0:22682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1783350172.663060:0:22682:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783350172.663634:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ea37b5419c0) 00000020:00000080:2.0:1783350172.663650:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783350172.663725:0:22682:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783350172.663732:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e3a5b 00000020:00000080:2.0:1783350172.664284:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783350172.666586:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd05e6ae1590e3a62 00000020:00000080:2.0:1783350172.667041:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783350172.667053:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350172.667059:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350172.667061:0:22682:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783350172.667064:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783350172.667067:0:22682:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1783350172.667069:0:22682:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350172.667070:0:22682:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350172.667071:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783350172.667073:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350172.667074:0:22682:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783350172.667076:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350172.667081:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350172.667082:0:22682:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783350172.667086:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783350172.667120:0:22682:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783350172.667176:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350172.667180:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350172.667181:0:22682:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783350172.667184:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350172.667187:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350172.667188:0:22682:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1783350172.667191:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783350172.667196:0:22682:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:00000080:2.0:1783350172.667227:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783350172.667242:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ea37b540000) 00000020:00000080:2.0:1783350172.667255:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1783350172.667260:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783350172.667320:0:22682:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1783350172.667326:0:22682:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783350172.667332:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e3a70 00010000:00080000:2.0:1783350172.667360:0:22682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea37f567000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1783350172.674127:0:22682:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1783350172.676725:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783350172.676740:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783350172.676773:0:22682:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783350172.676792:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e3a77 00000100:00080000:2.0:1783350172.676801:0:22682:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783350172.676807:0:22682:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ea37f567000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350172.676839:0:22682:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37b5d5880 x1869977659598208/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783350172.676869:0:22682:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1783350172.676936:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350172.676940:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350172.676942:0:22682:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783350172.676945:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783350172.676947:0:22682:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1783350172.676949:0:22682:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350172.676950:0:22682:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350172.676952:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783350172.676954:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350172.676955:0:22682:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783350172.676958:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783350172.676962:0:22682:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783350172.676965:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350172.676972:0:22682:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783350172.676977:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783350172.676981:0:22682:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:2.0:1783350172.677003:0:22682:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783350172.677005:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783350172.677018:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ea36d140000) 00000020:00000080:2.0:1783350172.677028:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1783350172.677033:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783350172.677081:0:22682:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783350172.677087:0:22682:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783350172.677093:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e3a85 00010000:00080000:2.0:1783350172.677119:0:22682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea357ed8000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1783350172.677325:0:22682:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1783350172.677578:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659598208:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783350172.677638:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350172.680083:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659598208 00000100:00100000:2.0:1783350172.680098:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659598208 00000100:00100000:2.0:1783350172.680166:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783350172.680176:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869977659598208:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1783350172.680202:0:22669:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1783350172.681789:0:22682:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783350172.682026:0:22682:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783350172.688403:0:22682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783350172.691095:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1783350172.698547:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1783350172.698962:0:22688:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1783350172.698968:0:22688:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783350172.699596:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783350172.699608:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783350172.699640:0:22682:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783350172.699658:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e3a8c 00000100:00080000:1.0:1783350172.699668:0:22682:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783350172.699674:0:22682:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ea357ed8000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350172.699718:0:22682:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d73aa00 x1869977659598336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350172.699746:0:22682:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783350172.699797:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350172.699806:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.699808:0:22682:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783350172.699812:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783350172.699814:0:22682:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1783350172.699816:0:22682:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783350172.699817:0:22682:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783350172.699819:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783350172.699822:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.699823:0:22682:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783350172.699825:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783350172.699829:0:22682:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783350172.699832:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.699833:0:22682:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783350172.699835:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783350172.699839:0:22682:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:1.0:1783350172.699860:0:22682:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783350172.699862:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783350172.699872:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ea241dccd40) 00000020:00000080:1.0:1783350172.699883:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1783350172.699887:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1783350172.700051:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659598336:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783350172.700113:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659598336 offset 0 length 520: 4 00000004:00080000:1.0:1783350172.700237:0:22682:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783350172.700242:0:22682:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783350172.700248:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e3a9a 00010000:00080000:1.0:1783350172.700275:0:22682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea24271b000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:1.0:1783350172.700485:0:22682:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1783350172.700543:0:22682:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783350172.700556:0:22682:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1783350172.701829:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869977659598208:12345-0@lo:38:llog_process_th.0 Request processed in 21647us (24183us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783350172.701841:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783350172.702131:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea37f567000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783350172.702157:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783350172.702162:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659598208:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1783350172.703505:0:22682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783350172.704015:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1783350172.704131:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1783350172.707459:0:22690:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1783350172.707478:0:22690:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783350172.708313:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783350172.708326:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783350172.708360:0:22682:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783350172.708380:0:22682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e3aa1 00000100:00080000:0.0:1783350172.708392:0:22682:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783350172.708397:0:22682:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ea24271b000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350172.708430:0:22682:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f538380 x1869977659598464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783350172.708452:0:22682:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783350172.708504:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350172.708508:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350172.708510:0:22682:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783350172.708513:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350172.708517:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350172.708518:0:22682:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783350172.708521:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783350172.708522:0:22682:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783350172.708524:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350172.708526:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350172.708528:0:22682:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783350172.708530:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350172.708532:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350172.708533:0:22682:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783350172.708537:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783350172.708566:0:22682:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22682:1869977659598592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783350172.708639:0:22682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350172.708677:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659598592 00000100:00100000:0.0:1783350172.708683:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659598592 00000100:00100000:0.0:1783350172.708730:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783350172.708743:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+9:22682:x1869977659598592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783350172.708834:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+9:22682:x1869977659598592:12345-0@lo:502:llog_process_th.0 Request processed in 91us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350172.708841:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783350172.708884:0:22682:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc20b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783350172.708903:0:22682:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22682:1869977659598592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783350172.708924:0:22682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350172.708927:0:22682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350172.708929:0:22682:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783350172.708932:0:22682:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1783350172.709150:0:22644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1783350172.709173:0:22644:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783350172.709190:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e3a15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a1c expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.709212:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e3a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a1c expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350172.709220:0:22644:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea37464f800 from 1 10000000:01000000:3.0:1783350172.709222:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783350172.709245:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.709252:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.709262:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350172.709274:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659598720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350172.709300:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350172.709315:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508cef00 going to sleep for 11 seconds 00000100:00100000:3.0:1783350172.709332:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659598720 00000100:00100000:3.0:1783350172.709335:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659598720 00000100:00100000:3.0:1783350172.709358:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783350172.709364:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+9:22644:x1869977659598720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350172.709372:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350172.709385:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3aaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3aa8 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.709404:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3aaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3aa8 expref: 10 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.709426:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3aaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3aa8 expref: 10 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.709434:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd400, rc 0) 00000100:00100000:3.0:1783350172.709461:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+10:22644:x1869977659598720:12345-0@lo:101:mount.lustre.0 Request processed in 97us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350172.709477:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783350172.709525:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659598720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350172.709536:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.709545:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350172.710202:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659598848:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783350172.710241:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350172.710261:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508cef00 going to sleep for 11 seconds 00000100:00100000:1.0:1783350172.710326:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659598464:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783350172.710417:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659598464 offset 0 length 520: 4 00000100:00100000:2.0:1783350172.710700:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659598848 00000100:00100000:2.0:1783350172.710705:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659598848 00000100:00100000:2.0:1783350172.710736:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783350172.710743:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+10:22644:x1869977659598848:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783350172.710760:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783350172.710765:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783350172.710844:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+10:22644:x1869977659598848:12345-0@lo:256:mount.lustre.0 Request processed in 101us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350172.710860:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783350172.711097:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659598848:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783350172.711673:0:22644:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783350172.711753:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.711763:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350172.711771:0:22644:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea37464f800 from 1 10000000:01000000:1.0:1783350172.711774:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783350172.711805:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.711812:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.711821:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350172.711837:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659598976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783350172.711879:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350172.711905:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52900 going to sleep for 11 seconds 00000100:00100000:0.0:1783350172.712415:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659598976 00000100:00100000:0.0:1783350172.712422:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659598976 00000100:00100000:0.0:1783350172.712462:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783350172.712480:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+10:22644:x1869977659598976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350172.712494:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350172.712510:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3abd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3ab6 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.712532:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3ab6 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.712543:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3ab6 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.712552:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f1800, rc 0) 00000100:00100000:0.0:1783350172.712597:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22644:x1869977659598976:12345-0@lo:101:mount.lustre.0 Request processed in 118us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350172.712603:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783350172.712944:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659598976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350172.712958:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.712966:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350172.713033:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659599104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350172.713059:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350172.713078:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52900 going to sleep for 11 seconds 00000100:00100000:2.0:1783350172.713164:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659599104 00000100:00100000:2.0:1783350172.713168:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659599104 00000100:00100000:2.0:1783350172.713187:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783350172.713192:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22644:x1869977659599104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350172.713301:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22644:x1869977659599104:12345-0@lo:501:mount.lustre.0 Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350172.713307:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783350172.713429:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659599104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350172.713456:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659599232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350172.713503:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350172.713528:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52900 going to sleep for 11 seconds 00000100:00100000:2.0:1783350172.713572:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659599232 00000100:00100000:2.0:1783350172.713576:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659599232 00000100:00100000:2.0:1783350172.713601:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783350172.713607:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22644:x1869977659599232:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350172.713698:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22644:x1869977659599232:12345-0@lo:503:mount.lustre.0 Request processed in 81us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350172.713704:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783350172.713825:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659599232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350172.714173:0:22692:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22692:1869977659599360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783350172.714203:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350172.714216:0:22692:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350172.714345:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659599360 00000100:00100000:2.0:1783350172.714350:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659599360 00000100:00100000:2.0:1783350172.714376:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783350172.714382:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22692:x1869977659599360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350172.714819:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22692:x1869977659599360:12345-0@lo:502:llog_process_th.0 Request processed in 436us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350172.714826:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783350172.714900:0:22692:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22692:1869977659599360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783350172.714966:0:22692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350172.714976:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.714978:0:22692:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783350172.714985:0:22692:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea37464f800 00000020:00000080:1.0:1783350172.714988:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350172.714995:0:22692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350172.714998:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.714999:0:22692:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783350172.715001:0:22692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350172.715003:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.715005:0:22692:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783350172.715007:0:22692:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea37464f800 00000020:00000080:1.0:1783350172.715009:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350172.715948:0:22692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350172.715958:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.715960:0:22692:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783350172.715964:0:22692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350172.715967:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.715969:0:22692:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783350172.715974:0:22692:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea37464f800 00000020:00000080:1.0:1783350172.715976:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350172.719272:0:22692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350172.719285:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.719287:0:22692:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783350172.719291:0:22692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350172.719295:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350172.719296:0:22692:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783350172.719313:0:22692:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea37464f800 00000020:00000080:1.0:1783350172.719315:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783350172.719395:0:22692:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22692:1869977659599488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783350172.719479:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350172.719518:0:22692:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350172.731620:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659599488 00000100:00100000:1.0:1783350172.731645:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659599488 00000100:00100000:1.0:1783350172.731698:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783350172.731708:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22692:x1869977659599488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783350172.731862:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22692:x1869977659599488:12345-0@lo:502:llog_process_th.0 Request processed in 155us (12393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350172.731869:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783350172.733480:0:22692:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22692:1869977659599488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783350172.733521:0:22692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350172.733528:0:22692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350172.733530:0:22692:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783350172.733535:0:22692:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1783350172.735146:0:22644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783350172.735179:0:22644:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783350172.735199:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.735223:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350172.735278:0:22644:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783350172.735281:0:22644:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea37464f800 10000000:01000000:2.0:1783350172.735284:0:22644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea37464f800 10000000:01000000:2.0:1783350172.735287:0:22644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783350172.735292:0:22644:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea37464f800 from 1 10000000:01000000:2.0:1783350172.735295:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783350172.735328:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e3ac4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.735336:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e3ac4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.735345:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e3ac4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350172.735368:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659599616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783350172.735429:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350172.738410:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350172.738443:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659599616 00000100:00100000:2.0:1783350172.738451:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659599616 00000100:00100000:2.0:1783350172.738513:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783350172.738522:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22644:x1869977659599616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350172.738538:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350172.738555:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e3acb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3ac4 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.738592:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e3acb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3ac4 expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.738614:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e3acb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3ac4 expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.738623:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f800, rc 0) 00000100:00100000:2.0:1783350172.738684:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22644:x1869977659599616:12345-0@lo:101:mount.lustre.0 Request processed in 163us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350172.740014:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783350172.740085:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659599616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350172.740105:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e3ac4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3acb expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.740115:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e3ac4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3acb expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350172.740210:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659599744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350172.740251:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350172.740282:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350172.743187:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659599744 00000100:00100000:3.0:1783350172.743202:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659599744 00000100:00100000:3.0:1783350172.743260:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783350172.743269:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22644:x1869977659599744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350172.743442:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22644:x1869977659599744:12345-0@lo:501:mount.lustre.0 Request processed in 174us (3190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350172.743450:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783350172.743540:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659599744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350172.743615:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659599872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350172.743658:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350172.743703:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350172.743743:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659599872 00000100:00100000:3.0:1783350172.743747:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659599872 00000100:00100000:3.0:1783350172.743781:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783350172.743788:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22644:x1869977659599872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783350172.743868:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22644:x1869977659599872:12345-0@lo:503:mount.lustre.0 Request processed in 80us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350172.743875:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783350172.743915:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659599872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350172.744132:0:22697:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22697:1869977659600000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350172.744178:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350172.744196:0:22697:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1783350172.745348:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659600000 00000100:00100000:2.0:1783350172.745357:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659600000 00000100:00100000:2.0:1783350172.745395:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783350172.745403:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22697:x1869977659600000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350172.745546:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22697:x1869977659600000:12345-0@lo:502:llog_process_th.0 Request processed in 143us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350172.745553:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783350172.745671:0:22697:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22697:1869977659600000:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783350172.745791:0:22697:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783350172.745805:0:22697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ea36d144d40) 00000020:00000080:2.0:1783350172.745821:0:22697:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1783350172.746078:0:22697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea37464f800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783350172.746082:0:22697:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea37464f800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783350172.746085:0:22697:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea37464f800 4 00010000:00080000:2.0:1783350172.746110:0:22697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea36d91d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1783350172.752569:0:22697:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1783350172.755348:0:22697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783350172.755393:0:22697:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783350172.755406:0:22697:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd05e6ae1590e3ad9 00000100:00080000:2.0:1783350172.755417:0:22697:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783350172.755423:0:22697:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ea36d91d000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350172.755456:0:22697:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37b5d7800 x1869977659600128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783350172.757578:0:22697:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783350172.757675:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659600128:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783350172.757749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350172.757819:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659600128 00000100:00100000:0.0:1783350172.757827:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659600128 00000100:00100000:0.0:1783350172.757860:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783350172.757867:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869977659600128:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783350172.757934:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869977659600128:12345-0@lo:38:llog_process_th.0 Request processed in 64us (182us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783350172.757942:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783350172.757977:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783350172.757984:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d91d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350172.757988:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783350172.757992:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659600128:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783350172.759647:0:22697:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22697:1869977659600256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350172.759718:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350172.759750:0:22697:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc600 going to sleep for 11 seconds 00000100:00100000:3.0:1783350172.760786:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659600256 00000100:00100000:3.0:1783350172.760795:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659600256 00000100:00100000:3.0:1783350172.760844:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783350172.760853:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22697:x1869977659600256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783350172.760985:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22697:x1869977659600256:12345-0@lo:502:llog_process_th.0 Request processed in 133us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350172.760993:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783350172.761032:0:22697:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22697:1869977659600256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350172.761081:0:22697:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22697:1869977659600384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350172.768086:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350172.768126:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659600384 00000100:00100000:2.0:1783350172.768147:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659600384 00000100:00100000:2.0:1783350172.768188:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783350172.768196:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22697:x1869977659600384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350172.768303:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22697:x1869977659600384:12345-0@lo:502:llog_process_th.0 Request processed in 107us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350172.768310:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783350172.768357:0:22697:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1783350172.768378:0:22697:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22697:1869977659600384:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783350172.768410:0:22697:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783350172.768482:0:22644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783350172.768507:0:22644:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783350172.768523:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e3ac4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3acb expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.768534:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e3ac4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3acb expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783350172.768589:0:22644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783350172.768592:0:22644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783350172.768593:0:22644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350172.768594:0:22644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350172.768596:0:22644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350172.768609:0:22644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350172.768610:0:22644:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783350172.768612:0:22644:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783350172.768613:0:22644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350172.768615:0:22644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783350172.768618:0:22644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783350172.768620:0:22644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783350172.768622:0:22644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783350172.768623:0:22644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350172.768624:0:22644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350172.768625:0:22644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350172.768627:0:22644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350172.768628:0:22644:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783350172.768629:0:22644:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783350172.768630:0:22644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350172.768631:0:22644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783350172.768649:0:22644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783350172.768665:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659600512:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783350172.768708:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350172.768722:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350172.770596:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659600512 00000100:00100000:2.0:1783350172.770664:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659600512 00000100:00100000:2.0:1783350172.770773:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783350172.770782:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22644:x1869977659600512:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783350172.770814:0:22658:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783350172.770829:0:22658:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783350172.774613:0:22658:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783350172.774630:0:22658:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783350172.774732:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783350172.774738:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783350172.774767:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.774786:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3aaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3aa8 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.774795:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.774830:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3aaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3aa8 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.774845:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3aaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3aa8 expref: 12 pid: 22657 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350172.774862:0:22680:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659600640:0@lo:104: 00000100:00100000:2.0:1783350172.774935:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350172.774978:0:22680:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350172.775045:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659600640 00000100:00100000:1.0:1783350172.775053:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659600640 00000100:00100000:1.0:1783350172.775101:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783350172.775110:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659600640:12345-0@lo:104: 00010000:00010000:1.0:1783350172.775130:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350172.775213:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783350172.775220:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659600640:12345-0@lo:104: Request processed in 111us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350172.775227:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1783350172.775286:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350172.775292:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.775312:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cdc00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783350172.775315:0:22654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.775323:0:22654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350172.775330:0:22654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350172.775347:0:22654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783350172.775376:0:22654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.775382:0:22654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783350172.775406:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.775413:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e3aa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3aaf expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350172.775427:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350172.775429:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350172.775431:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350172.775481:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659600768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783350172.775510:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350172.775666:0:22680:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659600640:0@lo:104: 00010000:00010000:3.0:1783350172.775684:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350172.775871:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659600768 00000100:00100000:0.0:1783350172.775876:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659600768 00010000:00010000:0.0:1783350172.775895:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3aaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3aa8 expref: 13 pid: 22657 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350172.775988:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783350172.775998:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+13:3647:x1869977659600768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350172.776010:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350172.776015:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3aaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3aa8 expref: 13 pid: 22657 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.776024:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3aaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3aa8 expref: 13 pid: 22657 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.776038:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3aaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3aa8 expref: 13 pid: 22657 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.776059:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.776066:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783350172.776079:0:22650:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001342081s 00010000:00010000:0.0:1783350172.776083:0:22650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.776090:0:22650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.776097:0:22650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.776103:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.776108:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350172.776112:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.776119:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.776652:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350172.776665:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350172.776722:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:3647:x1869977659600768:12345-0@lo:103:ldlm_bl.0 Request processed in 725us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350172.776729:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783350172.777177:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.777186:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350172.777197:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3ae0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350172.777616:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659600768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783350172.778550:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22644:x1869977659600512:12345-0@lo:253:mount.lustre.0 Request processed in 7765us (9837us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350172.778561:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783350172.778658:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22644:1869977659600512:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783350172.778671:0:22644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783350172.778674:0:22644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783350172.778675:0:22644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783350172.778677:0:22644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350172.778678:0:22644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350172.778679:0:22644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350172.778680:0:22644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350172.778681:0:22644:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783350172.778683:0:22644:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783350172.778684:0:22644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350172.778741:0:22644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783350172.778752:0:22644:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1783350172.791391:0:22644:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1783350172.791944:0:22644:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783350172.792019:0:22704:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:1.0:1783350172.792024:0:22704:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:1.0:1783350172.793438:0:22705:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783350172.793716:0:22644:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1783350172.794035:0:22706:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8ea36d73bb80 x1869977659600896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350172.794045:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00000040:00080000:1.0:1783350172.794680:0:22705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1783350172.794702:0:22644:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783350172.794738:0:22644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783350172.795797:0:22644:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783350172.795808:0:22644:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783350172.795845:0:22644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783350172.797843:0:22644:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783350172.798703:0:22644:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783350172.798747:0:22644:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783350172.799678:0:22644:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1783350172.800416:0:22644:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1783350172.802128:0:22644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:1.0:1783350172.803477:0:22705:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000001:00080000:3.0:1783350172.803546:0:22644:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00080000:1.0:1783350172.803550:0:22705:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:3.0:1783350172.803566:0:22644:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9d984195f988 00100000:10000000:3.0:1783350172.803572:0:22644:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1783350172.804758:0:22644:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783350172.804773:0:22644:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783350172.804790:0:22644:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1783350172.804814:0:22644:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783350172.805609:0:22644:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783350172.805807:0:22644:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783350173.449719:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783350173.771446:0:22698:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783350173.771465:0:22698:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783350173.772345:0:22698:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783350173.772354:0:22698:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783350173.828447:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 10000000:01000000:0.0:1783350174.406858:0:22662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783350174.406868:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea37464f800 from 11 10000000:01000000:0.0:1783350174.406874:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783350174.406925:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350174.406937:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350174.406949:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350174.406976:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659601024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783350174.407050:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350174.407088:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1783350174.407985:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659601024 00000100:00100000:2.0:1783350174.407996:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659601024 00000100:00100000:2.0:1783350174.408052:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783350174.408060:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+11:22662:x1869977659601024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350174.408074:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350174.408092:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3aee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350174.408130:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3ae7 expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350174.408159:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3ae7 expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350174.408169:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e200, rc 0) 00000100:00100000:2.0:1783350174.408227:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22662:x1869977659601024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350174.408312:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783350174.408363:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659601024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350174.408378:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350174.408387:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350174.408446:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659601152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783350174.408495:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350174.408513:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350174.408527:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659601152 00000100:00100000:2.0:1783350174.408530:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659601152 00000100:00100000:2.0:1783350174.408556:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783350174.408562:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22662:x1869977659601152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783350174.408577:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783350174.408594:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783350174.408596:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1783350174.408662:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:22662:x1869977659601152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350174.408669:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783350174.408947:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659601152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783350174.408985:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783350174.408992:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350174.409001:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350174.480224:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783350174.790929:0:22698:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783350174.790939:0:22698:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783350174.791088:0:22698:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1783350174.791119:0:22698:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783350174.792340:0:22698:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1783350174.852422:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00010000:00010000:0.0:1783350175.492357:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350175.876497:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00010000:00010000:3.0:1783350176.519907:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350176.900869:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00000001:02000400:3.0:1783350177.191457:0:22949:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783350177.546089:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350177.925212:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00000020:00000004:3.0:1783350178.153616:0:23001:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783350178.153784:0:23001:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1783350178.183591:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783350178.183598:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783350178.183601:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea37f567000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350178.183609:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 613 00000100:00080000:1.0:1783350178.183615:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783350178.183621:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ea37f567000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350178.183644:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d738380 x1869977659601408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350178.183676:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350178.183680:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350178.183683:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350178.183685:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350178.183688:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783350178.183691:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783350178.183692:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea36d91d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350178.183697:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ea36d91d000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350178.183712:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d738700 x1869977659601536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350178.183860:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783350178.183874:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659601280:0@lo:400:kworker.0 00000100:00100000:3.0:1783350178.183939:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350178.184056:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659601408:0@lo:38:kworker.0 00000100:00100000:2.0:1783350178.184100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350178.184127:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659601536:0@lo:38:kworker.0 00000100:00100000:2.0:1783350178.184174:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350178.184276:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659601408 00000100:00100000:3.0:1783350178.184284:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659601408 00000100:00100000:3.0:1783350178.184311:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783350178.184319:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659601408:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783350178.184336:0:22670:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783350178.184376:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659601408:12345-0@lo:38:kworker.0 Request processed in 57us (276us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783350178.184384:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783350178.184437:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659601536 00000100:00100000:3.0:1783350178.184441:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659601536 00000100:00100000:3.0:1783350178.184464:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783350178.184468:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659601536:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783350178.184483:0:22666:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 618 last 0 00000020:00000080:3.0:1783350178.184519:0:22666:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd05e6ae1590e3af5 00000004:00100000:3.0:1783350178.184533:0:22666:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783350178.184654:0:22666:0:(import.c:65:import_set_state_nolock()) ffff8ea2434db800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783350178.184693:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869977659601536:12345-0@lo:38:kworker.0 Request processed in 224us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350178.184700:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783350178.184884:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea37f567000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350178.184890:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783350178.184893:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659601408:0@lo:38:kworker.0 00010000:00080000:2.0:1783350178.184906:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ea36d738700 x1869977659601536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783350178.184919:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1783350178.184926:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783350178.184930:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783350178.184932:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d91d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783350178.184937:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659601536:0@lo:38:kworker.0 00000100:00100000:1.0:1783350178.185282:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659601280 00000100:00100000:1.0:1783350178.185287:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659601280 00000100:00100000:1.0:1783350178.185327:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783350178.185334:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:3649:x1869977659601280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350178.185381:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:3649:x1869977659601280:12345-0@lo:400:kworker.0 Request processed in 48us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350178.185388:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783350178.186342:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659601280:0@lo:400:kworker.0 00010000:00010000:3.0:1783350178.564346:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350178.950054:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00000020:00000004:2.0:1783350179.091878:0:23051:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783350179.092111:0:23051:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783350179.596158:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350179.975291:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00010000:00010000:3.0:1783350180.612340:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350180.996340:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00010000:00010000:0.0:1783350181.639677:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350182.020266:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00000100:00100000:3.0:1783350182.277038:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350172/real 1783350172] req@ffff8ea37f538380 x1869977659598464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350182 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350182.277070:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea37f538380 x1869977659598464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350182 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350182.277081:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350172/real 1783350172] req@ffff8ea36d73aa00 x1869977659598336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350182 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350182.277094:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea36d73aa00 x1869977659598336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350182 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783350182.277112:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24271b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350182.277163:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783350182.277167:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659598464:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783350182.277173:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea357ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350182.277179:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783350182.277181:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659598336:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783350182.277291:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783350182.277305:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783350182.277308:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea37f567000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783350182.277313:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 618 00000100:00080000:0.0:1783350182.277318:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783350182.277324:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ea37f567000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350182.277347:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f53b480 x1869977659601792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783350182.277362:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783350182.277364:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783350182.277366:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea357ed8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783350182.277369:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 613 00000100:00080000:0.0:1783350182.277383:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783350182.277387:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ea357ed8000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350182.277408:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f539880 x1869977659601920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783350182.277417:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783350182.277420:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783350182.277421:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea24271b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783350182.277424:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 613 00000100:00080000:0.0:1783350182.277427:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783350182.277430:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ea24271b000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350182.277439:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f539c00 x1869977659602048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783350182.277479:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783350182.277492:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3648:1869977659601664:0@lo:400:kworker.0 00000100:00100000:0.0:1783350182.277560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350182.277606:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659602176:0@lo:400:kworker.0 00000100:00100000:0.0:1783350182.278514:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350182.278567:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659601664 00000100:00100000:0.0:1783350182.278576:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659601664 00000100:00100000:0.0:1783350182.278763:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783350182.278774:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:3648:x1869977659601664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350182.278839:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:3648:x1869977659601664:12345-0@lo:400:kworker.0 Request processed in 67us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350182.278846:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783350182.278890:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659602176 00000100:00100000:0.0:1783350182.278894:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659602176 00000100:00100000:0.0:1783350182.278920:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783350182.278926:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659602176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350182.278959:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659602176:12345-0@lo:400:kworker.0 Request processed in 34us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350182.278965:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783350182.279001:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ea37f539f80 x1869977659602176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350182.279014:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659602176:0@lo:400:kworker.0 00000100:00100000:0.0:1783350182.279038:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659601792:0@lo:38:kworker.0 00000100:00100000:0.0:1783350182.279063:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350182.279079:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659601920:0@lo:8:kworker.0 00000400:00000100:0.0:1783350182.279098:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659601920 offset 0 length 520: 4 00000100:00100000:0.0:1783350182.279115:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659602048:0@lo:8:kworker.0 00000400:00000100:0.0:1783350182.279172:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659602048 offset 0 length 520: 4 00000100:00100000:0.0:1783350182.279198:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659601792 00000100:00100000:0.0:1783350182.279202:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659601792 00000100:00100000:0.0:1783350182.279221:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783350182.279226:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659601792:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783350182.279242:0:22670:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783350182.279274:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659601792:12345-0@lo:38:kworker.0 Request processed in 47us (210us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783350182.279280:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783350182.279306:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea37f567000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350182.279311:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783350182.279315:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659601792:0@lo:38:kworker.0 00000100:00100000:3.0:1783350182.279664:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3648:1869977659601664:0@lo:400:kworker.0 00010000:00010000:0.0:1783350182.665918:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350183.048193:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00010000:00010000:0.0:1783350183.684367:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783350184.006783:0:22698:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783350184.069792:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00010000:00010000:2.0:1783350184.709249:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350185.092228:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00010000:00010000:0.0:1783350185.733824:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783350185.841052:0:23396:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783350185.841056:0:23396:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1783350185.841057:0:23396:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783350185.841218:0:23396:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ea36d918800 00000020:01000004:0.0:1783350185.841235:0:23396:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1783350185.841247:0:23396:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783350185.841261:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8ea349e319c0) 00000020:00000080:0.0:1783350185.841278:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783350185.922428:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783350185.922746:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1783350185.942048:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783350185.945238:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1783350185.945760:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783350185.951380:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783350185.951990:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783350185.952517:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783350185.953313:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783350185.955986:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783350185.956467:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783350185.956708:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1783350185.957048:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1783350185.957427:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783350185.961232:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.961520:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.961966:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.962292:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.962576:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.962930:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.963379:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.963572:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.963915:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.964360:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.967938:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.968716:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.969428:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.969727:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.970171:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.970443:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.970656:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.971008:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.972402:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.973206:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.974946:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.975898:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.976305:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1783350185.976559:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.976824:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783350185.977198:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1783350185.977615:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783350185.977992:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1783350185.978337:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783350185.978658:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783350185.978993:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783350185.979378:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00080000:01000000:0.0:1783350185.981873:0:23396:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783350185.982104:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1783350185.982117:0:23396:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783350185.982129:0:23396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e3b03 00000020:01000004:0.0:1783350185.982165:0:23396:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1783350185.982187:0:23396:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783350185.982191:0:23396:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783350185.982197:0:23396:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1783350185.982225:0:23396:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1783350185.982228:0:23396:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1783350185.996058:0:23396:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783350185.996464:0:23396:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.150@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1783350185.996469:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783350185.996470:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783350185.996472:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783350185.996473:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783350185.996474:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783350185.996476:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783350185.996477:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783350185.996479:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783350185.996480:0:23396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783350185.996483:0:23396:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1783350185.996486:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783350185.996487:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783350185.996488:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783350185.996489:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783350185.996490:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783350185.996492:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783350185.996492:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783350185.996493:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783350185.996495:0:23396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783350185.996521:0:23396:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783350185.996542:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602304:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783350185.996687:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350185.996772:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea375e26a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783350185.996933:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659602304 00000100:00100000:1.0:1783350185.996941:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659602304 00000100:00100000:1.0:1783350185.997019:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783350185.997028:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:23396:x1869977659602304:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783350185.997058:0:22658:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783350185.997068:0:22658:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1783350185.997075:0:22658:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1783350185.997536:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:23396:x1869977659602304:12345-0@lo:253:mount.lustre.0 Request processed in 508us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350185.997545:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783350185.997639:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783350185.997648:0:23396:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783350185.997651:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783350185.997652:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783350185.997653:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350185.997654:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350185.997655:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350185.997656:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350185.997657:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783350185.997658:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350185.997660:0:23396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783350185.997676:0:23396:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea36d918800 from lustre-MDT0001 10000000:01000000:2.0:1783350185.997704:0:23396:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1783350185.997707:0:23396:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783350185.997713:0:23396:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ea370dfb380 local copy 00010000:00010000:2.0:1783350185.997723:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350185.997805:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350185.997852:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350185.998422:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348d6bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783350185.998515:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659602432 00000100:00100000:0.0:1783350185.998521:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659602432 00000100:00100000:1.0:1783350185.998630:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783350185.998638:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:23396:x1869977659602432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350185.998720:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:23396:x1869977659602432:12345-0@lo:501:mount.lustre.0 Request processed in 82us (867us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783350185.998727:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783350185.998996:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602432:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783350185.999010:0:23396:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783350185.999036:0:23396:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783350185.999044:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350185.999053:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350185.999078:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea36d918800 10000000:01000000:0.0:1783350185.999093:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783350185.999098:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ea370dfb380 10000000:01000000:0.0:1783350185.999101:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1783350185.999104:0:23396:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8ea370dfb380 from 1 10000000:01000000:0.0:1783350185.999107:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783350185.999132:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0600/0xd05e6ae1590e3b0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350185.999161:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0600/0xd05e6ae1590e3b0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350185.999169:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0600/0xd05e6ae1590e3b0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350185.999186:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350185.999217:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350185.999256:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dcf5240 going to sleep for 11 seconds 00000100:00100000:1.0:1783350185.999528:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659602560 00000100:00100000:1.0:1783350185.999534:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659602560 00000100:00100000:1.0:1783350185.999557:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783350185.999563:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+12:23396:x1869977659602560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350185.999573:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350185.999648:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea374602c00/0xd05e6ae1590e3b11 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3b0a expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350185.999670:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea374602c00/0xd05e6ae1590e3b11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3b0a expref: 13 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350185.999682:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea374602c00/0xd05e6ae1590e3b11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3b0a expref: 13 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350185.999690:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374602c00, rc 0) 00000100:00100000:1.0:1783350185.999729:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+13:23396:x1869977659602560:12345-0@lo:101:mount.lustre.0 Request processed in 165us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350185.999735:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783350186.000808:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350186.000901:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0600/0xd05e6ae1590e3b0a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3b11 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.000912:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0600/0xd05e6ae1590e3b0a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3b11 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350186.000931:0:23396:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783350186.000950:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0600/0xd05e6ae1590e3b0a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3b11 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.000958:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0600/0xd05e6ae1590e3b0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3b11 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350186.000967:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ea36d918800 10000000:01000000:0.0:1783350186.000973:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783350186.000977:0:23396:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8ea36d918800 from 1 10000000:01000000:0.0:1783350186.000980:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783350186.001003:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1a00/0xd05e6ae1590e3b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.001010:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1a00/0xd05e6ae1590e3b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.001018:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1a00/0xd05e6ae1590e3b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350186.001036:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602688:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350186.001076:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.001552:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dcf5240 going to sleep for 11 seconds 00000100:00100000:1.0:1783350186.002057:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659602688 00000100:00100000:1.0:1783350186.002066:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659602688 00000100:00100000:1.0:1783350186.002112:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783350186.002121:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+13:23396:x1869977659602688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350186.002133:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350186.002174:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea374602a00/0xd05e6ae1590e3b1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3b18 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350186.002196:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea374602a00/0xd05e6ae1590e3b1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3b18 expref: 14 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350186.002207:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea374602a00/0xd05e6ae1590e3b1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3b18 expref: 14 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350186.002215:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374602a00, rc 0) 00000100:00100000:1.0:1783350186.002260:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+14:23396:x1869977659602688:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350186.002267:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783350186.002763:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350186.002780:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1a00/0xd05e6ae1590e3b18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3b1f expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.002787:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1a00/0xd05e6ae1590e3b18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3b1f expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350186.002803:0:23396:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783350186.002817:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1a00/0xd05e6ae1590e3b18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3b1f expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.002992:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1a00/0xd05e6ae1590e3b18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3b1f expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350186.003002:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1783350186.003008:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783350186.003014:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ea36d918800 10000000:01000000:0.0:1783350186.003017:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783350186.003020:0:23396:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1783350186.003023:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783350186.003047:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0800/0xd05e6ae1590e3b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.003055:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0800/0xd05e6ae1590e3b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.003063:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0800/0xd05e6ae1590e3b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350186.003096:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350186.003132:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.003216:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dcf5240 going to sleep for 11 seconds 00000100:00100000:1.0:1783350186.006602:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659602816 00000100:00100000:1.0:1783350186.006616:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659602816 00000100:00100000:1.0:1783350186.006668:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783350186.006677:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+14:23396:x1869977659602816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350186.006692:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350186.006709:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea374603e00/0xd05e6ae1590e3b2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3b26 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350186.006736:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea374603e00/0xd05e6ae1590e3b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3b26 expref: 15 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350186.006747:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea374603e00/0xd05e6ae1590e3b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3b26 expref: 15 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350186.006782:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374603e00, rc 0) 00000100:00100000:1.0:1783350186.007072:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+15:23396:x1869977659602816:12345-0@lo:101:mount.lustre.0 Request processed in 395us (3939us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350186.007080:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783350186.007197:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350186.007215:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0800/0xd05e6ae1590e3b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3b2d expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.007224:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0800/0xd05e6ae1590e3b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3b2d expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783350186.009291:0:23396:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1783350186.010374:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783350186.027634:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1783350186.027688:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1783350186.027704:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1783350186.027717:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1783350186.027729:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1783350186.027741:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1783350186.027754:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1783350186.027781:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1783350186.027798:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1783350186.027813:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1783350186.028742:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1783350186.028791:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1783350186.028807:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1783350186.028819:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1783350186.028967:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1783350186.028987:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1783350186.029002:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1783350186.029018:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1783350186.029032:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1783350186.029049:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1783350186.029064:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1783350186.029078:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1783350186.029092:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1783350186.029108:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1783350186.029123:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1783350186.029161:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1783350186.029192:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1783350186.029208:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1783350186.029221:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1783350186.029237:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1783350186.029263:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1783350186.029278:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1783350186.029292:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1783350186.029308:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1783350186.029320:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1783350186.029331:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1783350186.029343:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1783350186.029355:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1783350186.029381:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1783350186.029398:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1783350186.029412:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1783350186.029424:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1783350186.029436:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1783350186.029446:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1783350186.029474:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1783350186.029480:0:23396:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1783350186.031819:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350186.035638:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350186.035692:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3485a3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783350186.036512:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659602944 00000100:00100000:3.0:1783350186.036538:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659602944 00000100:00100000:3.0:1783350186.036604:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783350186.036613:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+15:23396:x1869977659602944:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350186.036792:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+15:23396:x1869977659602944:12345-0@lo:501:mount.lustre.0 Request processed in 180us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350186.036800:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783350186.037038:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659602944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350186.037089:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659603072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783350186.037166:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.037189:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350186.037618:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659603072 00000100:00100000:2.0:1783350186.037623:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659603072 00000100:00100000:2.0:1783350186.037666:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783350186.037673:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+15:23396:x1869977659603072:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350186.039295:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+15:23396:x1869977659603072:12345-0@lo:503:mount.lustre.0 Request processed in 1615us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350186.039307:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783350186.039479:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659603072:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783350186.040090:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783350186.040409:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659603200:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350186.040466:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.040503:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8180 going to sleep for 11 seconds 00000100:00100000:3.0:1783350186.040626:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659603200 00000100:00100000:3.0:1783350186.040633:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659603200 00000100:00100000:3.0:1783350186.040678:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783350186.040686:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+15:23396:x1869977659603200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783350186.041968:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+15:23396:x1869977659603200:12345-0@lo:502:mount.lustre.0 Request processed in 1277us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350186.041978:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783350186.042080:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659603200:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350186.042528:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1783350186.042560:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1783350186.042649:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1783350186.042668:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1783350186.042679:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1783350186.042690:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1783350186.042703:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1783350186.042714:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1783350186.042727:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1783350186.042738:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1783350186.042749:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1783350186.042760:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1783350186.042943:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1783350186.042959:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1783350186.042970:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1783350186.042981:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1783350186.042991:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1783350186.043002:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1783350186.043012:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1783350186.043024:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1783350186.043037:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1783350186.043048:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1783350186.043058:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1783350186.043070:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1783350186.043081:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1783350186.043093:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1783350186.043104:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1783350186.043115:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1783350186.043125:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1783350186.043165:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1783350186.043183:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1783350186.043196:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1783350186.043210:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1783350186.043222:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1783350186.043234:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1783350186.044554:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1783350186.044573:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1783350186.044651:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1783350186.044668:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1783350186.044679:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1783350186.044689:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1783350186.044702:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1783350186.044715:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1783350186.044728:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1783350186.044787:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659603328:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350186.045059:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.045372:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350186.049933:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659603328 00000100:00100000:2.0:1783350186.049964:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659603328 00000100:00100000:2.0:1783350186.050018:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783350186.050028:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+15:23396:x1869977659603328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350186.050219:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+15:23396:x1869977659603328:12345-0@lo:502:mount.lustre.0 Request processed in 191us (5160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350186.050227:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783350186.050422:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659603328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350186.051041:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1783350186.051056:0:23396:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1783350186.052166:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350186.052178:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350186.052180:0:23400:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783350186.052186:0:23400:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1783350186.052189:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783350186.052202:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8ea349e30000) 00000020:00000080:0.0:1783350186.052221:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1783350186.052226:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783350186.052415:0:23400:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783350186.052423:0:23400:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e3b3b 00000020:00000080:0.0:1783350186.052673:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1783350186.052677:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350186.052681:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350186.052682:0:23400:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783350186.052684:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350186.052687:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350186.052695:0:23400:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1783350186.052700:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783350186.052708:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8ea349e34d40) 00000020:00000080:0.0:1783350186.052719:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1783350186.052722:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783350186.052724:0:23400:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1783350186.052727:0:23400:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1783350186.052732:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783350186.052921:0:23400:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea36d918800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1783350186.052937:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8ea349e33380) 00000020:00000080:0.0:1783350186.052945:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1783350186.053003:0:23400:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783350186.053009:0:23400:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e3b50 00000020:00000080:0.0:1783350186.053097:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1783350186.053103:0:23400:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783350186.053107:0:23400:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd05e6ae1590e3b57 00080000:01000000:0.0:1783350186.053112:0:23400:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783350186.053115:0:23400:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e3b5e 00000100:00100000:0.0:1783350186.117722:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00010000:00010000:3.0:1783350186.128501:0:23400:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1783350186.128934:0:23400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1783350186.129205:0:23400:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783350186.130557:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1783350186.130570:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350186.130576:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350186.130578:0:23400:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1783350186.130582:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783350186.130708:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350186.130710:0:23400:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1783350186.130714:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783350186.130720:0:23400:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:00000080:3.0:1783350186.130749:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783350186.130764:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8ea2424499c0) 00000020:00000080:3.0:1783350186.130784:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1783350186.130790:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783350186.130857:0:23400:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1783350186.130864:0:23400:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783350186.130871:0:23400:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e3b6c 00010000:00080000:3.0:1783350186.130900:0:23400:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea34618e800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1783350186.133299:0:23400:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1783350186.135091:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783350186.135105:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783350186.135170:0:23400:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783350186.135193:0:23400:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e3b73 00000100:00080000:0.0:1783350186.135205:0:23400:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783350186.135210:0:23400:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ea34618e800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350186.135244:0:23400:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f539500 x1869977659603456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783350186.135277:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659603456:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783350186.135346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.135409:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659603456 00000100:00100000:0.0:1783350186.135416:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659603456 00000100:00100000:0.0:1783350186.135450:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783350186.135456:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659603456:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783350186.135479:0:22670:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:0.0:1783350186.135509:0:22670:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e3b7a 00000004:00100000:0.0:1783350186.135524:0:22670:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1783350186.135530:0:22670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1783350186.135659:0:23400:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783350186.135685:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783350186.135690:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783350186.135692:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea37f567000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783350186.135697:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:0.0:1783350186.135700:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783350186.135704:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ea37f567000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350186.135733:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f539180 x1869977659603584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783350186.135747:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783350186.135751:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783350186.135753:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783350186.135756:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783350186.135793:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659603712:0@lo:400:kworker.0 00000100:00100000:0.0:1783350186.135797:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659603584:0@lo:38:kworker.0 00000100:00100000:0.0:1783350186.135823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350186.135825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.135846:0:22669:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1783350186.135852:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659603712 00000100:00100000:0.0:1783350186.135854:0:22669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1783350186.135929:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659603712 00000100:00100000:2.0:1783350186.135972:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783350186.135979:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659603712:12345-0@lo:400:kworker.0 00000020:01000000:1.0:1783350186.136017:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350186.136023:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1783350186.136025:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659603712:12345-0@lo:400:kworker.0 Request processed in 47us (199us total) trans 0 rc 0/0 00000020:00000080:1.0:1783350186.136025:0:23400:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1783350186.136029:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783350186.136032:0:23400:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000100:00100000:2.0:1783350186.136033:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:1.0:1783350186.136033:0:23400:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783350186.136034:0:23400:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783350186.136036:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783350186.136038:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.136040:0:23400:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783350186.136042:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350186.136046:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.136053:0:23400:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1783350186.136057:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00010000:00080000:2.0:1783350186.136065:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ea37f538e00 x1869977659603712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350186.136078:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659603712:0@lo:400:kworker.0 00000004:01000000:1.0:1783350186.136101:0:23400:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783350186.136119:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350186.136122:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.136124:0:23400:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1783350186.136126:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783350186.136128:0:23400:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1783350186.136129:0:23400:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783350186.136131:0:23400:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783350186.136133:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783350186.136234:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.136236:0:23400:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783350186.136240:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783350186.136243:0:23400:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1783350186.136246:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.136248:0:23400:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783350186.136251:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783350186.136254:0:23400:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:1.0:1783350186.136272:0:23400:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1783350186.136275:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783350186.136287:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8ea241dc99c0) 00000020:00000080:1.0:1783350186.136299:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1783350186.136304:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783350186.136359:0:23400:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1783350186.136375:0:23400:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783350186.136381:0:23400:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e3b88 00010000:00080000:1.0:1783350186.136407:0:23400:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea243527000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.150@tcp at head 00010000:00010000:1.0:1783350186.136675:0:23400:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1783350186.137849:0:23400:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783350186.138036:0:23400:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1783350186.147259:0:23400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783350186.148930:0:23400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00080000:2.0:1783350186.149374:0:22670:0:(import.c:65:import_set_state_nolock()) ffff8ea2437de800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783350186.149434:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659603584 00000100:00100000:3.0:1783350186.149441:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659603584 00000100:00100000:3.0:1783350186.149554:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783350186.149562:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869977659603584:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783350186.149632:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869977659603584:12345-0@lo:38:kworker.0 Request processed in 69us (13808us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783350186.149639:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1783350186.149775:0:23400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1783350186.149844:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783350186.149852:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea37f567000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783350186.149856:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783350186.149860:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659603584:0@lo:38:kworker.0 00000100:00100000:2.0:1783350186.151717:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1869977659603456:12345-0@lo:38:llog_process_th.0 Request processed in 16252us (16363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350186.151731:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783350186.151768:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783350186.151791:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1783350186.151800:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783350186.151806:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783350186.151810:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea34618e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783350186.151825:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659603456:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1783350186.152822:0:23406:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1783350186.152828:0:23406:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1783350186.152955:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783350186.152976:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659603840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350186.153041:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350186.153318:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659603840 00000100:00100000:3.0:1783350186.153327:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659603840 00000100:00100000:3.0:1783350186.153383:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783350186.153392:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1869977659603840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783350186.153426:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783350186.153473:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1869977659603840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350186.153479:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350186.153981:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659603840:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1783350186.154720:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783350186.154733:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783350186.154779:0:23400:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783350186.154800:0:23400:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e3b8f 00000100:00080000:3.0:1783350186.154810:0:23400:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783350186.154815:0:23400:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ea243527000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350186.154846:0:23400:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d775f80 x1869977659603968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783350186.154886:0:23400:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783350186.155329:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350186.155334:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350186.155336:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350186.155339:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783350186.155416:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659603968:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783350186.155466:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659603968 offset 0 length 520: 4 00000020:01000000:3.0:1783350186.155995:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350186.156001:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350186.156003:0:23400:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783350186.156007:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783350186.156010:0:23400:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1783350186.156011:0:23400:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783350186.156013:0:23400:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783350186.156014:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783350186.156017:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350186.156018:0:23400:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783350186.156021:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783350186.156026:0:23400:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783350186.156030:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350186.156031:0:23400:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783350186.156034:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783350186.156038:0:23400:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:3.0:1783350186.156060:0:23400:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783350186.156063:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783350186.156088:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8ea24244b380) 00000020:00000080:3.0:1783350186.156106:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1783350186.156111:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783350186.156467:0:23400:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783350186.156474:0:23400:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783350186.156480:0:23400:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e3b9d 00010000:00080000:3.0:1783350186.156506:0:23400:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea370da1800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1783350186.158064:0:23400:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1783350186.158167:0:23400:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783350186.158182:0:23400:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1783350186.165500:0:23400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783350186.166117:0:23400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1783350186.166324:0:23400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1783350186.169172:0:23408:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1783350186.169179:0:23408:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783350186.170028:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783350186.170039:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783350186.170072:0:23400:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783350186.170090:0:23400:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e3ba4 00000100:00080000:2.0:1783350186.170100:0:23400:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783350186.170105:0:23400:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea370da1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350186.170156:0:23400:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37b5d4a80 x1869977659604096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783350186.170181:0:23400:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783350186.170238:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350186.170241:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350186.170244:0:23400:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783350186.170247:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350186.170250:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350186.170252:0:23400:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783350186.170254:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783350186.170256:0:23400:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783350186.170258:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350186.170260:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350186.170261:0:23400:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783350186.170263:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350186.170265:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350186.170266:0:23400:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783350186.170269:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783350186.170289:0:23400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350186.170291:0:23400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350186.170292:0:23400:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783350186.170294:0:23400:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1783350186.170348:0:23396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1783350186.170384:0:23396:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783350186.170398:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0800/0xd05e6ae1590e3b26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3b2d expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350186.170409:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0800/0xd05e6ae1590e3b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3b2d expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350186.170417:0:23396:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea36d918800 from 1 10000000:01000000:2.0:1783350186.170420:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783350186.170451:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350186.170459:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350186.170470:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350186.170487:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604224:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783350186.170554:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350186.170581:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea375e26240 going to sleep for 11 seconds 00000100:00100000:0.0:1783350186.170675:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659604096:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783350186.170703:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659604096 offset 0 length 520: 4 00000100:00080000:1.0:1783350186.170903:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350186.170908:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350186.170910:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350186.170913:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783350186.171176:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659604224 00000100:00100000:3.0:1783350186.171183:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659604224 00000100:00100000:3.0:1783350186.171237:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783350186.171245:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+15:23396:x1869977659604224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350186.171260:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350186.171273:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3bb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3bab expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350186.171295:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bab expref: 16 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350186.171305:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bab expref: 16 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350186.171313:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc800, rc 0) 00000100:00100000:3.0:1783350186.171353:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+16:23396:x1869977659604224:12345-0@lo:101:mount.lustre.0 Request processed in 109us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350186.171359:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783350186.171754:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604224:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350186.171769:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350186.171778:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350186.172347:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604352:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783350186.172414:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350186.172452:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea375e26240 going to sleep for 11 seconds 00000100:00100000:1.0:1783350186.172603:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659604352 00000100:00100000:1.0:1783350186.172609:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659604352 00000100:00100000:1.0:1783350186.172652:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783350186.172661:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+16:23396:x1869977659604352:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783350186.172678:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783350186.172697:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783350186.172701:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1783350186.172793:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+16:23396:x1869977659604352:12345-0@lo:256:mount.lustre.0 Request processed in 133us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350186.172808:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783350186.172954:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604352:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783350186.173675:0:23396:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783350186.173704:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.173715:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350186.173723:0:23396:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea36d918800 from 1 10000000:01000000:0.0:1783350186.173726:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783350186.173755:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.173764:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.173786:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350186.173806:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350186.173851:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.173868:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea341254e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350186.174688:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659604480 00000100:00100000:1.0:1783350186.174697:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659604480 00000100:00100000:1.0:1783350186.174756:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783350186.174765:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+16:23396:x1869977659604480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350186.174779:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350186.174794:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea374602200/0xd05e6ae1590e3bc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3bb9 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350186.174818:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea374602200/0xd05e6ae1590e3bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bb9 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350186.174829:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea374602200/0xd05e6ae1590e3bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bb9 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350186.174838:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374602200, rc 0) 00000100:00100000:1.0:1783350186.174888:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:23396:x1869977659604480:12345-0@lo:101:mount.lustre.0 Request processed in 125us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350186.174894:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783350186.174994:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350186.175010:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.175019:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783350186.176952:0:23396:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1783350186.177254:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783350186.177429:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1783350186.177454:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1783350186.177467:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1783350186.177478:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1783350186.177490:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1783350186.177503:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1783350186.177529:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1783350186.177543:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1783350186.177558:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1783350186.177572:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1783350186.177585:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1783350186.179488:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1783350186.179496:0:23396:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1783350186.180242:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350186.180323:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.180376:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea34558b180 going to sleep for 11 seconds 00000100:00100000:1.0:1783350186.180452:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659604608 00000100:00100000:1.0:1783350186.180459:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659604608 00000100:00100000:1.0:1783350186.180509:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783350186.180528:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:23396:x1869977659604608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350186.181298:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:23396:x1869977659604608:12345-0@lo:501:mount.lustre.0 Request processed in 769us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350186.181307:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783350186.181411:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350186.181452:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783350186.181497:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.181569:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea34558b180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350186.184964:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659604736 00000100:00100000:2.0:1783350186.189808:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659604736 00000100:00100000:2.0:1783350186.189882:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783350186.189892:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:23396:x1869977659604736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350186.190068:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:23396:x1869977659604736:12345-0@lo:503:mount.lustre.0 Request processed in 176us (8570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350186.190075:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783350186.192581:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604736:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783350186.193064:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783350186.193196:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350186.193261:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350186.193301:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508cec00 going to sleep for 11 seconds 00000100:00100000:0.0:1783350186.193670:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659604864 00000100:00100000:0.0:1783350186.193678:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659604864 00000100:00100000:0.0:1783350186.193728:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783350186.193737:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:23396:x1869977659604864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350186.193848:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:23396:x1869977659604864:12345-0@lo:502:mount.lustre.0 Request processed in 111us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.193855:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783350186.193977:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783350186.194763:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1783350186.194799:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1783350186.194818:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1783350186.194830:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1783350186.194844:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1783350186.194857:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1783350186.194873:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1783350186.194885:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1783350186.194898:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1783350186.194911:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1783350186.194925:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1783350186.194958:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350186.195015:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350186.195042:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508cec00 going to sleep for 11 seconds 00000100:00100000:0.0:1783350186.195112:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659604992 00000100:00100000:0.0:1783350186.195118:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659604992 00000100:00100000:0.0:1783350186.195184:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783350186.195192:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:23396:x1869977659604992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350186.195282:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:23396:x1869977659604992:12345-0@lo:502:mount.lustre.0 Request processed in 90us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.195288:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783350186.196268:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659604992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783350186.196340:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1783350186.196353:0:23396:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1783350186.213307:0:23410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350186.213320:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.213322:0:23410:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783350186.213329:0:23410:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea36d918800 00000020:00000080:1.0:1783350186.213332:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350186.213339:0:23410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350186.213357:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.213358:0:23410:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783350186.213372:0:23410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350186.213376:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.213377:0:23410:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783350186.213381:0:23410:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea36d918800 00000020:00000080:1.0:1783350186.213383:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350186.213448:0:23410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350186.213451:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.213452:0:23410:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783350186.213455:0:23410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350186.213458:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.213459:0:23410:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783350186.213462:0:23410:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea36d918800 00000020:00000080:1.0:1783350186.213465:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350186.213482:0:23410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350186.213486:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.213487:0:23410:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783350186.213489:0:23410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350186.213491:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.213493:0:23410:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783350186.213496:0:23410:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea36d918800 00000020:00000080:1.0:1783350186.213497:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350186.213886:0:23410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350186.213891:0:23410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350186.213893:0:23410:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783350186.213896:0:23410:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1783350186.214384:0:23396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783350186.214415:0:23396:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783350186.214438:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.214451:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350186.214532:0:23396:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783350186.214534:0:23396:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea36d918800 10000000:01000000:0.0:1783350186.214538:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea36d918800 10000000:01000000:0.0:1783350186.214542:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783350186.214549:0:23396:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea36d918800 from 1 10000000:01000000:0.0:1783350186.214551:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783350186.214789:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0200/0xd05e6ae1590e3bc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.214797:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0200/0xd05e6ae1590e3bc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.214809:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0200/0xd05e6ae1590e3bc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350186.214834:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350186.214898:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.214939:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348d6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350186.214996:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659605120 00000100:00100000:2.0:1783350186.215004:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659605120 00000100:00100000:2.0:1783350186.215051:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783350186.215059:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:23396:x1869977659605120:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350186.215072:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350186.215085:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8f200/0xd05e6ae1590e3bce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3bc7 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350186.215106:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8f200/0xd05e6ae1590e3bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bc7 expref: 18 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350186.215117:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8f200/0xd05e6ae1590e3bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bc7 expref: 18 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350186.215125:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f200, rc 0) 00000100:00100000:2.0:1783350186.215187:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659605120:12345-0@lo:101:mount.lustre.0 Request processed in 128us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350186.215194:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783350186.216743:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350186.216767:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0200/0xd05e6ae1590e3bc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bce expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.216778:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0200/0xd05e6ae1590e3bc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3bce expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783350186.218896:0:23396:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1783350186.219246:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783350186.222030:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1783350186.222088:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1783350186.222105:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1783350186.222120:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1783350186.222151:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1783350186.222167:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1783350186.222186:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1783350186.222201:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1783350186.222217:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1783350186.222230:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1783350186.222244:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1783350186.222257:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1783350186.222271:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1783350186.222284:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1783350186.222296:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1783350186.222307:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1783350186.222336:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1783350186.222352:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1783350186.222376:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1783350186.222391:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1783350186.222404:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1783350186.222418:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1783350186.222432:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1783350186.222446:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1783350186.222459:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1783350186.222470:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1783350186.222482:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1783350186.222493:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1783350186.222505:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1783350186.222516:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1783350186.222528:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1783350186.222539:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1783350186.222566:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1783350186.225145:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1783350186.225230:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1783350186.225248:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1783350186.225264:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1783350186.225279:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1783350186.225295:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1783350186.225309:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1783350186.225324:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1783350186.225339:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1783350186.225355:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1783350186.225387:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1783350186.225401:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1783350186.225412:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1783350186.225424:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1783350186.225436:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1783350186.225635:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1783350186.225654:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1783350186.225670:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1783350186.225676:0:23396:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1783350186.225789:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350186.225852:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.225910:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659605248 00000100:00100000:0.0:1783350186.225916:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659605248 00000100:00100000:0.0:1783350186.225961:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783350186.225969:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659605248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350186.226078:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659605248:12345-0@lo:501:mount.lustre.0 Request processed in 108us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.226085:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783350186.226127:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09e000 going to sleep for 11 seconds 00000100:00100000:0.0:1783350186.226170:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350186.226208:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783350186.226244:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.226266:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659605376 00000100:00100000:0.0:1783350186.226270:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659605376 00000100:00100000:0.0:1783350186.226291:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783350186.226298:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659605376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783350186.234773:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659605376:12345-0@lo:503:mount.lustre.0 Request processed in 8465us (8517us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.234787:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783350186.234876:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09e000 going to sleep for 11 seconds 00000100:00100000:0.0:1783350186.234901:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605376:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783350186.235356:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783350186.235446:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350186.235498:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.235675:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350186.236655:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659605504 00000100:00100000:1.0:1783350186.236665:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659605504 00000100:00100000:1.0:1783350186.236719:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783350186.236728:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659605504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350186.236862:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659605504:12345-0@lo:502:mount.lustre.0 Request processed in 135us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350186.236876:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783350186.240268:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350186.240511:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1783350186.240556:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1783350186.240571:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1783350186.240611:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1783350186.240627:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1783350186.240640:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1783350186.240652:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1783350186.240666:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1783350186.240679:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1783350186.240693:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1783350186.240733:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1783350186.240750:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1783350186.240765:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1783350186.240780:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1783350186.240795:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1783350186.240810:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1783350186.240825:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1783350186.240840:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1783350186.240854:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1783350186.240869:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1783350186.240882:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1783350186.240893:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1783350186.240905:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1783350186.240917:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1783350186.240931:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1783350186.240944:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1783350186.240970:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1783350186.240985:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1783350186.240998:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1783350186.241012:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1783350186.241027:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1783350186.241043:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1783350186.241056:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1783350186.241070:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1783350186.241085:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1783350186.241100:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1783350186.241114:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1783350186.241129:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1783350186.241176:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1783350186.241191:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1783350186.241207:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1783350186.241220:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1783350186.241247:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1783350186.241269:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1783350186.241283:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1783350186.241296:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1783350186.241308:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1783350186.241321:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1783350186.241380:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350186.241450:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.241497:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350186.242720:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659605632 00000100:00100000:1.0:1783350186.242731:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659605632 00000100:00100000:1.0:1783350186.242788:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783350186.242799:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659605632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350186.242948:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659605632:12345-0@lo:502:mount.lustre.0 Request processed in 150us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350186.242956:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783350186.243785:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350186.244007:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1783350186.244035:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1783350186.244072:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605760:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350186.244126:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.246664:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350186.252345:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659605760 00000100:00100000:1.0:1783350186.252368:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659605760 00000100:00100000:0.0:1783350186.252528:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783350186.252539:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659605760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350186.252708:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659605760:12345-0@lo:502:mount.lustre.0 Request processed in 170us (8581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.252716:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783350186.252780:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659605760:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350186.252856:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1783350186.252869:0:23396:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783350186.253980:0:23415:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1783350186.253998:0:23415:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8ea241dcb380) 00000020:00000080:1.0:1783350186.254022:0:23415:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1783350186.254201:0:23415:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea36d918800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783350186.254206:0:23415:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea36d918800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783350186.254208:0:23415:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea36d918800 3 00010000:00080000:1.0:1783350186.254238:0:23415:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea3461c2800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.150@tcp at head 00010000:00010000:1.0:1783350186.258056:0:23415:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1783350186.258191:0:23415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1783350186.258235:0:23415:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783350186.258246:0:23415:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd05e6ae1590e3bdc 00000100:00080000:1.0:1783350186.258258:0:23415:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783350186.258263:0:23415:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ea3461c2800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350186.258298:0:23415:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d738a80 x1869977659605888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350186.258327:0:23415:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783350186.258369:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783350186.258378:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783350186.258380:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea37f567000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350186.258386:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ea37f567000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350186.258410:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d739880 x1869977659606016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350186.258420:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350186.258423:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350186.258426:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350186.258429:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350186.258465:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350186.258469:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350186.258471:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350186.258474:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783350186.258565:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659605888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783350186.258705:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659606144:0@lo:400:kworker.0 00000100:00100000:1.0:1783350186.261998:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659606272:0@lo:400:kworker.0 00000100:00100000:2.0:1783350186.262130:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.263009:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659606144 00000100:00100000:0.0:1783350186.263019:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659606144 00000100:00100000:0.0:1783350186.263067:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783350186.263089:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659606144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350186.263171:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659606144:12345-0@lo:400:kworker.0 Request processed in 84us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.263178:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783350186.263233:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ea36d73b800 x1869977659606144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350186.263247:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659606144:0@lo:400:kworker.0 00000100:00100000:0.0:1783350186.263397:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.263422:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659605888 00000100:00100000:0.0:1783350186.263426:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659605888 00000100:00100000:0.0:1783350186.263444:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783350186.263449:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659605888:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783350186.263467:0:22665:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:0.0:1783350186.263499:0:22665:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd05e6ae1590e3be3 00000004:00100000:0.0:1783350186.263525:0:22665:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783350186.263554:0:22665:0:(import.c:65:import_set_state_nolock()) ffff8ea34618d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783350186.263601:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869977659605888:12345-0@lo:38:llog_process_th.0 Request processed in 151us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.263608:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783350186.263644:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ea36d738a80 x1869977659605888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350186.263654:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783350186.263660:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1783350186.263666:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783350186.263671:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783350186.263678:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea3461c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783350186.263684:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659605888:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783350186.263693:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659606016:0@lo:38:kworker.0 00000100:00100000:0.0:1783350186.263722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.263744:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659606016 00000100:00100000:0.0:1783350186.263746:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659606016 00000100:00100000:0.0:1783350186.263762:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783350186.263766:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659606016:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783350186.263796:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659606016:12345-0@lo:38:kworker.0 Request processed in 29us (73us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783350186.263801:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1783350186.263822:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea37f567000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350186.263826:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783350186.263829:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659606016:0@lo:38:kworker.0 00000100:00100000:1.0:1783350186.268894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783350186.269065:0:23415:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:2.0:1783350186.269263:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659606272 00000100:00100000:2.0:1783350186.269274:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659606272 00000100:00100000:2.0:1783350186.269322:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783350186.269331:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1869977659606272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350186.269402:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1869977659606272:12345-0@lo:400:kworker.0 Request processed in 72us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350186.269410:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783350186.269462:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659606272:0@lo:400:kworker.0 00000020:01000000:0.0:1783350186.269950:0:23396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783350186.269992:0:23396:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783350186.270009:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0200/0xd05e6ae1590e3bc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bce expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.270021:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0200/0xd05e6ae1590e3bc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bce expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783350186.270076:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783350186.270079:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783350186.270080:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783350186.270081:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783350186.270083:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783350186.270085:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783350186.270086:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783350186.270091:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783350186.270092:0:23396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783350186.270096:0:23396:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1783350186.270098:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783350186.270099:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783350186.270100:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783350186.270101:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783350186.270102:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783350186.270103:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783350186.270104:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783350186.270105:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783350186.270106:0:23396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783350186.270128:0:23396:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783350186.270165:0:23396:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659606400:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783350186.270211:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.270239:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659606400 00000100:00100000:0.0:1783350186.270243:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659606400 00000100:00100000:0.0:1783350186.270271:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783350186.270277:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659606400:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783350186.270297:0:22657:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783350186.270309:0:22657:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783350186.270456:0:23396:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24310df00 going to sleep for 11 seconds 00000001:00100000:2.0:1783350186.288040:0:22645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1783350186.288100:0:22657:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783350186.288116:0:22657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1783350186.288161:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783350186.288166:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783350186.288198:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350186.288216:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3ae7 expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350186.288233:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3bb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bab expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350186.288241:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350186.288279:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3bab expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350186.288303:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3bb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bab expref: 18 pid: 22659 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350186.288319:0:22680:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d777800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659606528:0@lo:104: 00000100:00100000:0.0:1783350186.288401:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:23396:x1869977659606400:12345-0@lo:253:mount.lustre.0 Request processed in 18122us (18188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.288413:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783350186.288491:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350186.288525:0:23396:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:23396:1869977659606400:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783350186.288537:0:23396:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00010000:00010000:3.0:1783350186.288539:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3ae7 expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783350186.288540:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783350186.288542:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783350186.288543:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350186.288545:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350186.288546:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350186.288547:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:3.0:1783350186.288548:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3aee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3ae7 expref: 17 pid: 22659 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783350186.288549:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783350186.288551:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350186.288553:0:23396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783350186.288556:0:22680:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659606656:0@lo:104: 00000020:02000000:2.0:1783350186.288567:0:23396:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1783350186.288575:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350186.288589:0:22680:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350186.288848:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659606528 00000100:00100000:0.0:1783350186.288854:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659606528 00000100:00100000:0.0:1783350186.288879:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659606656 00000100:00100000:0.0:1783350186.288881:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659606656 00000100:00100000:0.0:1783350186.288893:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350186.288900:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+4:22680:x1869977659606528:12345-0@lo:104: 00010000:00010000:0.0:1783350186.288921:0:22649:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.288971:0:22649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783350186.288977:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+4:22680:x1869977659606528:12345-0@lo:104: Request processed in 78us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.288984:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350186.288996:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783350186.289002:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d774380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659606656:12345-0@lo:104: 00010000:00010000:0.0:1783350186.289008:0:22649:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289037:0:22649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783350186.289041:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d774380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659606656:12345-0@lo:104: Request processed in 41us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.289046:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783350186.289064:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783350186.289070:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289078:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f400 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350186.289081:0:22654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289089:0:22654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350186.289097:0:22654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350186.289110:0:22654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783350186.289154:0:22654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289161:0:22654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350186.289182:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289190:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e3bab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3bb2 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289202:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350186.289205:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289211:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3429f0e00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350186.289213:0:22654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350186.289219:0:22680:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d777800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659606528:0@lo:104: 00010000:00010000:0.0:1783350186.289220:0:22654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350186.289226:0:22654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350186.289231:0:22654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783350186.289244:0:22654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289249:0:22654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350186.289271:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289278:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0e00/0xd05e6ae1590e3ae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3aee expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289290:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350186.289292:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350186.289293:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350186.289299:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350186.289316:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659606784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350186.289344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350186.289385:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3648:1869977659606912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350186.289407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350186.289422:0:22680:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659606656:0@lo:104: 00010000:00010000:3.0:1783350186.289439:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350186.289444:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659606784 00000100:00100000:0.0:1783350186.289448:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659606784 00010000:00010000:0.0:1783350186.289463:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3bb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bab expref: 18 pid: 22659 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350186.289481:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659606912 00000100:00100000:0.0:1783350186.289483:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659606912 00010000:00010000:0.0:1783350186.289493:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3aee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3ae7 expref: 19 pid: 22659 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350186.289504:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350186.289510:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:3647:x1869977659606784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350186.289536:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350186.289542:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3bb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bab expref: 19 pid: 22659 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289561:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bab expref: 19 pid: 22659 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289574:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3bb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3bab expref: 19 pid: 22659 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289707:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350186.289737:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:3647:x1869977659606784:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.289745:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350186.289758:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783350186.289764:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:3648:x1869977659606912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350186.289772:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350186.289776:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3aee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3ae7 expref: 17 pid: 22659 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289787:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3ae7 expref: 17 pid: 22659 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289797:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3aee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3ae7 expref: 17 pid: 22659 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289808:0:22651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289816:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783350186.289829:0:22651:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001663503s 00010000:00010000:0.0:1783350186.289839:0:22651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289847:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289854:0:22651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289860:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289866:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350186.289869:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289875:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289894:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350186.289903:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350186.289929:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+16:3648:x1869977659606912:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.289936:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783350186.289942:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350186.289950:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350186.289956:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3bea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350186.289964:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3648:1869977659606912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350186.289981:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659606784:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1783350186.295688:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1783350186.295831:0:23422:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1783350186.295836:0:23422:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1783350186.296256:0:23423:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1783350186.296803:0:23423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1783350186.299495:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1783350186.300836:0:23423:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783350186.300917:0:23423:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1783350186.301325:0:23424:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1869977659607040:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1783350186.301439:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1783350186.301476:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783350186.301527:0:23424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:0.0:1783350186.301934:0:23396:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:3.0:1783350186.301977:0:23424:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350186.303555:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659607040 00000100:00100000:0.0:1783350186.303567:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659607040 00000100:00100000:0.0:1783350186.303626:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783350186.303635:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23424:x1869977659607040:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783350186.303729:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23424:x1869977659607040:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 95us (2202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350186.303735:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:01000000:0.0:1783350186.303835:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1783350186.303911:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783350186.303933:0:23424:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1869977659607040:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1783350186.303964:0:23424:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783350186.303996:0:23424:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1869977659607168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783350186.304030:0:23424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350186.304048:0:23424:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b80c0 going to sleep for 11 seconds 00000040:00080000:0.0:1783350186.304904:0:23396:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783350186.305678:0:23396:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783350186.305716:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1783350186.305810:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783350186.306309:0:23396:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:2.0:1783350186.306480:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659607168 00000100:00100000:2.0:1783350186.306488:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659607168 00000100:00100000:2.0:1783350186.306529:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783350186.306537:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23424:x1869977659607168:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783350186.306690:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23424:x1869977659607168:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 152us (2657us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350186.306697:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783350186.307097:0:23424:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1869977659607168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783350186.307190:0:23424:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23424:1869977659607296:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1783350186.307493:0:23424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350186.307552:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659607296 00000100:00100000:3.0:1783350186.307557:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659607296 00000100:00100000:3.0:1783350186.307587:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783350186.307592:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23424:x1869977659607296:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1783350186.307625:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23424:x1869977659607296:12345-0@lo:900:lod0001_rec0000.0 Request processed in 33us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350186.307630:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783350186.307645:0:23424:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8180 going to sleep for 11 seconds 00010000:00080000:3.0:1783350186.307657:0:23424:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ea36d774a80 x1869977659607296/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783350202 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350186.307667:0:23424:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23424:1869977659607296:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1783350186.307707:0:23424:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1869977659607424:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783350186.307736:0:23424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350186.307749:0:23424:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350186.307883:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659607424 00000100:00100000:2.0:1783350186.307888:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659607424 00000100:00100000:2.0:1783350186.307906:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783350186.307912:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23424:x1869977659607424:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783350186.307971:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23424:x1869977659607424:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 59us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350186.307977:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783350186.308979:0:23424:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1869977659607424:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1783350186.309037:0:23424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783350186.315472:0:23424:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783350186.315570:0:23424:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783350186.315576:0:23424:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1783350186.320897:0:23396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1783350186.330445:0:23396:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783350186.330493:0:23396:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9d9841977988 00100000:10000000:0.0:1783350186.330502:0:23396:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1783350186.331400:0:23396:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783350186.331434:0:23396:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783350186.331450:0:23396:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783350186.331474:0:23396:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1783350186.333510:0:23396:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783350186.333746:0:23396:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783350186.760468:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350187.153004:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00000040:00080000:2.0:1783350187.333131:0:23421:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1783350187.524897:0:22662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783350187.524905:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea36d918800 from 12 10000000:01000000:0.0:1783350187.524910:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783350187.524957:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350187.524969:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350187.524996:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350187.525020:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659607552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783350187.525087:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350187.525133:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783350187.525234:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659607552 00000100:00100000:1.0:1783350187.525242:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659607552 00000100:00100000:1.0:1783350187.525300:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783350187.525308:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+16:22662:x1869977659607552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350187.525321:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350187.525334:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3bf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3bf1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350187.525367:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bf1 expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350187.525378:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bf1 expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350187.525387:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374603200, rc 0) 00000100:00100000:1.0:1783350187.525445:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:22662:x1869977659607552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350187.525451:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783350187.525547:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659607552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350187.525560:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350187.525568:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350187.525633:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659607680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783350187.525665:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350187.525695:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343bc2840 going to sleep for 11 seconds 00000100:00100000:3.0:1783350187.525731:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659607680 00000100:00100000:3.0:1783350187.525737:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659607680 00000100:00100000:3.0:1783350187.525772:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783350187.525780:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:22662:x1869977659607680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783350187.525794:0:22657:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783350187.525822:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783350187.525825:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1783350187.525906:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:22662:x1869977659607680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350187.525914:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783350187.525936:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659607680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783350187.525981:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783350187.525988:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350187.526006:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350187.526014:0:22662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783350187.526016:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea37464f800 from 12 10000000:01000000:2.0:1783350187.526019:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783350187.526034:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350187.526041:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350187.526048:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350187.526060:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659607808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783350187.526084:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350187.526105:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343bc2840 going to sleep for 11 seconds 00000100:00100000:3.0:1783350187.526150:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659607808 00000100:00100000:3.0:1783350187.526155:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659607808 00000100:00100000:3.0:1783350187.526189:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783350187.526195:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:22662:x1869977659607808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350187.526202:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350187.526222:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3c06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3bff expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350187.526236:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bff expref: 18 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350187.526254:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bff expref: 18 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350187.526261:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd600, rc 0) 00000100:00100000:3.0:1783350187.526293:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:22662:x1869977659607808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350187.526299:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783350187.526546:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659607808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350187.526557:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350187.526564:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350187.526615:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659607936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783350187.526645:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350187.526679:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343bc2840 going to sleep for 11 seconds 00000100:00100000:0.0:1783350187.527158:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659607936 00000100:00100000:0.0:1783350187.527164:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659607936 00000100:00100000:0.0:1783350187.527206:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783350187.527213:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:22662:x1869977659607936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783350187.527228:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783350187.527242:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783350187.527245:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1783350187.527328:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:22662:x1869977659607936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350187.527335:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783350187.527417:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659607936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783350187.527466:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783350187.527473:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350187.527481:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350187.781009:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350188.164430:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00000040:00080000:2.0:1783350188.357765:0:23421:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783350188.805444:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350189.188368:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00010000:00010000:2.0:1783350189.829360:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350190.212239:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00010000:00010000:0.0:1783350190.853840:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783350191.176742:0:23667:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783350191.236350:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 0 seconds 00000100:00100000:0.0:1783350191.494020:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783350191.494041:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659608064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783350191.494105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783350191.495474:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783350191.495480:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783350191.495483:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea37f567000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783350191.495494:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ea37f567000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350191.495515:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37b5d4000 x1869977659608320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783350191.495532:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350191.495535:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783350191.495538:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350191.495541:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783350191.495562:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350191.495564:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783350191.495580:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350191.495583:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783350191.495710:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659608064 00000100:00100000:2.0:1783350191.495717:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659608064 00000100:00100000:2.0:1783350191.495761:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783350191.495770:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659608064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350191.495801:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783350191.495865:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659608064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350191.495872:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783350191.495898:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659608448:0@lo:400:kworker.0 00000100:00100000:2.0:1783350191.495935:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350191.495958:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783350191.495963:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659608192:0@lo:400:kworker.0 00000100:00100000:2.0:1783350191.495991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350191.496028:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659608320:0@lo:38:kworker.0 00000100:00100000:2.0:1783350191.496052:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350191.496081:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659608320 00000100:00100000:2.0:1783350191.496085:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659608320 00000100:00100000:2.0:1783350191.496103:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783350191.496107:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869977659608320:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783350191.496130:0:22669:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 632 last 0 00000020:00000080:2.0:1783350191.496199:0:22669:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e3c0d 00000004:00100000:2.0:1783350191.496215:0:22669:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783350191.496220:0:22669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1783350191.496293:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659608448 00000100:00100000:2.0:1783350191.496298:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659608448 00000100:00100000:2.0:1783350191.500771:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783350191.500792:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659608448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350191.500936:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659608448:12345-0@lo:400:kworker.0 Request processed in 152us (5000us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350191.500945:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783350191.500973:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659608192 00000100:00100000:2.0:1783350191.500980:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659608192 00000100:00100000:2.0:1783350191.501028:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783350191.501035:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:3647:x1869977659608192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350191.501066:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:3647:x1869977659608192:12345-0@lo:400:kworker.0 Request processed in 32us (5074us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350191.501072:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783350191.501113:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783350191.501128:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659608576:0@lo:400:kworker.0 00000100:00100000:2.0:1783350191.501179:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350191.501210:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659608576 00000100:00100000:2.0:1783350191.501214:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659608576 00000100:00100000:2.0:1783350191.501238:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783350191.501243:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659608576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350191.501276:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659608576:12345-0@lo:400:kworker.0 Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350191.501281:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783350191.501411:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659608064:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1783350191.501442:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea37b5d5880 x1869977659608576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350191.501463:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659608576:0@lo:400:kworker.0 00010000:00080000:1.0:1783350191.504274:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea37b5d7800 x1869977659608448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350191.504292:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659608448:0@lo:400:kworker.0 00000100:00100000:1.0:1783350191.504334:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659608192:0@lo:400:kworker.0 00000100:00080000:0.0:1783350191.514073:0:22669:0:(import.c:65:import_set_state_nolock()) ffff8ea349781000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783350191.515326:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1869977659608320:12345-0@lo:38:kworker.0 Request processed in 19205us (19261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350191.515350:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1783350191.519454:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1783350191.519466:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783350191.519472:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783350191.519476:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea37f567000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783350191.519497:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003f72bcf6): req@ffff8ea36d73bb80 x1869977659600896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350191.519514:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659608320:0@lo:38:kworker.0 00000100:00100000:0.0:1783350191.521172:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350191.521204:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 11 seconds 00000100:00100000:0.0:1783350191.521222:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659608704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783350191.521245:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350191.521279:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659600896 00000100:00100000:0.0:1783350191.521285:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659600896 00000100:00100000:0.0:1783350191.524613:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659608704 00000100:00100000:0.0:1783350191.524626:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659608704 00000100:00100000:0.0:1783350191.524658:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783350191.524667:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22706:x1869977659600896:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783350191.524780:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22706:x1869977659600896:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 113us (3612us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350191.524787:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783350191.524803:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783350191.524809:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659608704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783350191.524829:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350191.524865:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659608704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (3619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350191.524871:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783350191.524923:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659608704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783350191.525172:0:22706:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73bb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1869977659600896:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1783350191.525204:0:22706:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783350191.525244:0:22706:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1869977659608832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783350191.525280:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350191.527452:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659608832 00000100:00100000:1.0:1783350191.527467:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659608832 00000100:00100000:1.0:1783350191.527520:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783350191.527531:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22706:x1869977659608832:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783350191.527696:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22706:x1869977659608832:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 167us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350191.527714:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783350191.527850:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783350191.527876:0:22706:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1869977659608832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783350191.527967:0:22706:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1869977659608960:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783350191.528001:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350191.528026:0:22706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783350191.528042:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659608960 00000100:00100000:0.0:1783350191.528045:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659608960 00000100:00100000:0.0:1783350191.528067:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783350191.528073:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22706:x1869977659608960:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783350191.528126:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22706:x1869977659608960:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 52us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350191.528132:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783350191.528182:0:22706:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1869977659608960:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1783350191.528220:0:22706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783350191.540446:0:22706:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783350191.540521:0:22706:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:0.0:1783350191.540526:0:22706:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1783350191.876354:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783350192.260838:0:23719:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783350192.261074:0:23719:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783350192.900332:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783350193.186629:0:23769:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783350193.186904:0:23769:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783350193.925804:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783350194.249581:0:22698:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1783350194.420352:0:23818:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3aacbdd0 20000000:00000080:0.0:1783350194.420371:0:23818:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ea3495e6800 uarg=0000000000000000 20000000:01000000:0.0:1783350194.420411:0:23818:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783350194.420418:0:23818:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783350194.420423:0:23818:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783350194.421464:0:23819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1783350194.421623:0:23818:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783350194.428736:0:23818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783350194.428768:0:23818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350194.428787:0:23818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3abd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3ab6 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350194.428808:0:23818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea374602200/0xd05e6ae1590e3bc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bb9 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350194.428816:0:23818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350194.428857:0:23818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea374602200/0xd05e6ae1590e3bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3bb9 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350194.428873:0:23818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea374602200/0xd05e6ae1590e3bc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bb9 expref: 17 pid: 22657 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350194.428887:0:23818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23818:1869977659609088:0@lo:104: 00000100:00100000:0.0:1783350194.428958:0:23818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783350194.429014:0:23818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3ab6 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350194.429021:0:23818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3abd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3ab6 expref: 17 pid: 22657 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350194.429029:0:23818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23818:1869977659609216:0@lo:104: 00000100:00100000:0.0:1783350194.429048:0:23818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350194.429062:0:23818:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783350194.429798:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659609088 00000100:00100000:1.0:1783350194.429808:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659609088 00000100:00100000:1.0:1783350194.429850:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659609216 00000100:00100000:1.0:1783350194.429853:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659609216 00000100:00100000:1.0:1783350194.429881:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783350194.429890:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+4:23818:x1869977659609088:12345-0@lo:104: 00010000:00010000:1.0:1783350194.429902:0:22649:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350194.429970:0:22649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783350194.429976:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+4:23818:x1869977659609088:12345-0@lo:104: Request processed in 88us (1019us total) trans 0 rc 0/0 00010000:00010000:2.0:1783350194.429983:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783350194.429984:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1783350194.429993:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.430003:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3429f1200 already unused, calling callback (ffffffffc1361c20) 00000100:00100000:1.0:1783350194.430006:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 10000000:00010000:2.0:1783350194.430009:0:22654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.430018:0:22654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350194.430026:0:22654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350194.430027:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:23818:x1869977659609216:12345-0@lo:104: 10000000:01000000:2.0:1783350194.430039:0:22654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783350194.430041:0:22649:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.430079:0:22654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350194.430079:0:22649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783350194.430088:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:23818:x1869977659609216:12345-0@lo:104: Request processed in 62us (1037us total) trans 0 rc 0/0 00010000:00010000:2.0:1783350194.430109:0:22654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783350194.430113:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783350194.430132:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350194.430154:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.430162:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1200/0xd05e6ae1590e3bb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3bc0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.430184:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350194.430186:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350194.430188:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350194.430192:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659609344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350194.430227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350194.430959:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659609344 00000100:00100000:2.0:1783350194.430967:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659609344 00010000:00010000:2.0:1783350194.430995:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea374602200/0xd05e6ae1590e3bc0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bb9 expref: 18 pid: 22657 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350194.431039:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783350194.431046:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:3646:x1869977659609344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783350194.431059:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350194.431065:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea374602200/0xd05e6ae1590e3bc0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bb9 expref: 18 pid: 22657 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.431075:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea374602200/0xd05e6ae1590e3bc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bb9 expref: 18 pid: 22657 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.431094:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783350194.431167:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:3646:x1869977659609344:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350194.431174:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783350194.431562:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350194.431569:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350194.431571:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350194.431654:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.431670:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374603400 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783350194.431673:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.431681:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783350194.431688:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350194.431694:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783350194.431730:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.431737:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783350194.431749:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.431756:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3ab6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3abd expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.431773:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350194.431775:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350194.431777:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350194.432027:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659609472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350194.432070:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350194.432175:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659609344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783350194.432395:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659609472 00000100:00100000:2.0:1783350194.432402:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659609472 00010000:00010000:2.0:1783350194.432423:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3abd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3ab6 expref: 18 pid: 22657 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350194.432445:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783350194.432461:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:3647:x1869977659609472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783350194.432474:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350194.432479:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3abd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3ab6 expref: 18 pid: 22657 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.432488:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3abd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3ab6 expref: 18 pid: 22657 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.432503:0:22651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.432510:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.432536:0:22651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.432543:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.432550:0:22651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.432557:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.432562:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780aec00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350194.432567:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.432573:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.432587:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.432596:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783350194.432624:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:3647:x1869977659609472:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350194.432631:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783350194.432859:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659609472:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350194.434025:0:23818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea374602200/0xd05e6ae1590e3bc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3bb9 expref: 17 pid: 22657 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350194.434040:0:23818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23818:1869977659609088:0@lo:104: 00010000:00010000:0.0:1783350194.434052:0:23818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3abd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3ab6 expref: 16 pid: 22657 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350194.434075:0:23818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23818:1869977659609216:0@lo:104: 00010000:00010000:0.0:1783350194.434097:0:23818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350194.434106:0:23818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350194.434112:0:23818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350194.434118:0:23818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3780aec00/0xd05e6ae1590e3c14 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350194.948785:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783350195.782312:0:22662:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783350195.782320:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea36d918800 from 13 10000000:01000000:3.0:1783350195.782325:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783350195.782373:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350195.782384:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350195.782395:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350195.782423:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659609600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783350195.782495:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350195.782536:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1783350195.782834:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659609600 00000100:00100000:0.0:1783350195.782842:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659609600 00000100:00100000:0.0:1783350195.782897:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783350195.782906:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+16:22662:x1869977659609600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783350195.782919:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350195.782933:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3780af400/0xd05e6ae1590e3c22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3c1b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350195.782955:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3780af400/0xd05e6ae1590e3c22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c1b expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350195.782966:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3780af400/0xd05e6ae1590e3c22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c1b expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350195.782975:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3780af400, rc 0) 00000100:00100000:0.0:1783350195.783032:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:22662:x1869977659609600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350195.783038:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783350195.783214:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659609600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350195.783227:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350195.783243:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350195.783317:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659609728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350195.783345:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350195.783361:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783350195.783576:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659609728 00000100:00100000:2.0:1783350195.783581:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659609728 00000100:00100000:2.0:1783350195.783605:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783350195.783612:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:22662:x1869977659609728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783350195.783723:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:22662:x1869977659609728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350195.783729:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783350195.783843:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659609728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350195.783872:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659609856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783350195.783912:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350195.783940:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783350195.783987:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659609856 00000100:00100000:2.0:1783350195.783991:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659609856 00000100:00100000:2.0:1783350195.784023:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783350195.784030:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:22662:x1869977659609856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783350195.784110:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:22662:x1869977659609856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350195.784117:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783350195.784317:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659609856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783350195.785794:0:23880:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783350195.789928:0:22662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783350195.789970:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783350195.789983:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350195.790016:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350195.790029:0:22662:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783350195.790032:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea37464f800 from 13 10000000:01000000:2.0:1783350195.790034:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783350195.790074:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350195.790083:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350195.790092:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350195.790116:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659609984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783350195.790217:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350195.790258:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350195.793736:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659609984 00000100:00100000:1.0:1783350195.793751:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659609984 00000100:00100000:1.0:1783350195.793798:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783350195.793808:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+17:22662:x1869977659609984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350195.793824:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350195.793841:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3c30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3c29 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350195.793868:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3c30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c29 expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350195.793879:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3c30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c29 expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350195.793889:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374602000, rc 0) 00000100:00100000:1.0:1783350195.793963:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:22662:x1869977659609984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350195.793970:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783350195.794068:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659609984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350195.794085:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350195.794094:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350195.794214:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659610112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350195.794249:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350195.794280:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350195.794396:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659610112 00000100:00100000:2.0:1783350195.794401:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659610112 00000100:00100000:2.0:1783350195.794436:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783350195.794443:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:22662:x1869977659610112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783350195.794540:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:22662:x1869977659610112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350195.794547:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783350195.794620:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659610112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350195.794657:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659610240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783350195.794694:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350195.794720:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350195.794763:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659610240 00000100:00100000:2.0:1783350195.794767:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659610240 00000100:00100000:2.0:1783350195.794793:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783350195.794805:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:22662:x1869977659610240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783350195.794873:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:22662:x1869977659610240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350195.794878:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783350195.794957:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659610240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783350195.795863:0:23881:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783350195.806452:0:22662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783350195.806488:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783350195.806499:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350195.806510:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350195.974480:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350196.613610:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659610368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783350196.613698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350196.613764:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659610368 00000100:00100000:0.0:1783350196.613772:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659610368 00000100:00100000:0.0:1783350196.613817:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783350196.613825:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659610368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783350196.613865:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350196.613913:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659610368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350196.613920:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783350196.613961:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659610368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350196.615196:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350186/real 1783350186] req@ffff8ea37b5d4a80 x1869977659604096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350196 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350196.615226:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea37b5d4a80 x1869977659604096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350196 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350196.615238:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350186/real 1783350186] req@ffff8ea36d775f80 x1869977659603968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350196 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350196.615250:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea36d775f80 x1869977659603968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350196 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783350196.615268:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea370da1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350196.615276:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783350196.615280:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659604096:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783350196.615295:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243527000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350196.615299:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783350196.615302:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659603968:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783350196.616241:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659610496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783350196.616317:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350196.617208:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659610496 00000100:00100000:1.0:1783350196.617220:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659610496 00000100:00100000:1.0:1783350196.617269:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783350196.617278:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659610496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783350196.617323:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783350196.617394:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659610496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350196.617402:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783350196.617459:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659610496:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1783350196.617753:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350196.617759:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350196.617762:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350196.617765:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350196.617779:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350196.617782:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783350196.617785:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea243527000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350196.617791:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 626 00000100:00080000:1.0:1783350196.617796:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783350196.617815:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ea243527000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350196.617835:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d739880 x1869977659610880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350196.617851:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350196.617854:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783350196.617856:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea370da1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350196.617859:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 626 00000100:00080000:1.0:1783350196.617861:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783350196.617865:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea370da1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350196.617876:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d738a80 x1869977659611008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783350196.617915:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659610624:0@lo:400:kworker.0 00000100:00100000:1.0:1783350196.617958:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350196.617991:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783350196.617997:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659610752:0@lo:400:kworker.0 00000100:00100000:1.0:1783350196.618022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350196.618048:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783350196.618054:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659611136:0@lo:400:kworker.0 00000100:00100000:1.0:1783350196.618743:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350196.619271:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659610624 00000100:00100000:3.0:1783350196.619280:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659610624 00000100:00100000:3.0:1783350196.619343:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783350196.619353:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:3646:x1869977659610624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350196.619431:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:3646:x1869977659610624:12345-0@lo:400:kworker.0 Request processed in 79us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350196.619438:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783350196.619483:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659610880:0@lo:8:kworker.0 00000400:00000100:3.0:1783350196.619594:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659610880 offset 0 length 520: 4 00000100:00100000:3.0:1783350196.619620:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659611008:0@lo:8:kworker.0 00000400:00000100:3.0:1783350196.619641:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659611008 offset 0 length 520: 4 00000100:00100000:0.0:1783350196.619728:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659610624:0@lo:400:kworker.0 00000100:00100000:2.0:1783350196.621372:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659610752 00000100:00100000:2.0:1783350196.621385:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659610752 00000100:00100000:2.0:1783350196.621436:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659611136 00000100:00100000:2.0:1783350196.621440:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659611136 00000100:00100000:2.0:1783350196.621457:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350196.621466:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659610752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350196.621594:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659610752:12345-0@lo:400:kworker.0 Request processed in 128us (3569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350196.621601:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350196.621618:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783350196.621624:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659611136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350196.621662:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659611136:12345-0@lo:400:kworker.0 Request processed in 39us (2920us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350196.621669:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783350196.621716:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea36d73b800 x1869977659611136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350196.621730:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659611136:0@lo:400:kworker.0 00010000:00080000:1.0:1783350196.623047:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea36d739f80 x1869977659610752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350196.623075:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659610752:0@lo:400:kworker.0 00010000:00010000:3.0:1783350196.997911:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783350197.127940:0:23397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783350197.638079:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350182/real 1783350182] req@ffff8ea37f539880 x1869977659601920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350197 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350197.638110:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea37f539880 x1869977659601920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350197 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350197.638120:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350182/real 1783350182] req@ffff8ea37f539c00 x1869977659602048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350197 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350197.638742:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea37f539c00 x1869977659602048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350197 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783350197.638761:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea357ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350197.651249:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783350197.651509:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659601920:0@lo:8:kworker.0 00000100:00080000:3.0:1783350197.651523:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24271b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350197.651532:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783350197.651535:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659602048:0@lo:8:kworker.0 00000100:00080000:1.0:1783350197.652713:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350197.652718:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783350197.652727:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea357ed8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350197.652733:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:1.0:1783350197.652739:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783350197.652746:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ea357ed8000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350197.652769:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d738700 x1869977659611520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350197.652783:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350197.652786:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783350197.652788:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea24271b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350197.652791:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:1.0:1783350197.652793:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783350197.652796:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ea24271b000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350197.652806:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d738380 x1869977659611648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350197.652826:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350197.652829:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350197.652843:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350197.652847:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783350197.653271:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659611264:0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.653344:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350197.653378:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659612032:0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.653403:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350197.653427:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783350197.653432:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659611904:0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.653467:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350197.653509:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659611392:0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.653534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350197.653551:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783350197.653556:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659611776:0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.655418:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350197.655727:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659611520:0@lo:8:kworker.0 00000400:00000100:3.0:1783350197.655775:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659611520 offset 0 length 520: 4 00000100:00100000:3.0:1783350197.655799:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659611648:0@lo:8:kworker.0 00000400:00000100:3.0:1783350197.655822:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659611648 offset 0 length 520: 4 00000100:00100000:1.0:1783350197.656404:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659611264 00000100:00100000:1.0:1783350197.656414:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659611264 00000100:00100000:1.0:1783350197.656465:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783350197.656475:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:3649:x1869977659611264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.657423:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:3649:x1869977659611264:12345-0@lo:400:kworker.0 Request processed in 945us (4074us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350197.657433:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783350197.657486:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659612032 00000100:00100000:1.0:1783350197.657492:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659612032 00000100:00100000:1.0:1783350197.657762:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659611776 00000100:00100000:1.0:1783350197.657766:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659611776 00000100:00100000:1.0:1783350197.657785:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783350197.657792:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659612032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.658124:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659612032:12345-0@lo:400:kworker.0 Request processed in 44us (4431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350197.658132:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783350197.658171:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783350197.658178:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659611776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.658218:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659611776:12345-0@lo:400:kworker.0 Request processed in 41us (2807us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350197.658235:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783350197.658266:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659611904 00000100:00100000:1.0:1783350197.658271:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659611904 00000100:00100000:1.0:1783350197.658301:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659611392 00000100:00100000:1.0:1783350197.658305:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659611392 00000100:00100000:1.0:1783350197.658318:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783350197.658323:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659611904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.658359:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659611904:12345-0@lo:400:kworker.0 Request processed in 35us (4891us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350197.658365:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783350197.658377:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783350197.658383:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659611392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.658411:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659611392:12345-0@lo:400:kworker.0 Request processed in 28us (4876us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350197.658417:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783350197.659524:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659611904:0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.659539:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659611264:0@lo:400:kworker.0 00010000:00080000:1.0:1783350197.659553:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea36d739180 x1869977659612032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350197.659565:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659612032:0@lo:400:kworker.0 00010000:00080000:1.0:1783350197.659624:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea36d73b480 x1869977659611776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350197.659634:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659611776:0@lo:400:kworker.0 00000100:00100000:1.0:1783350197.659646:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659611392:0@lo:400:kworker.0 00010000:00010000:2.0:1783350198.023305:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783350198.597822:0:23421:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783350199.051122:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350200.068515:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350201.093387:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783350201.680703:0:24168:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783350201.680706:0:24168:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783350201.680708:0:24168:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1783350201.680839:0:24168:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ea37864d000 00000020:01000004:0.0:1783350201.680854:0:24168:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1783350201.680866:0:24168:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783350201.680882:0:24168:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ea37f458000) 00000020:00000080:0.0:1783350201.680897:0:24168:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1783350201.732762:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783350201.732784:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659612160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783350201.732860:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350201.732971:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659612160 00000100:00100000:0.0:1783350201.732979:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659612160 00000100:00100000:0.0:1783350201.733058:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783350201.733068:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659612160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783350201.733101:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350201.733164:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659612160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350201.733171:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783350201.734315:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659612160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783350201.737269:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783350201.737290:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659612288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783350201.737357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350201.737586:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659612288 00000100:00100000:2.0:1783350201.737593:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659612288 00000100:00100000:2.0:1783350201.737648:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783350201.737657:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659612288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350201.737690:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783350201.737745:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659612288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350201.737751:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783350201.737830:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659612288:0@lo:41:osp-pre-0-1.0 00100000:10000000:0.0:1783350201.787887:0:24168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783350201.789618:0:24168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1783350201.789874:0:24168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783350201.790850:0:24168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783350201.791167:0:24168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1783350201.791555:0:24168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1783350201.791764:0:24168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1783350201.794450:0:24168:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783350201.794671:0:24168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783350201.794683:0:24168:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783350201.794693:0:24168:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd05e6ae1590e3c3e 00000020:01000004:0.0:1783350201.794700:0:24168:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783350201.794719:0:24168:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783350201.794722:0:24168:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783350201.794729:0:24168:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783350201.794734:0:24168:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783350201.794745:0:24168:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ea37f45b380) 00000020:00000080:0.0:1783350201.794756:0:24168:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1783350201.803166:0:24168:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783350201.806443:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783350201.806451:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783350201.807118:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783350201.807125:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783350201.810572:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783350201.810586:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1783350201.816976:0:24168:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783350201.817132:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1783350201.817166:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1783350201.826666:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1783350201.826680:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783350201.861024:0:24168:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783350201.862981:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783350201.862990:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783350201.867819:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783350201.867831:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783350201.871336:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783350201.871348:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783350201.873971:0:24168:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783350201.878384:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783350201.878397:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783350201.879444:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783350201.879455:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1783350201.928762:0:24168:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783350201.928943:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1783350201.928950:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783350201.932088:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783350201.932100:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1783350201.933017:0:24168:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783350201.933107:0:24168:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783350201.933114:0:24168:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1783350201.945345:0:24168:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783350201.945383:0:24168:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.150@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1783350201.945389:0:24168:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783350201.945390:0:24168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783350201.945392:0:24168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783350201.945393:0:24168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783350201.945394:0:24168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783350201.945395:0:24168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783350201.945397:0:24168:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783350201.945398:0:24168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783350201.945400:0:24168:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783350201.945403:0:24168:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1783350201.945405:0:24168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783350201.945406:0:24168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783350201.945407:0:24168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783350201.945408:0:24168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783350201.945409:0:24168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783350201.945410:0:24168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783350201.945411:0:24168:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783350201.945412:0:24168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783350201.945413:0:24168:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783350201.945438:0:24168:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783350201.945520:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659612416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783350201.945640:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350201.945746:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f79900 going to sleep for 11 seconds 00000100:00100000:2.0:1783350201.945950:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659612416 00000100:00100000:2.0:1783350201.945958:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659612416 00000100:00100000:3.0:1783350201.946093:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783350201.946109:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:24168:x1869977659612416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783350201.946164:0:22659:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783350201.946167:0:22659:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1783350201.946171:0:22659:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783350201.946516:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:24168:x1869977659612416:12345-0@lo:253:mount.lustre.0 Request processed in 406us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350201.946525:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783350201.946734:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659612416:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783350201.946747:0:24168:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783350201.946750:0:24168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783350201.946751:0:24168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783350201.946752:0:24168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350201.946753:0:24168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350201.946754:0:24168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350201.946756:0:24168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350201.946757:0:24168:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783350201.946758:0:24168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350201.946760:0:24168:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783350201.946781:0:24168:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea37864d000 from lustre-OST0000 10000000:01000000:2.0:1783350201.946807:0:24168:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783350201.946810:0:24168:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783350201.946817:0:24168:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ea370dfb380 local copy 00010000:00010000:2.0:1783350201.946827:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350201.946924:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659612544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350201.946959:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350201.947077:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f79900 going to sleep for 11 seconds 00000100:00100000:3.0:1783350201.947120:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659612544 00000100:00100000:3.0:1783350201.947125:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659612544 00000100:00100000:3.0:1783350201.947182:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783350201.947190:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:24168:x1869977659612544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350201.947299:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:24168:x1869977659612544:12345-0@lo:501:mount.lustre.0 Request processed in 110us (339us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783350201.947306:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783350201.947588:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659612544:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783350201.947682:0:24168:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783350201.947705:0:24168:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783350201.947713:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350201.947722:0:24168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350201.947749:0:24168:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea37864d000 10000000:01000000:3.0:1783350201.947753:0:24168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783350201.947758:0:24168:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783350201.947761:0:24168:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783350201.947764:0:24168:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783350201.947767:0:24168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783350201.947798:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e3c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350201.947805:0:24168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e3c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350201.947814:0:24168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e3c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350201.947829:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659612672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350201.947857:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350201.947971:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783350201.950711:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659612672 00000100:00100000:1.0:1783350201.950727:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659612672 00000100:00100000:1.0:1783350201.950972:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783350201.950983:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+18:24168:x1869977659612672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350201.950999:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350201.951017:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea374603a00/0xd05e6ae1590e3c53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3c4c expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350201.951783:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea374603a00/0xd05e6ae1590e3c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c4c expref: 19 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350201.951795:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea374603a00/0xd05e6ae1590e3c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c4c expref: 19 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350201.951805:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374603a00, rc 0) 00000100:00100000:1.0:1783350201.951886:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:24168:x1869977659612672:12345-0@lo:101:mount.lustre.0 Request processed in 905us (4026us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350201.951893:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783350201.952313:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659612672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350201.952334:0:24168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e3c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c53 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350201.952344:0:24168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e3c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3c53 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783350201.958457:0:24168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1783350201.959262:0:24168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783350201.961235:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1783350201.961296:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1783350201.961310:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1783350201.961320:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1783350201.961331:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1783350201.961341:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1783350201.961351:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1783350201.961363:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1783350201.961373:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1783350201.961392:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1783350201.961417:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1783350201.961428:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1783350201.961449:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1783350201.961454:0:24168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1783350201.965727:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659612800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350201.965799:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350201.965848:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350201.965856:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659612800 00000100:00100000:1.0:1783350201.965863:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659612800 00000100:00100000:1.0:1783350201.965915:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783350201.965924:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:24168:x1869977659612800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350201.966102:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:24168:x1869977659612800:12345-0@lo:501:mount.lustre.0 Request processed in 178us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350201.966109:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783350201.966158:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659612800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350201.966190:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659612928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783350201.966226:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350201.966711:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b000 going to sleep for 11 seconds 00000100:00100000:2.0:1783350201.968234:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659612928 00000100:00100000:2.0:1783350201.968257:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659612928 00000100:00100000:2.0:1783350201.968352:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783350201.968363:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:24168:x1869977659612928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350201.969446:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:24168:x1869977659612928:12345-0@lo:503:mount.lustre.0 Request processed in 1080us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350201.969456:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783350201.971477:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659612928:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783350201.971928:0:24168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783350201.972001:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350201.974617:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350201.974710:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783350201.975712:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659613056 00000100:00100000:1.0:1783350201.975721:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659613056 00000100:00100000:1.0:1783350201.975925:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783350201.975936:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:24168:x1869977659613056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350201.979258:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:24168:x1869977659613056:12345-0@lo:502:mount.lustre.0 Request processed in 3307us (4629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350201.979272:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783350201.979493:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350201.979733:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1783350201.979774:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1783350201.979787:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1783350201.979798:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1783350201.979808:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1783350201.979818:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1783350201.979828:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1783350201.979838:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1783350201.979848:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1783350201.979859:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1783350201.979869:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1783350201.979879:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1783350201.979911:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350201.979955:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350201.988185:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350201.991778:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659613184 00000100:00100000:3.0:1783350201.991793:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659613184 00000100:00100000:3.0:1783350201.991857:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783350201.991868:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:24168:x1869977659613184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783350201.992047:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:24168:x1869977659613184:12345-0@lo:502:mount.lustre.0 Request processed in 180us (12090us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350201.992055:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783350201.992207:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350201.992293:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1783350201.992307:0:24168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1783350201.992919:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783350201.992927:0:24185:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1783350201.992933:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350201.992935:0:24185:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783350201.992947:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783350201.992962:0:24185:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ea24244cd40) 00000020:00000080:3.0:1783350201.992983:0:24185:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783350201.992989:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783350201.993050:0:24185:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea37864d000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783350201.993059:0:24185:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783350201.993065:0:24185:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd05e6ae1590e3c61 00010000:00010000:3.0:1783350201.996086:0:24185:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1783350202.010859:0:24185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1783350202.018648:0:24185:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1783350202.024560:0:24185:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783350202.024575:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350202.024589:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350202.024591:0:24185:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783350202.024596:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783350202.024599:0:24185:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1783350202.024600:0:24185:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350202.024601:0:24185:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350202.024603:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783350202.024605:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350202.024607:0:24185:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783350202.024609:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350202.024612:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350202.024613:0:24185:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783350202.024617:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783350202.024618:0:24185:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783350202.024621:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350202.024623:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350202.024624:0:24185:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783350202.024626:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350202.024628:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350202.024629:0:24185:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783350202.024632:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783350202.024660:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350202.024663:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350202.024664:0:24185:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783350202.024667:0:24185:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1783350202.025051:0:24168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1783350202.025083:0:24168:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783350202.025108:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e3c4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c53 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.025122:0:24168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e3c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c53 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350202.025130:0:24168:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea37864d000 from 1 10000000:01000000:3.0:1783350202.025157:0:24168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783350202.025198:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.025206:0:24168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.025217:0:24168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350202.025250:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350202.025317:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350202.025357:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659613312 00000100:00100000:3.0:1783350202.025365:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659613312 00000100:00100000:3.0:1783350202.025418:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783350202.025426:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:24168:x1869977659613312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350202.025439:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350202.025450:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e3c6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3c68 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.025482:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e3c6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c68 expref: 20 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.025493:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e3c6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c68 expref: 20 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.025501:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd200, rc 0) 00000100:00100000:3.0:1783350202.025530:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:24168:x1869977659613312:12345-0@lo:101:mount.lustre.0 Request processed in 105us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350202.025537:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783350202.025576:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b480 going to sleep for 11 seconds 00000100:00100000:3.0:1783350202.025595:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350202.025607:0:24168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.025614:0:24168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783350202.028626:0:24168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1783350202.028992:0:24168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783350202.030667:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1783350202.030731:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1783350202.030768:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1783350202.032399:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1783350202.032453:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1783350202.032551:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1783350202.032571:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1783350202.032587:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1783350202.032609:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1783350202.032633:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1783350202.032656:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1783350202.033597:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1783350202.033610:0:24168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1783350202.033720:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350202.034568:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350202.034622:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350202.034803:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659613440 00000100:00100000:0.0:1783350202.034813:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659613440 00000100:00100000:0.0:1783350202.034863:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783350202.034871:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:24168:x1869977659613440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350202.035026:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:24168:x1869977659613440:12345-0@lo:501:mount.lustre.0 Request processed in 155us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350202.035033:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783350202.035122:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350202.035203:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350202.035268:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350202.035292:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1783350202.035350:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659613568 00000100:00100000:1.0:1783350202.035355:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659613568 00000100:00100000:1.0:1783350202.035383:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783350202.035389:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:24168:x1869977659613568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350202.035472:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:24168:x1869977659613568:12345-0@lo:503:mount.lustre.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350202.035478:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783350202.035542:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613568:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783350202.036009:0:24168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783350202.036079:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350202.036124:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350202.036207:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1783350202.036280:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659613696 00000100:00100000:3.0:1783350202.036286:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659613696 00000100:00100000:3.0:1783350202.036326:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783350202.036335:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:24168:x1869977659613696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783350202.036417:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:24168:x1869977659613696:12345-0@lo:502:mount.lustre.0 Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350202.036424:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783350202.036617:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350202.036822:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1783350202.036847:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1783350202.036862:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1783350202.036875:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1783350202.036887:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1783350202.036897:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1783350202.036908:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1783350202.036921:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1783350202.036933:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1783350202.036959:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1783350202.036971:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1783350202.036995:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350202.037037:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350202.037059:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1783350202.037165:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659613824 00000100:00100000:0.0:1783350202.037170:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659613824 00000100:00100000:0.0:1783350202.037206:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783350202.037213:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:24168:x1869977659613824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350202.037313:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:24168:x1869977659613824:12345-0@lo:502:mount.lustre.0 Request processed in 100us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350202.037320:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783350202.037428:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783350202.037474:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1783350202.037483:0:24168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1783350202.038576:0:24189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350202.038588:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350202.038590:0:24189:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783350202.038599:0:24189:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea37864d000 00000020:00000080:1.0:1783350202.038601:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350202.038610:0:24189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350202.038612:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350202.038613:0:24189:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783350202.038616:0:24189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350202.038618:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350202.038619:0:24189:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783350202.038622:0:24189:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea37864d000 00000020:00000080:1.0:1783350202.038631:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350202.038693:0:24189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350202.038697:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350202.038698:0:24189:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783350202.038701:0:24189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350202.038703:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350202.038704:0:24189:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783350202.038707:0:24189:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea37864d000 00000020:00000080:1.0:1783350202.038709:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350202.038726:0:24189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350202.038729:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350202.038730:0:24189:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783350202.038732:0:24189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350202.038734:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350202.038736:0:24189:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783350202.038739:0:24189:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea37864d000 00000020:00000080:1.0:1783350202.038741:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350202.038826:0:24189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350202.038831:0:24189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350202.038832:0:24189:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783350202.038836:0:24189:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1783350202.052725:0:24168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783350202.052792:0:24168:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783350202.052814:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350202.052827:0:24168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350202.052917:0:24168:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783350202.052921:0:24168:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea37864d000 10000000:01000000:2.0:1783350202.052924:0:24168:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea37864d000 10000000:01000000:2.0:1783350202.052928:0:24168:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783350202.052945:0:24168:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea37864d000 from 1 10000000:01000000:2.0:1783350202.052947:0:24168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783350202.052984:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e400/0xd05e6ae1590e3c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350202.052994:0:24168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e400/0xd05e6ae1590e3c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350202.053005:0:24168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e400/0xd05e6ae1590e3c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350202.053031:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783350202.053103:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350202.053165:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09e000 going to sleep for 11 seconds 00000100:00100000:0.0:1783350202.053940:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659613952 00000100:00100000:0.0:1783350202.053951:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659613952 00000100:00100000:0.0:1783350202.054027:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783350202.054037:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:24168:x1869977659613952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350202.054053:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350202.054068:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3780afc00/0xd05e6ae1590e3c7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3c76 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350202.054102:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3780afc00/0xd05e6ae1590e3c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c76 expref: 21 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350202.054114:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3780afc00/0xd05e6ae1590e3c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c76 expref: 21 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350202.054123:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3780afc00, rc 0) 00000100:00100000:0.0:1783350202.054202:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659613952:12345-0@lo:101:mount.lustre.0 Request processed in 168us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350202.054209:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783350202.054411:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659613952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350202.054427:0:24168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e400/0xd05e6ae1590e3c76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c7d expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350202.054436:0:24168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e400/0xd05e6ae1590e3c76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3c7d expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783350202.063599:0:24168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1783350202.063905:0:24168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783350202.064165:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1783350202.064192:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1783350202.064207:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1783350202.064220:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1783350202.066494:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1783350202.066546:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1783350202.066567:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1783350202.066582:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1783350202.066596:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1783350202.066611:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1783350202.066637:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1783350202.066654:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1783350202.066668:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1783350202.066682:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1783350202.066695:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1783350202.066709:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1783350202.066723:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1783350202.066737:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1783350202.066752:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1783350202.066782:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1783350202.066816:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1783350202.066833:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1783350202.066852:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1783350202.066874:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1783350202.066889:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1783350202.066903:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1783350202.066918:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1783350202.066933:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1783350202.066947:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1783350202.066961:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1783350202.066976:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1783350202.066989:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1783350202.067006:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1783350202.067042:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1783350202.068998:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1783350202.069447:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1783350202.069479:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1783350202.069502:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1783350202.069517:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1783350202.069545:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1783350202.069997:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1783350202.070033:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1783350202.070473:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1783350202.070506:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1783350202.070524:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1783350202.070551:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1783350202.070565:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1783350202.070583:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1783350202.070741:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1783350202.070773:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1783350202.070794:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1783350202.070800:0:24168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1783350202.070904:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659614080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350202.070968:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350202.071015:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc20540 going to sleep for 11 seconds 00000100:00100000:3.0:1783350202.074819:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659614080 00000100:00100000:3.0:1783350202.074833:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659614080 00000100:00100000:3.0:1783350202.074892:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783350202.074901:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659614080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350202.075073:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659614080:12345-0@lo:501:mount.lustre.0 Request processed in 172us (4103us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350202.075080:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783350202.075564:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659614080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350202.077005:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659614208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350202.077087:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350202.077125:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc20540 going to sleep for 11 seconds 00000100:00100000:1.0:1783350202.077179:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659614208 00000100:00100000:1.0:1783350202.077186:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659614208 00000100:00100000:1.0:1783350202.077233:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783350202.077259:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659614208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350202.077363:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659614208:12345-0@lo:503:mount.lustre.0 Request processed in 121us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350202.077370:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783350202.077425:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659614208:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783350202.079955:0:24168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783350202.080061:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659614336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350202.080130:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350202.080233:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc20540 going to sleep for 11 seconds 00000100:00100000:0.0:1783350202.081386:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659614336 00000100:00100000:0.0:1783350202.081398:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659614336 00000100:00100000:0.0:1783350202.081452:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783350202.081462:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659614336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350202.083339:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659614336:12345-0@lo:502:mount.lustre.0 Request processed in 1869us (3199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350202.083353:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783350202.083531:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659614336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783350202.084043:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1783350202.084077:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1783350202.084089:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1783350202.084100:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1783350202.084111:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1783350202.084122:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1783350202.084171:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1783350202.084190:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1783350202.084206:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1783350202.084236:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1783350202.084740:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1783350202.084761:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1783350202.084776:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1783350202.084790:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1783350202.084805:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1783350202.084821:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1783350202.084836:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1783350202.084851:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1783350202.085688:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1783350202.085723:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1783350202.085739:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1783350202.085757:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1783350202.085773:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1783350202.085790:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1783350202.085805:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1783350202.085835:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1783350202.085851:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1783350202.085885:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1783350202.085902:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1783350202.085916:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1783350202.085940:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1783350202.085954:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1783350202.085968:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1783350202.085982:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1783350202.085994:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1783350202.086007:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1783350202.086019:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1783350202.086032:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1783350202.086045:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1783350202.086055:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1783350202.086067:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1783350202.086095:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1783350202.086111:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1783350202.086124:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1783350202.086161:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1783350202.086180:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1783350202.086194:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1783350202.086209:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1783350202.086279:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659614464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350202.086361:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350202.086408:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc20540 going to sleep for 11 seconds 00000100:00100000:1.0:1783350202.086438:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659614464 00000100:00100000:1.0:1783350202.086446:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659614464 00000100:00100000:1.0:1783350202.086491:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783350202.086500:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659614464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350202.088107:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659614464:12345-0@lo:502:mount.lustre.0 Request processed in 1600us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350202.088119:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783350202.088220:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659614464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783350202.088432:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1783350202.088460:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1783350202.088495:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659614592:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350202.088539:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350202.088745:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659614592 00000100:00100000:0.0:1783350202.088752:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659614592 00000100:00100000:0.0:1783350202.088793:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783350202.088801:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659614592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350202.089218:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659614592:12345-0@lo:502:mount.lustre.0 Request processed in 416us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350202.089226:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783350202.089741:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1783350202.089762:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659614592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783350202.089824:0:24168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1783350202.089836:0:24168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783350202.092405:0:24195:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783350202.092422:0:24195:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ea242448000) 00000020:00000080:3.0:1783350202.092452:0:24195:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1783350202.092670:0:24195:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea37864d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783350202.092675:0:24195:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea37864d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783350202.092677:0:24195:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea37864d000 3 00010000:00080000:3.0:1783350202.092706:0:24195:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea2426d2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1783350202.096574:0:24195:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1783350202.096679:0:24195:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783350202.096727:0:24195:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783350202.096741:0:24195:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd05e6ae1590e3c8b 00000100:00080000:3.0:1783350202.096752:0:24195:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783350202.096848:0:24195:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ea2426d2000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350202.096887:0:24195:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d775180 x1869977659614720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350202.096933:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659614720:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783350202.096997:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783350202.097056:0:24195:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783350202.097080:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350202.097084:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350202.097087:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350202.097090:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350202.098884:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350202.098893:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350202.098897:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350202.098900:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783350202.100028:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659614720 00000100:00100000:1.0:1783350202.100039:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659614720 00000100:00100000:1.0:1783350202.100129:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783350202.100167:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659614720:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783350202.100196:0:22665:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000100:00100000:2.0:1783350202.100229:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659614976:0@lo:400:kworker.0 00000020:00000080:1.0:1783350202.100260:0:22665:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd05e6ae1590e3c92 00000004:00100000:1.0:1783350202.100278:0:22665:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783350202.100315:0:22665:0:(import.c:65:import_set_state_nolock()) ffff8ea243521800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783350202.100317:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350202.100379:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869977659614720:12345-0@lo:38:llog_process_th.0 Request processed in 241us (3381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350202.100388:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783350202.100528:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea36d775180 x1869977659614720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350202.100549:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783350202.100556:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1783350202.100564:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783350202.100569:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783350202.100571:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea2426d2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783350202.100577:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659614720:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783350202.100684:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783350202.100692:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659614848:0@lo:400:kworker.0 00000100:00100000:2.0:1783350202.100720:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350202.100792:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659614976 00000100:00100000:1.0:1783350202.100798:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659614976 00000100:00100000:1.0:1783350202.100822:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350202.100828:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659614976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350202.100879:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659614976:12345-0@lo:400:kworker.0 Request processed in 50us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350202.100886:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000004:3.0:1783350202.101359:0:24195:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783350202.101376:0:24195:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ea349f899c0) 00000020:00000080:3.0:1783350202.101397:0:24195:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1783350202.101554:0:24195:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea37864d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783350202.101557:0:24195:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea37864d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783350202.101560:0:24195:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea37864d000 3 00010000:00080000:3.0:1783350202.101584:0:24195:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea3497b8000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1783350202.103250:0:24195:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1783350202.103354:0:24195:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1783350202.103400:0:24195:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783350202.103413:0:24195:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd05e6ae1590e3ca0 00000100:00080000:3.0:1783350202.103425:0:24195:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783350202.103431:0:24195:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ea3497b8000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350202.103467:0:24195:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d775180 x1869977659615104/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350202.103506:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869977659615104:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1783350202.103575:0:24195:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783350202.103598:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350202.103602:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350202.103611:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350202.103614:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350202.103618:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350202.103621:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350202.103624:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350202.103627:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1783350202.104208:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea36d776d80 x1869977659614976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350202.104337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350202.104538:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659614976:0@lo:400:kworker.0 00000100:00100000:1.0:1783350202.114674:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659614848 00000100:00100000:1.0:1783350202.114689:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659614848 00000100:00100000:1.0:1783350202.114739:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659615104 00000100:00100000:1.0:1783350202.114743:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659615104 00000100:00100000:1.0:1783350202.114760:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783350202.114770:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659614848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350202.114879:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659614848:12345-0@lo:400:kworker.0 Request processed in 98us (14145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350202.114887:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783350202.114913:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783350202.114918:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659615104:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783350202.114942:0:22665:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:1.0:1783350202.114979:0:22665:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd05e6ae1590e3ca7 00000004:00100000:1.0:1783350202.114996:0:22665:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783350202.115031:0:22665:0:(import.c:65:import_set_state_nolock()) ffff8ea243526000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783350202.115074:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869977659615104:12345-0@lo:38:llog_process_th.0 Request processed in 154us (10739us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350202.115081:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783350202.115214:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea36d775180 x1869977659615104/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350202.115226:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783350202.115234:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1783350202.115257:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783350202.115263:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783350202.115265:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea3497b8000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783350202.115272:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869977659615104:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783350202.115338:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea36d775500 x1869977659614848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350202.115348:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659614848:0@lo:400:kworker.0 00000040:00080000:3.0:1783350202.116894:0:24195:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1783350202.117403:0:24168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783350202.117437:0:24168:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783350202.117485:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e400/0xd05e6ae1590e3c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c7d expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350202.117497:0:24168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e400/0xd05e6ae1590e3c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3c7d expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783350202.117547:0:24168:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783350202.117550:0:24168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783350202.117551:0:24168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350202.117552:0:24168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350202.117553:0:24168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350202.117554:0:24168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350202.117556:0:24168:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783350202.117558:0:24168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350202.117559:0:24168:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783350202.117562:0:24168:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783350202.117564:0:24168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783350202.117565:0:24168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783350202.117566:0:24168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350202.117567:0:24168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350202.117568:0:24168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350202.117569:0:24168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350202.117570:0:24168:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783350202.117571:0:24168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350202.117572:0:24168:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783350202.117594:0:24168:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783350202.117612:0:24168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659615232:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783350202.117671:0:24168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350202.117717:0:24168:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1783350202.117974:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659615232 00000100:00100000:0.0:1783350202.117982:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659615232 00000100:00100000:0.0:1783350202.118039:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783350202.118049:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24168:x1869977659615232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783350202.118084:0:22658:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783350202.118097:0:22658:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1783350202.118476:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1783350202.134768:0:22658:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783350202.134788:0:22658:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783350202.134825:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783350202.134843:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783350202.134865:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350202.134883:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3bf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bf1 expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350202.134891:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3bff expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350202.134898:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350202.134936:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3bff expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350202.134949:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3c06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bff expref: 21 pid: 22657 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350202.134963:0:22680:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659615360:0@lo:104: 00000100:00100000:2.0:1783350202.135025:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783350202.135080:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3bf1 expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350202.135103:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bf1 expref: 21 pid: 22659 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350202.135111:0:22680:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659615488:0@lo:104: 00000100:00100000:1.0:1783350202.135214:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659615360 00000100:00100000:1.0:1783350202.135221:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659615360 00000100:00100000:1.0:1783350202.135285:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783350202.135295:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659615360:12345-0@lo:104: 00010000:00010000:1.0:1783350202.135308:0:22649:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.135360:0:22649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783350202.135366:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659615360:12345-0@lo:104: Request processed in 74us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350202.135373:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1783350202.135396:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350202.135402:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.135410:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fe00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350202.135414:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.135422:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783350202.135429:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350202.135447:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783350202.135475:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.135481:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783350202.135500:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.135508:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e3bff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c06 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.135520:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350202.135522:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350202.135524:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350202.135546:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659615616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350202.135774:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350202.135826:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659615616 00000100:00100000:1.0:1783350202.135830:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659615616 00010000:00010000:1.0:1783350202.135847:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3c06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bff expref: 22 pid: 22657 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350202.135950:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350202.135975:0:22680:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1783350202.135983:0:22648:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783350202.135996:0:22680:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659615360:0@lo:104: 00000100:00100000:3.0:1783350202.136005:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659615488 00000100:00100000:3.0:1783350202.136010:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659615488 00000100:00100000:1.0:1783350202.136178:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783350202.136186:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:3646:x1869977659615616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350202.136226:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350202.136234:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3c06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bff expref: 22 pid: 22657 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350202.136345:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783350202.136352:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37dfae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659615488:12345-0@lo:104: 00010000:00010000:3.0:1783350202.136361:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.136414:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783350202.136422:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37dfae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659615488:12345-0@lo:104: Request processed in 70us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350202.136429:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783350202.136470:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350202.136475:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.136482:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3429f0000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:3.0:1783350202.136492:0:22654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.136501:0:22654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783350202.136508:0:22654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350202.136512:0:22654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783350202.136545:0:22654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.136551:0:22654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783350202.136566:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.136573:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e3bf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3bf8 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.136586:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350202.136588:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350202.136590:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350202.136734:0:22680:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659615488:0@lo:104: 00010000:00010000:2.0:1783350202.136761:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350202.136848:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24168:x1869977659615232:12345-0@lo:253:mount.lustre.0 Request processed in 18800us (19175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350202.136858:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1783350202.137057:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bff expref: 21 pid: 22657 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.137080:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e3c06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3bff expref: 21 pid: 22657 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.137093:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350202.137126:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:3646:x1869977659615616:12345-0@lo:103:ldlm_bl.0 Request processed in 941us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350202.137162:0:24168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24168:1869977659615232:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783350202.137175:0:24168:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783350202.137179:0:24168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783350202.137180:0:24168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783350202.137181:0:24168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350202.137182:0:24168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350202.137184:0:24168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350202.137185:0:24168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350202.137187:0:24168:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783350202.137189:0:24168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350202.137191:0:24168:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783350202.137204:0:24168:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1783350202.137207:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659615744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350202.137334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350202.137660:0:22652:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1783350202.137735:0:22652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1783350202.138330:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783350202.138354:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659615744 00000100:00100000:1.0:1783350202.138360:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659615744 00010000:00010000:1.0:1783350202.138382:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bf1 expref: 20 pid: 22659 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350202.138410:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783350202.138417:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea357eea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:3647:x1869977659615744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350202.138429:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350202.138434:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bf1 expref: 20 pid: 22659 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.138443:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3bf1 expref: 20 pid: 22659 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.138456:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3bf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3bf1 expref: 20 pid: 22659 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.138469:0:22651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.138477:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783350202.138502:0:22651:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003659651s 00010000:00010000:1.0:1783350202.138506:0:22651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.138513:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.138520:0:22651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.138526:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.138532:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fa00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350202.138535:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.138542:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.138557:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.138975:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.138985:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350202.138997:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e3cae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350202.139318:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350202.139373:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea357eea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:3647:x1869977659615744:12345-0@lo:103:ldlm_bl.0 Request processed in 955us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350202.139381:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783350202.139633:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659615616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783350202.139775:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659615744:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1783350202.141536:0:24168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1783350202.145377:0:24168:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783350202.145389:0:24168:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783350202.145426:0:24168:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783350202.145482:0:24168:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783350202.145502:0:24168:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783350202.145521:0:24168:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1783350202.149000:0:24168:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783350202.149802:0:24168:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783350203.147511:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783350203.191638:0:24250:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783350203.192015:0:24250:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1783350203.718719:0:22662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783350203.718728:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea36d918800 from 13 10000000:01000000:1.0:1783350203.718733:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783350203.718791:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350203.718803:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350203.718814:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350203.718840:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659615872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783350203.718909:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350203.722612:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4480 going to sleep for 11 seconds 00000100:00100000:0.0:1783350203.728062:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659615872 00000100:00100000:0.0:1783350203.728077:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659615872 00000100:00100000:0.0:1783350203.728154:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783350203.728165:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+19:22662:x1869977659615872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783350203.728182:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350203.728200:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3780ae200/0xd05e6ae1590e3cbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3cb5 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350203.728238:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3780ae200/0xd05e6ae1590e3cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3cb5 expref: 20 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350203.728264:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3780ae200/0xd05e6ae1590e3cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3cb5 expref: 20 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350203.728274:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3780ae200, rc 0) 00000100:00100000:0.0:1783350203.728344:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:22662:x1869977659615872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (9435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350203.728351:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783350203.728403:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659615872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783350203.728419:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350203.728427:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350203.730009:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659616000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783350203.730065:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350203.730169:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f0fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783350203.745289:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659616000 00000100:00100000:3.0:1783350203.745307:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659616000 00000100:00100000:3.0:1783350203.745376:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783350203.745386:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:22662:x1869977659616000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783350203.745413:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783350203.745434:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783350203.745437:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1783350203.745696:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:22662:x1869977659616000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 311us (15629us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350203.745705:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783350203.745797:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659616000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783350203.745865:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783350203.745875:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350203.745885:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350203.745896:0:22662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783350203.745899:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea37464f800 from 13 10000000:01000000:1.0:1783350203.745902:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783350203.745928:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350203.745936:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350203.745945:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350203.745973:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659616128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783350203.746008:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350203.746042:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783350203.747562:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659616128 00000100:00100000:3.0:1783350203.747574:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659616128 00000100:00100000:3.0:1783350203.747628:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783350203.747637:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:22662:x1869977659616128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350203.747650:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350203.747666:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3cca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3cc3 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350203.747691:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3cc3 expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350203.747718:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3cc3 expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350203.747728:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd000, rc 0) 00000100:00100000:3.0:1783350203.748236:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:22662:x1869977659616128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 589us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350203.748245:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783350203.752766:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659616128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350203.752795:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350203.752807:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350203.752886:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659616256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783350203.752953:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350203.752993:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea375e26840 going to sleep for 11 seconds 00000100:00100000:3.0:1783350203.753070:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659616256 00000100:00100000:3.0:1783350203.753078:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659616256 00000100:00100000:3.0:1783350203.753132:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783350203.753169:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:22662:x1869977659616256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783350203.753190:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783350203.753207:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783350203.753210:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1783350203.753308:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:22662:x1869977659616256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350203.753317:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783350203.754104:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659616256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783350203.754183:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783350203.754192:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350203.754208:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350204.165348:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783350204.487340:0:22698:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783350205.191526:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350206.220522:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350206.852310:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659616384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783350206.852380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350206.852592:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659616384 00000100:00100000:3.0:1783350206.852600:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659616384 00000100:00100000:3.0:1783350206.852642:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783350206.852650:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659616384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783350206.852684:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783350206.852806:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659616384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350206.852813:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783350206.852868:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659616384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783350206.853071:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659616512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783350206.853101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350206.853271:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659616512 00000100:00100000:1.0:1783350206.853275:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659616512 00000100:00100000:1.0:1783350206.853305:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783350206.853316:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659616512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783350206.853336:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783350206.853383:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659616512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350206.853389:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783350206.853454:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659616512:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783350207.238316:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783350207.367051:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350207.367058:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350207.367061:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350207.367064:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350207.367087:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350207.367090:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350207.367092:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350207.367103:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783350207.367161:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659616768:0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.367289:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659616640:0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.367355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350207.367393:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659617152:0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.367420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350207.367474:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659616640 00000100:00100000:0.0:1783350207.367481:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659616640 00000100:00100000:0.0:1783350207.367523:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783350207.367531:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:3646:x1869977659616640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.367603:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:3646:x1869977659616640:12345-0@lo:400:kworker.0 Request processed in 58us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350207.367612:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783350207.367662:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659616640:0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.367712:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659617024:0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.367740:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350207.367759:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783350207.367764:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659616896:0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.367783:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350207.367798:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659617408:0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.367821:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350207.367849:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659617024 00000100:00100000:0.0:1783350207.367853:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659617024 00000100:00100000:0.0:1783350207.367877:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783350207.367884:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659617024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.367921:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659617024:12345-0@lo:400:kworker.0 Request processed in 38us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350207.367926:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783350207.367952:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659617024:0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.367977:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659617152 00000100:00100000:0.0:1783350207.367981:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659617152 00000100:00100000:0.0:1783350207.367996:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659616896 00000100:00100000:0.0:1783350207.367998:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659616896 00000100:00100000:0.0:1783350207.368007:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659617408 00000100:00100000:0.0:1783350207.368010:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659617408 00000100:00100000:0.0:1783350207.368029:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783350207.368044:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659617152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.368080:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659617152:12345-0@lo:400:kworker.0 Request processed in 37us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350207.368086:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783350207.368097:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783350207.368102:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659616896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.368130:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659616896:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350207.368159:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783350207.368170:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783350207.368176:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659617408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.368222:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659617408:12345-0@lo:400:kworker.0 Request processed in 47us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350207.368228:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1783350207.368256:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783350207.368274:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36d739180 x1869977659616896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350207.368285:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659616896:0@lo:400:kworker.0 00010000:00080000:0.0:1783350207.368294:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5c9880 x1869977659617408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350207.368302:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659617408:0@lo:400:kworker.0 00010000:00080000:0.0:1783350207.368322:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36d739f80 x1869977659617152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350207.368330:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659617152:0@lo:400:kworker.0 00000100:00100000:1.0:1783350207.369124:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350207.369197:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659617280:0@lo:400:kworker.0 00000100:00100000:1.0:1783350207.369234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350207.369271:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659617280 00000100:00100000:1.0:1783350207.369276:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659617280 00000100:00100000:1.0:1783350207.369314:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783350207.369320:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659617280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350207.369358:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659617280:12345-0@lo:400:kworker.0 Request processed in 38us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350207.369364:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1783350207.369383:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783350207.369401:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5c8700 x1869977659617280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350207.369411:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659617280:0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.369755:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659616768 00000100:00100000:0.0:1783350207.369760:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659616768 00000100:00100000:0.0:1783350207.369799:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783350207.369806:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659616768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350207.369846:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659616768:12345-0@lo:400:kworker.0 Request processed in 40us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350207.369853:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783350207.369942:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659616768:0@lo:400:kworker.0 00010000:00010000:1.0:1783350208.262856:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783350208.617454:0:24541:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1783350208.836832:0:23421:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783350209.293912:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783350209.692565:0:24593:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783350209.697840:0:24593:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783350210.314656:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783350210.621903:0:24644:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783350210.625490:0:24644:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783350211.332267:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350196/real 1783350196] req@ffff8ea36d739880 x1869977659610880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350211.332298:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea36d739880 x1869977659610880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350211 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350211.332308:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350196/real 1783350196] req@ffff8ea36d738a80 x1869977659611008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350211.332317:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea36d738a80 x1869977659611008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350211 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783350211.332336:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243527000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350211.332353:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783350211.332357:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659610880:0@lo:8:kworker.0 00000100:00080000:2.0:1783350211.332362:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea370da1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350211.332367:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783350211.332370:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659611008:0@lo:8:kworker.0 00000100:00100000:0.0:1783350211.332645:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659617536:0@lo:400:kworker.0 00000100:00100000:0.0:1783350211.332718:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783350211.332724:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783350211.332818:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350211.332823:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350211.332826:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350211.332829:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783350211.332837:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659617664:0@lo:400:kworker.0 00000100:00100000:3.0:1783350211.332876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350211.332895:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659617536 00000100:00100000:3.0:1783350211.332904:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783350211.332904:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659617536 00000100:00100000:3.0:1783350211.332911:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659617792:0@lo:400:kworker.0 00000100:00100000:3.0:1783350211.332945:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350211.332987:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783350211.332996:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:3649:x1869977659617536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350211.333004:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659617792 00000100:00100000:3.0:1783350211.333014:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659617792 00000100:00100000:3.0:1783350211.333050:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783350211.333058:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659617792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350211.333097:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659617792:12345-0@lo:400:kworker.0 Request processed in 39us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350211.333103:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783350211.333126:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659617920:0@lo:400:kworker.0 00000100:00100000:3.0:1783350211.333185:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350211.333215:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659617664 00000100:00100000:3.0:1783350211.333219:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659617664 00000100:00100000:3.0:1783350211.333241:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659617920 00000100:00100000:3.0:1783350211.333244:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659617920 00000100:00100000:3.0:1783350211.333259:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783350211.333265:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659617664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350211.333306:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659617664:12345-0@lo:400:kworker.0 Request processed in 40us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350211.333312:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783350211.333325:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783350211.333331:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659617920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350211.333362:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659617920:12345-0@lo:400:kworker.0 Request processed in 32us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350211.333368:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783350211.333411:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659617920:0@lo:400:kworker.0 00010000:00080000:3.0:1783350211.333437:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5c8380 x1869977659617792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350211.333447:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659617792:0@lo:400:kworker.0 00000100:00100000:3.0:1783350211.333456:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659617664:0@lo:400:kworker.0 00000100:00080000:1.0:1783350211.333993:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350211.334006:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783350211.334009:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea243527000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350211.334014:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 637 00000100:00080000:1.0:1783350211.334018:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783350211.334024:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ea243527000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350211.334067:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f5c8000 x1869977659618048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350211.334094:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350211.334098:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783350211.334100:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea370da1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350211.334103:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 637 00000100:00080000:1.0:1783350211.334105:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783350211.334108:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea370da1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350211.334119:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f5c8a80 x1869977659618176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783350211.334715:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:3649:x1869977659617536:12345-0@lo:400:kworker.0 Request processed in 1716us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350211.334725:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783350211.335322:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659618432:0@lo:400:kworker.0 00000100:00100000:0.0:1783350211.335323:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659617536:0@lo:400:kworker.0 00000100:00100000:0.0:1783350211.335344:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659618304:0@lo:400:kworker.0 00000100:00100000:2.0:1783350211.335530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350211.335568:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783350211.335574:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659618560:0@lo:400:kworker.0 00000100:00100000:2.0:1783350211.335600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350211.335622:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659618432 00000100:00100000:1.0:1783350211.335628:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659618432 00000100:00100000:2.0:1783350211.335644:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659618560 00000100:00100000:2.0:1783350211.335648:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659618560 00000100:00100000:1.0:1783350211.335673:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783350211.335681:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659618432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350211.335706:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783350211.335735:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783350211.335739:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783350211.335767:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783350211.335775:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659618560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350211.335874:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659618560:12345-0@lo:400:kworker.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350211.335874:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659618432:12345-0@lo:400:kworker.0 Request processed in 192us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350211.335881:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783350211.335896:0:22666:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783350211.335903:0:22666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783350211.335922:0:22664:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00010000:00080000:0.0:1783350211.335925:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5c8e00 x1869977659618560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350211.335927:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659618304 00000100:00100000:2.0:1783350211.335930:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659618304 00000100:00100000:0.0:1783350211.335936:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659618560:0@lo:400:kworker.0 00010000:00080000:0.0:1783350211.335958:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5c9f80 x1869977659618432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350211.335969:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659618432:0@lo:400:kworker.0 00000100:00100000:1.0:1783350211.336255:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783350211.336267:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783350211.336275:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659618304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350211.336328:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659618304:12345-0@lo:400:kworker.0 Request processed in 55us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350211.336335:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1783350211.336349:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5ca680 x1869977659618304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350211.336370:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659618304:0@lo:400:kworker.0 00000100:00100000:3.0:1783350211.340734:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659618048:0@lo:8:kworker.0 00000100:00100000:3.0:1783350211.340829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350211.340886:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659618176:0@lo:8:kworker.0 00000100:00100000:3.0:1783350211.340909:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350211.341126:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659618048 00000100:00100000:0.0:1783350211.341134:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659618048 00000100:00100000:0.0:1783350211.341521:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659618176 00000100:00100000:0.0:1783350211.341526:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659618176 00000100:00100000:0.0:1783350211.341543:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783350211.341549:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1869977659618048:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783350211.341576:0:24174:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:0.0:1783350211.341611:0:24174:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e3cd1 00002000:00100000:0.0:1783350211.341625:0:24174:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ea367c6a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1783350211.341628:0:24174:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1783350211.341630:0:24174:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783350211.341788:0:24174:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1783350211.341811:0:24174:0:(import.c:65:import_set_state_nolock()) ffff8ea367c6e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783350211.341881:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1869977659618048:12345-0@lo:8:kworker.0 Request processed in 329us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350211.341889:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783350211.341909:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783350211.341916:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869977659618176:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783350211.341931:0:24173:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1783350211.341984:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5c8000 x1869977659618048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783350231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350211.341996:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783350211.342005:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1783350211.342012:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783350211.342017:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783350211.342019:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243527000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783350211.342045:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000004:00080000:0.0:1783350211.342107:0:23406:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783350211.342212:0:23406:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 652137074924ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783350211.342219:0:23406:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1783350211.342783:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659618048:0@lo:8:kworker.0 00000100:00100000:0.0:1783350211.345449:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659618688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783350211.345527:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783350211.345599:0:23407:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1783350211.345629:0:23407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1869977659618816:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1783350211.345658:0:23407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350211.345675:0:23407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19900 going to sleep for 11 seconds 00000100:00100000:3.0:1783350211.345709:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659618688 00000100:00100000:3.0:1783350211.345717:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659618688 00000100:00100000:3.0:1783350211.345771:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783350211.345794:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869977659618688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783350211.345822:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783350211.346010:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869977659618688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 217us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350211.346017:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783350211.346050:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783350211.346055:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1783350211.346070:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350211.346209:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659618816 00000100:00100000:3.0:1783350211.346213:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659618816 00000100:00100000:3.0:1783350211.348056:0:24664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783350211.348074:0:24664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23407:x1869977659618816:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:0.0:1783350211.355126:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36d775500 x1869977659618688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783350227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350211.355366:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659618688:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1783350211.374133:0:24664:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783350211.374182:0:24664:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1783350211.374282:0:24664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23407:x1869977659618816:12345-0@lo:7:osp-pre-0-1.0 Request processed in 26211us (28619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350211.374305:0:24664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783350211.377709:0:23407:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36d775180 x1869977659618816/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783350227 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350211.377728:0:23407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1869977659618816:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1783350211.377743:0:23407:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1783350211.377788:0:23407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1869977659618944:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1783350211.377850:0:23407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350211.377889:0:23407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19900 going to sleep for 11 seconds 00000100:00100000:0.0:1783350211.377940:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659618944 00000100:00100000:0.0:1783350211.377950:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659618944 00000100:00100000:0.0:1783350211.378008:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783350211.378017:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23407:x1869977659618944:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1783350211.378045:0:24175:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1783350211.378087:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23407:x1869977659618944:12345-0@lo:5:osp-pre-0-1.0 Request processed in 71us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350211.378095:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783350211.379426:0:23407:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36d775180 x1869977659618944/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783350227 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350211.379443:0:23407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1869977659618944:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1783350211.379454:0:23407:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1783350211.379494:0:23407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1869977659619072:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1783350211.379536:0:23407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350211.379563:0:23407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19900 going to sleep for 11 seconds 00000100:00100000:3.0:1783350211.379582:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659619072 00000100:00100000:3.0:1783350211.379586:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659619072 00000100:00100000:3.0:1783350211.379636:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783350211.379644:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23407:x1869977659619072:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1783350211.379697:0:24174:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:0.0:1783350211.381882:0:23397:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1783350211.395587:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869977659618176:12345-0@lo:8:kworker.0 Request processed in 53662us (54668us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783350211.395601:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783350211.396341:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea370da1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350211.396349:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783350211.396353:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659618176:0@lo:8:kworker.0 00000001:00080000:1.0:1783350211.422318:0:24169:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1783350211.422336:0:24169:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1783350211.427741:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23407:x1869977659619072:12345-0@lo:5:osp-pre-0-1.0 Request processed in 48087us (48194us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1783350211.427757:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783350211.427865:0:23407:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36d775180 x1869977659619072/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783350227 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350211.427881:0:23407:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1783350211.427888:0:23407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1869977659619072:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1783350211.427904:0:23407:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1783350211.427970:0:23407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23407:1869977659619200:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1783350211.428006:0:23407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350211.428036:0:23407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc1f300 going to sleep for 11 seconds 00000100:00100000:2.0:1783350211.428245:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659619200 00000100:00100000:2.0:1783350211.428252:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659619200 00000100:00100000:2.0:1783350211.428291:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783350211.428300:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23407:x1869977659619200:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1783350211.428345:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23407:x1869977659619200:12345-0@lo:900:osp-pre-0-1.0 Request processed in 47us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350211.428351:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783350211.428423:0:23407:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5cad80 x1869977659619200/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783350227 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350211.428433:0:23407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23407:1869977659619200:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1783350211.973905:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659619328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350211.974911:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350211.974989:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659619328 00000100:00100000:2.0:1783350211.974998:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659619328 00000100:00100000:2.0:1783350211.975044:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783350211.975052:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659619328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783350211.975085:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783350211.975300:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659619328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 248us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350211.975307:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783350211.975354:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659619328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350211.975757:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783350211.975769:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659619456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350211.978727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350211.978915:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659619456 00000100:00100000:3.0:1783350211.978926:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659619456 00000100:00100000:3.0:1783350211.978988:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783350211.978997:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659619456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783350211.979032:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783350211.979078:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659619456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350211.979086:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783350211.981682:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659619456:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783350212.357854:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350213.380767:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350214.411021:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783350214.729091:0:22698:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783350215.428408:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350216.459481:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783350216.580676:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350216.580683:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350216.580686:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350216.580689:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350216.580709:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350216.580712:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783350216.580715:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea370da1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783350216.580723:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 652 00000100:00080000:3.0:1783350216.580729:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783350216.580737:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea370da1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350216.580757:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244525500 x1869977659620224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350216.580979:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659619584:0@lo:400:kworker.0 00000100:00100000:3.0:1783350216.581049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350216.581092:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659620096:0@lo:400:kworker.0 00000100:00100000:3.0:1783350216.581123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350216.581179:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783350216.581185:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659619968:0@lo:400:kworker.0 00000100:00100000:3.0:1783350216.581208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350216.581226:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659620608:0@lo:400:kworker.0 00000100:00100000:3.0:1783350216.581247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350216.581274:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659619712:0@lo:400:kworker.0 00000100:00100000:3.0:1783350216.581295:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350216.581311:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659620352:0@lo:400:kworker.0 00000100:00100000:1.0:1783350216.581693:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659620224:0@lo:8:kworker.0 00000100:00100000:1.0:1783350216.581731:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350216.581768:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659620608 00000100:00100000:1.0:1783350216.581776:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659620608 00000100:00100000:1.0:1783350216.581825:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783350216.581834:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659620608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350216.581883:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659620608:12345-0@lo:400:kworker.0 Request processed in 50us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350216.581901:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1783350216.581921:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783350216.581949:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea244526d80 x1869977659620608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350216.581963:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659620608:0@lo:400:kworker.0 00000100:00100000:3.0:1783350216.582053:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350216.582112:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783350216.582120:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659619840:0@lo:400:kworker.0 00000100:00100000:3.0:1783350216.582174:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350216.582254:0:24664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659620096 00000100:00100000:0.0:1783350216.582259:0:24664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659620096 00000100:00100000:0.0:1783350216.582292:0:24664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659620224 00000100:00100000:0.0:1783350216.582295:0:24664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659620224 00000100:00100000:0.0:1783350216.582313:0:24664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783350216.582321:0:24664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659620096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350216.582483:0:24664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659620096:12345-0@lo:400:kworker.0 Request processed in 163us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350216.582500:0:24664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783350216.582516:0:24664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783350216.582520:0:24664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1869977659620224:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783350216.582538:0:24664:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783350216.582572:0:24664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1869977659620224:12345-0@lo:8:kworker.0 Request processed in 50us (840us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783350216.582578:0:24664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783350216.582596:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783350216.582615:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea370da1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350216.582619:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783350216.582623:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659620224:0@lo:8:kworker.0 00010000:00080000:0.0:1783350216.582646:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea244524380 x1869977659620096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783350232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350216.582656:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659620096:0@lo:400:kworker.0 00000100:00100000:0.0:1783350216.582708:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783350216.582717:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659620736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783350216.582743:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350216.582773:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659620736 00000100:00100000:0.0:1783350216.582776:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659620736 00000100:00100000:0.0:1783350216.582803:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350216.582810:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659620736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783350216.582828:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783350216.582861:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659620736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350216.582878:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783350216.582907:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea244777b80 x1869977659620736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783350232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350216.582920:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659620736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783350216.591151:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659620480:0@lo:400:kworker.0 00000100:00100000:3.0:1783350216.591212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350216.591415:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659619584 00000100:00100000:2.0:1783350216.591424:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659619584 00000100:00100000:2.0:1783350216.591471:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783350216.591480:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:3647:x1869977659619584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350216.591537:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:3647:x1869977659619584:12345-0@lo:400:kworker.0 Request processed in 58us (10487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350216.591545:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783350216.591591:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659619968 00000100:00100000:2.0:1783350216.591595:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659619968 00000100:00100000:2.0:1783350216.591618:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659619712 00000100:00100000:2.0:1783350216.591621:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659619712 00000100:00100000:2.0:1783350216.591634:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783350216.591640:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659619968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350216.591677:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659619968:12345-0@lo:400:kworker.0 Request processed in 36us (10467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350216.591682:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783350216.591693:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783350216.591705:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659619712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350216.591735:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659619712:12345-0@lo:400:kworker.0 Request processed in 31us (10439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350216.591740:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783350216.593533:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659620352 00000100:00100000:1.0:1783350216.593545:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659620352 00000100:00100000:1.0:1783350216.593598:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659619840 00000100:00100000:1.0:1783350216.593601:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659619840 00000100:00100000:1.0:1783350216.593620:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783350216.593627:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659620352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350216.593699:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659620352:12345-0@lo:400:kworker.0 Request processed in 71us (12367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350216.593705:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783350216.593720:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783350216.593726:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659619840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350216.593751:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659619840:12345-0@lo:400:kworker.0 Request processed in 26us (11576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350216.593756:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783350216.597270:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659619968:0@lo:400:kworker.0 00000100:00100000:1.0:1783350216.597287:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659619584:0@lo:400:kworker.0 00000100:00100000:3.0:1783350216.604460:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659619712:0@lo:400:kworker.0 00010000:00080000:3.0:1783350216.604483:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea244525f80 x1869977659620352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350216.604495:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659620352:0@lo:400:kworker.0 00010000:00080000:3.0:1783350216.604523:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea244527800 x1869977659619840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350216.604541:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659619840:0@lo:400:kworker.0 00000100:00100000:2.0:1783350216.604784:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659620480 00000100:00100000:2.0:1783350216.604791:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659620480 00000100:00100000:2.0:1783350216.604855:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783350216.604865:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659620480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350216.604946:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659620480:12345-0@lo:400:kworker.0 Request processed in 83us (13734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350216.604953:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1783350216.605598:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783350216.605630:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea244525180 x1869977659620480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350216.605643:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659620480:0@lo:400:kworker.0 00000100:00100000:1.0:1783350217.093532:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783350217.093566:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659620864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783350217.093636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350217.093687:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659620864 00000100:00100000:1.0:1783350217.093695:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659620864 00000100:00100000:1.0:1783350217.093740:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783350217.093749:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659620864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783350217.093783:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783350217.093826:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659620864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350217.093834:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783350217.093879:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659620864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350217.098545:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659620992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350217.098682:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350217.098761:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659620992 00000100:00100000:3.0:1783350217.098768:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659620992 00000100:00100000:3.0:1783350217.098822:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783350217.098831:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659620992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783350217.098866:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783350217.101737:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659620992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2900us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.101752:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783350217.105673:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659620992:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783350217.476295:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350217.604234:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350197/real 1783350197] req@ffff8ea36d738700 x1869977659611520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350217 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350217.604267:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea36d738700 x1869977659611520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350217 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350217.604276:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350197/real 1783350197] req@ffff8ea36d738380 x1869977659611648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350217 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350217.604287:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea36d738380 x1869977659611648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350217 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783350217.604304:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea357ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350217.604321:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783350217.604325:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659611520:0@lo:8:kworker.0 00000100:00080000:0.0:1783350217.604331:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24271b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350217.604336:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783350217.604339:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659611648:0@lo:8:kworker.0 00000100:00080000:1.0:1783350217.604617:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350217.604621:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783350217.604624:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea357ed8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350217.604629:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:1.0:1783350217.604634:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783350217.604640:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ea357ed8000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350217.604659:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f5ca300 x1869977659621376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350217.604675:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350217.604678:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1783350217.604894:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659621120:0@lo:400:kworker.0 00000100:00100000:0.0:1783350217.604955:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350217.604996:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783350217.605002:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659621248:0@lo:400:kworker.0 00000100:00100000:0.0:1783350217.605045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350217.605075:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659621120 00000100:00100000:0.0:1783350217.605082:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659621120 00000100:00100000:0.0:1783350217.605165:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783350217.605175:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:3646:x1869977659621120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350217.605225:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:3646:x1869977659621120:12345-0@lo:400:kworker.0 Request processed in 51us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350217.605233:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783350217.605276:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659621120:0@lo:400:kworker.0 00000100:00080000:1.0:1783350217.605703:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea24271b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350217.605709:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:1.0:1783350217.605712:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783350217.605717:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ea24271b000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350217.605738:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f5c9500 x1869977659621504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350217.606028:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350217.606032:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783350217.606034:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea370da1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350217.606038:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 657 00000100:00080000:1.0:1783350217.606041:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783350217.606045:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea370da1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350217.606057:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f5c9f80 x1869977659622016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783350217.606098:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659621248 00000100:00100000:1.0:1783350217.606194:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659621248 00000100:00100000:1.0:1783350217.606230:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783350217.606238:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659621248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350217.606291:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659621248:12345-0@lo:400:kworker.0 Request processed in 53us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350217.606298:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783350217.606325:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659621376:0@lo:8:kworker.0 00000100:00100000:3.0:1783350217.606458:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659621632:0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.606491:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350217.606513:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659622272:0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.606541:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350217.606564:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783350217.606569:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659621760:0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.606590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350217.606605:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659622400:0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.606622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350217.606648:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659621632 00000100:00100000:3.0:1783350217.606660:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659621632 00000100:00100000:3.0:1783350217.606893:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659622272 00000100:00100000:3.0:1783350217.606897:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659622272 00000100:00100000:3.0:1783350217.606913:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659622400 00000100:00100000:3.0:1783350217.606915:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659622400 00000100:00100000:3.0:1783350217.606926:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783350217.606931:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659621632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.606970:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659621632:12345-0@lo:400:kworker.0 Request processed in 38us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.606976:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783350217.606989:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783350217.606994:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659622272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.607020:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659622272:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.607025:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783350217.607036:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783350217.607043:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659622400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.607066:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659622400:12345-0@lo:400:kworker.0 Request processed in 24us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.607072:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783350217.607089:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659621760 00000100:00100000:3.0:1783350217.607092:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659621760 00000100:00100000:3.0:1783350217.607159:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783350217.607167:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659621760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.607196:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659621760:12345-0@lo:400:kworker.0 Request processed in 30us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.607202:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783350217.607231:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659622144:0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.607258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350217.607276:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783350217.607281:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659621888:0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.607303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350217.607329:0:24664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659621888 00000100:00100000:3.0:1783350217.607333:0:24664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659621888 00000100:00100000:3.0:1783350217.607370:0:24664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783350217.607375:0:24664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659621888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.607408:0:24664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659621888:12345-0@lo:400:kworker.0 Request processed in 33us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.607414:0:24664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783350217.607446:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5ca680 x1869977659621888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783350233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350217.607463:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659621888:0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.607489:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659621760:0@lo:400:kworker.0 00010000:00080000:3.0:1783350217.607499:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5c9c00 x1869977659622400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350217.607506:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659622400:0@lo:400:kworker.0 00010000:00080000:3.0:1783350217.607515:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5c8a80 x1869977659621632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350217.607522:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659621632:0@lo:400:kworker.0 00010000:00080000:3.0:1783350217.607544:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5c8700 x1869977659622272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350217.607564:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659622272:0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.607587:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659622144 00000100:00100000:3.0:1783350217.607590:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659622144 00000100:00100000:3.0:1783350217.607611:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783350217.607616:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659622144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350217.607649:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659622144:12345-0@lo:400:kworker.0 Request processed in 32us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.607655:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1783350217.607678:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5c8e00 x1869977659622144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350217.608209:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350217.608246:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659621504:0@lo:8:kworker.0 00000100:00100000:1.0:1783350217.608271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350217.608289:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659622016:0@lo:8:kworker.0 00000100:00100000:1.0:1783350217.608308:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350217.608573:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659621248:0@lo:400:kworker.0 00000100:00100000:1.0:1783350217.609289:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659621376 00000100:00100000:1.0:1783350217.609298:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659621376 00000100:00100000:1.0:1783350217.609332:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659621504 00000100:00100000:1.0:1783350217.609335:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659621504 00000100:00100000:1.0:1783350217.609430:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659622016 00000100:00100000:1.0:1783350217.609487:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659622016 00000100:00100000:1.0:1783350217.609504:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783350217.609510:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1869977659621376:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1783350217.609643:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783350217.609648:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869977659621504:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783350217.609660:0:24173:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783350217.609734:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869977659621504:12345-0@lo:8:kworker.0 Request processed in 84us (1462us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783350217.609741:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783350217.609765:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783350217.609769:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869977659622016:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783350217.609779:0:24173:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783350217.609802:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869977659622016:12345-0@lo:8:kworker.0 Request processed in 32us (1493us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783350217.609808:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1783350217.610337:0:24174:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:1.0:1783350217.610972:0:24174:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e3cd8 00002000:00100000:1.0:1783350217.610988:0:24174:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ea37e56e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783350217.610993:0:24174:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783350217.610995:0:24174:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783350217.611073:0:24174:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783350217.611098:0:24174:0:(import.c:65:import_set_state_nolock()) ffff8ea37e56b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783350217.611218:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659622144:0@lo:400:kworker.0 00000100:00100000:1.0:1783350217.611599:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1869977659621376:12345-0@lo:8:kworker.0 Request processed in 2019us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350217.611610:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783350217.611658:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f5ca300 x1869977659621376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783350242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350217.611667:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783350217.611673:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1783350217.611996:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783350217.612003:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783350217.612006:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea357ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783350217.612026:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783350217.612033:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659621376:0@lo:8:kworker.0 00000004:00080000:1.0:1783350217.612059:0:22688:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783350217.612164:0:22688:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 658407027060ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783350217.612171:0:22688:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1783350217.615219:0:22689:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:3.0:1783350217.615250:0:22689:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1869977659622656:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783350217.615318:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350217.615345:0:22689:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea35931a240 going to sleep for 11 seconds 00000100:00100000:3.0:1783350217.615366:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659622656 00000100:00100000:3.0:1783350217.615373:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659622656 00000100:00100000:3.0:1783350217.615427:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783350217.615448:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22689:x1869977659622656:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1783350217.615640:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350217.615655:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783350217.615666:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659622528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783350217.616039:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350217.616070:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659622528 00000100:00100000:3.0:1783350217.616079:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659622528 00000100:00100000:3.0:1783350217.616629:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783350217.616640:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1869977659622528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783350217.616661:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783350217.616982:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1869977659622528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 342us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.616990:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783350217.617041:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24271b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350217.617046:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783350217.617050:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659621504:0@lo:8:kworker.0 00000100:00080000:3.0:1783350217.617062:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea370da1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350217.617065:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783350217.617068:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659622016:0@lo:8:kworker.0 00010000:00080000:1.0:1783350217.617480:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea244524e00 x1869977659622528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783350233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350217.617508:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659622528:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1783350217.620223:0:22645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1783350217.624549:0:24173:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1783350217.624560:0:24173:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1783350217.624566:0:24173:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:3.0:1783350217.639524:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350217.639537:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e72f485/0xd05e6ae1590e3cdf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.639559:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=658s v=(0 0) 00010000:00010000:3.0:1783350217.639564:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350217.639571:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e72f485/0xd05e6ae1590e3cdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.639588:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e72f485/0xd05e6ae1590e3cdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.639605:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e72f485/0xd05e6ae1590e3cdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.639614:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e72f485/0xd05e6ae1590e3cdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.639645:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350217.639716:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.639724:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e72f485/0xd05e6ae1590e3cdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.639734:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.639738:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e72f485/0xd05e6ae1590e3cdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.639746:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e72f485/0xd05e6ae1590e3cdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.639776:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e72f485/0xd05e6ae1590e3cdf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.639784:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e72f485/0xd05e6ae1590e3cdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.639800:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.639802:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.639804:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350217.641597:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350217.641610:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3ce6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.641623:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=658s v=(0 0) 00010000:00010000:3.0:1783350217.641629:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350217.641634:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.641646:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.641655:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.641662:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.641900:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783350217.642509:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350217.642517:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3ced lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642529:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=658s v=(0 0) 00010000:00010000:3.0:1783350217.642532:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350217.642536:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3ced lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642546:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3ced lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642555:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3ced lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642563:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3ced lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642579:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783350217.642588:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783350217.642592:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642600:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cda00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350217.642610:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642619:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642635:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3ce6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642642:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3ce6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642659:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350217.642663:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3ced lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642669:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350217.642672:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3ced lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642679:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3ced lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642688:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3ced lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642710:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3ced lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.642735:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350217.642737:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350217.642739:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.643556:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.644011:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.644029:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3cf4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644040:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.644044:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.644049:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644060:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644069:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644075:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644099:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783350217.644479:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.644485:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3cfb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644495:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.644498:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.644502:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3cfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644511:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3cfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644524:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3cfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644530:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3cfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644546:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783350217.644556:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783350217.644561:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644568:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780aec00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350217.644572:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644580:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644593:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3cf4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644600:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3cf4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644615:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350217.644624:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3cfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644630:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780afe00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350217.644633:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3cfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644640:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3cfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644648:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3cfb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644655:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3cfb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.644666:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.644668:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.644669:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350217.645164:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.645477:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.645484:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.645494:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.645498:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.645502:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.645524:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.645533:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.645541:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.645568:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350217.646527:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350217.646537:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.646547:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780af200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350217.646551:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.646560:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.646594:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.646601:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.646620:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350217.646622:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350217.646623:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.646978:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.646986:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.646996:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.647000:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.647005:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.647016:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.647025:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.647045:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.647063:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350217.647074:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350217.647078:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.647085:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780af800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350217.647088:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.647097:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.647108:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.647115:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.647240:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.647243:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.647244:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.648803:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.648824:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.648897:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.648902:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.648908:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.648919:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.648929:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.648935:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.648953:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350217.649099:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350217.649108:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.649118:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780af600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350217.649131:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.649158:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.649174:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.649182:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.649215:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350217.649217:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350217.649219:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350217.653072:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350217.653085:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1596922/0xd05e6ae1590e3d17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.653117:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=658s v=(0 0) 00010000:00010000:1.0:1783350217.653978:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350217.653987:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1596922/0xd05e6ae1590e3d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.654004:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1596922/0xd05e6ae1590e3d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.654015:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1596922/0xd05e6ae1590e3d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.654023:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1596922/0xd05e6ae1590e3d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.654051:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350217.654196:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350217.654204:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1596922/0xd05e6ae1590e3d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.654214:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374603000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350217.654219:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1596922/0xd05e6ae1590e3d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.654229:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1596922/0xd05e6ae1590e3d17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.654256:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1596922/0xd05e6ae1590e3d17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.654264:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1596922/0xd05e6ae1590e3d17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.654284:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.654286:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.654288:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.656336:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.656359:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be2923d5/0xd05e6ae1590e3d1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.656373:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.656377:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.656382:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be2923d5/0xd05e6ae1590e3d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.656393:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be2923d5/0xd05e6ae1590e3d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.656403:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be2923d5/0xd05e6ae1590e3d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.656409:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be2923d5/0xd05e6ae1590e3d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.656482:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783350217.656980:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.656987:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000493d357/0xd05e6ae1590e3d25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.656997:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.657000:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.657004:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000493d357/0xd05e6ae1590e3d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.657014:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000493d357/0xd05e6ae1590e3d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.657022:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000493d357/0xd05e6ae1590e3d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.657030:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000493d357/0xd05e6ae1590e3d25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.657066:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783350217.657073:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be2923d5/0xd05e6ae1590e3d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.657081:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780ae800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.657085:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be2923d5/0xd05e6ae1590e3d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.657093:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be2923d5/0xd05e6ae1590e3d1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.657131:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be2923d5/0xd05e6ae1590e3d1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.657171:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be2923d5/0xd05e6ae1590e3d1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.657188:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.657192:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000493d357/0xd05e6ae1590e3d25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.657198:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780aee00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.657203:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000493d357/0xd05e6ae1590e3d25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.657211:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000493d357/0xd05e6ae1590e3d25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.657222:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000493d357/0xd05e6ae1590e3d25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.657231:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.657233:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.657235:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.657537:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783350217.657542:0:24173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000493d357/0xd05e6ae1590e3d25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.658044:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.658175:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.658183:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa8acd51/0xd05e6ae1590e3d2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.658200:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.658203:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.658208:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa8acd51/0xd05e6ae1590e3d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.658219:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa8acd51/0xd05e6ae1590e3d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.658227:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa8acd51/0xd05e6ae1590e3d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.658234:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa8acd51/0xd05e6ae1590e3d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.658253:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350217.658427:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.658432:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa8acd51/0xd05e6ae1590e3d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.658446:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780ae600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.658450:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa8acd51/0xd05e6ae1590e3d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.658458:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa8acd51/0xd05e6ae1590e3d2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.658472:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa8acd51/0xd05e6ae1590e3d2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.658478:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa8acd51/0xd05e6ae1590e3d2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.658491:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.658492:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.658494:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.658932:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.658938:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006245d1e/0xd05e6ae1590e3d33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.658948:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.658951:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.658954:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006245d1e/0xd05e6ae1590e3d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.658964:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006245d1e/0xd05e6ae1590e3d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.658984:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006245d1e/0xd05e6ae1590e3d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.658992:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006245d1e/0xd05e6ae1590e3d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.659040:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783350217.659483:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.659490:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae721234/0xd05e6ae1590e3d3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.659499:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.659502:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.659506:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae721234/0xd05e6ae1590e3d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.659515:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae721234/0xd05e6ae1590e3d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.659522:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae721234/0xd05e6ae1590e3d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.659530:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae721234/0xd05e6ae1590e3d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.660017:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783350217.660024:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006245d1e/0xd05e6ae1590e3d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.660034:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780ae000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.660037:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006245d1e/0xd05e6ae1590e3d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.660046:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006245d1e/0xd05e6ae1590e3d33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.660066:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006245d1e/0xd05e6ae1590e3d33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.660073:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006245d1e/0xd05e6ae1590e3d33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.660091:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.660094:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae721234/0xd05e6ae1590e3d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.660101:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780afa00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.660104:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae721234/0xd05e6ae1590e3d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.660112:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae721234/0xd05e6ae1590e3d3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.660132:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae721234/0xd05e6ae1590e3d3a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.660153:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.660155:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.660157:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.662046:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783350217.662057:0:24173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae721234/0xd05e6ae1590e3d3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783350217.665108:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.665131:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.665181:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.665186:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.665193:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.665207:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.665218:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.665226:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.666987:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.666999:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.667028:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780af800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.667033:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.667044:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.667064:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d41 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.667172:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783350217.667180:0:24173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a325b3d/0xd05e6ae1590e3d41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.667230:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.667233:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.667361:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.667943:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.667951:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3d48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.667963:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.667967:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.667973:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.667986:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.667996:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668003:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668021:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783350217.668501:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.668509:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3d4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668530:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.668534:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.668538:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668548:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668558:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668565:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3d4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668580:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783350217.668591:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783350217.668597:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668604:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780afe00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350217.668608:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668615:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3d48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668645:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3d48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668652:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001a0fd93/0xd05e6ae1590e3d48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668674:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350217.668678:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3d4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668685:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780aec00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350217.668688:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3d4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668697:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3d4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668708:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3d4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668714:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076db7f69/0xd05e6ae1590e3d4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.668734:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.668737:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.668745:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.669328:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.669336:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded8809c/0xd05e6ae1590e3d56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.669405:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.669409:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.669413:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ded8809c/0xd05e6ae1590e3d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.669423:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ded8809c/0xd05e6ae1590e3d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.669431:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded8809c/0xd05e6ae1590e3d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.669438:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ded8809c/0xd05e6ae1590e3d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.669455:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350217.669466:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350217.669471:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ded8809c/0xd05e6ae1590e3d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.669478:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780af000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350217.669482:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ded8809c/0xd05e6ae1590e3d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.669500:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ded8809c/0xd05e6ae1590e3d56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.669514:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ded8809c/0xd05e6ae1590e3d56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.669521:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ded8809c/0xd05e6ae1590e3d56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.669545:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.669548:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.669551:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.670039:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.670046:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de77dee7/0xd05e6ae1590e3d5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.670055:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.670058:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.670062:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de77dee7/0xd05e6ae1590e3d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.670072:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de77dee7/0xd05e6ae1590e3d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.670080:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de77dee7/0xd05e6ae1590e3d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.670093:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de77dee7/0xd05e6ae1590e3d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.670110:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350217.670133:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350217.670155:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de77dee7/0xd05e6ae1590e3d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.670161:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780ae400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350217.670164:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de77dee7/0xd05e6ae1590e3d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.670171:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de77dee7/0xd05e6ae1590e3d5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.670182:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de77dee7/0xd05e6ae1590e3d5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.670189:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de77dee7/0xd05e6ae1590e3d5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.670202:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.670203:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.670205:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.671526:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.671547:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab01f13/0xd05e6ae1590e3d64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.671559:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.671562:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.671567:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dab01f13/0xd05e6ae1590e3d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.671579:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dab01f13/0xd05e6ae1590e3d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.671601:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab01f13/0xd05e6ae1590e3d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.671609:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dab01f13/0xd05e6ae1590e3d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.671629:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350217.671641:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350217.671645:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dab01f13/0xd05e6ae1590e3d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.671651:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780aea00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350217.671655:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab01f13/0xd05e6ae1590e3d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.671663:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab01f13/0xd05e6ae1590e3d64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.671683:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dab01f13/0xd05e6ae1590e3d64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.671691:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dab01f13/0xd05e6ae1590e3d64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.671708:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.671709:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.671711:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.675625:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.675639:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.675961:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.675972:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.675989:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.675993:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.676000:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.676014:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.676025:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.676033:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.676079:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350217.676333:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.676340:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.676417:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780af600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.676421:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.676431:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.676448:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.676467:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a93fc2/0xd05e6ae1590e3d6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.676488:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.676490:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.676492:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.676581:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.676587:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.676596:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.676599:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.676603:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.676613:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.676620:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.676627:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.676678:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350217.676789:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.676795:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.677067:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3780af200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.677071:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.677080:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.677091:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.677099:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3116c08/0xd05e6ae1590e3d72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.677112:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.677114:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.677116:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.677156:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.677162:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3d79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.677170:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.677178:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.677182:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.677196:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.677205:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.677212:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3d79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.677230:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350217.677448:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.677454:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3d79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.677462:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.677466:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3d79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.677473:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3d79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.677483:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3d79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.677489:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3d79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.677500:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.677501:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.677503:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.678616:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.678626:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088750ae2/0xd05e6ae1590e3d80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.678638:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.678641:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.678646:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088750ae2/0xd05e6ae1590e3d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.678656:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088750ae2/0xd05e6ae1590e3d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.678664:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088750ae2/0xd05e6ae1590e3d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.678678:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088750ae2/0xd05e6ae1590e3d80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.679940:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350217.680050:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.680057:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088750ae2/0xd05e6ae1590e3d80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.680068:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808a00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.680073:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088750ae2/0xd05e6ae1590e3d80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.680093:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088750ae2/0xd05e6ae1590e3d80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.680112:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088750ae2/0xd05e6ae1590e3d80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.680119:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088750ae2/0xd05e6ae1590e3d80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.680167:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.680169:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.680172:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.681040:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.681051:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec1802c/0xd05e6ae1590e3d87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.681063:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.681066:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.681071:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec1802c/0xd05e6ae1590e3d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.681082:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec1802c/0xd05e6ae1590e3d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.681090:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec1802c/0xd05e6ae1590e3d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.681097:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec1802c/0xd05e6ae1590e3d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.681169:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350217.681877:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.681884:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec1802c/0xd05e6ae1590e3d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.681894:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.681898:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec1802c/0xd05e6ae1590e3d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.681907:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec1802c/0xd05e6ae1590e3d87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.681921:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec1802c/0xd05e6ae1590e3d87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.681940:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec1802c/0xd05e6ae1590e3d87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.681957:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.681959:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.681960:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350217.682365:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350217.682373:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3d8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.682390:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1783350217.682393:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350217.682398:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.682408:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.682416:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.682425:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.682440:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350217.682580:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.682585:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.682593:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d809000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.682596:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.682604:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3d8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.682614:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3d8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.682622:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3d8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.682635:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.682637:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.682638:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350217.684055:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350217.684066:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e308a891/0xd05e6ae1590e3d95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.684080:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=658s v=(0 0) 00010000:00010000:1.0:1783350217.684084:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350217.684089:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e308a891/0xd05e6ae1590e3d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.684111:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e308a891/0xd05e6ae1590e3d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.684127:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e308a891/0xd05e6ae1590e3d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.684171:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e308a891/0xd05e6ae1590e3d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.684187:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350217.684629:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350217.684636:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e308a891/0xd05e6ae1590e3d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.684645:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374603200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350217.684649:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e308a891/0xd05e6ae1590e3d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.684659:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e308a891/0xd05e6ae1590e3d95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.684686:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e308a891/0xd05e6ae1590e3d95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.684702:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e308a891/0xd05e6ae1590e3d95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.684717:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.684719:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350217.684721:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350217.685850:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350217.685863:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3d9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.685877:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=658s v=(0 0) 00010000:00010000:3.0:1783350217.685957:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350217.685963:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3d9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.685976:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3d9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.685987:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3d9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.685995:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3d9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.686019:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350217.686207:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.686213:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3d9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.686222:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.686226:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3d9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.686245:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3d9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.686260:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3d9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.686268:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b06044fd/0xd05e6ae1590e3d9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.686288:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.686290:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.686291:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350217.687982:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350217.687995:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3da3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.688024:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=658s v=(0 0) 00010000:00010000:3.0:1783350217.688028:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350217.688034:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.688114:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.688255:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.688266:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3da3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.688360:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350217.689413:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350217.689424:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3da3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.689667:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cda00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350217.689672:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3da3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.689744:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3da3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.689846:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3da3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.689854:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3da3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350217.689873:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350217.689875:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350217.689950:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350217.698077:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350217.698092:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e3daa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.698110:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=658s v=(0 0) 00010000:00010000:1.0:1783350217.698115:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350217.698130:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e3daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.698177:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e3daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.698188:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e3daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.698205:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e3daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.698221:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350217.699027:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350217.699038:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e3daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.699050:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350217.699055:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e3daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.699066:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e3daa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.699086:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e3daa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.699094:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e3daa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.699131:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350217.699133:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350217.699152:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350217.706079:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350217.706093:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e3db1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.706156:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=658s v=(0 0) 00010000:00010000:2.0:1783350217.706161:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350217.706169:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e3db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.706183:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e3db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.706193:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e3db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.706201:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e3db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350217.706221:0:24173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1783350217.706307:0:24173:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:2.0:1783350217.706532:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22689:x1869977659622656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 91094us (91211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350217.706543:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783350217.706636:0:22689:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1869977659622656:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783350217.706652:0:22689:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1783350217.706697:0:22689:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1869977659622784:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783350217.706731:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350217.706767:0:22689:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc1fa80 going to sleep for 11 seconds 00010000:00010000:1.0:1783350217.706868:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350217.706877:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e3db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.706890:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fe00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350217.706895:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e3db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.706906:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e3db1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.706925:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e3db1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.706934:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e3db1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.706955:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.706958:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350217.706960:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350217.707438:0:24664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659622784 00000100:00100000:0.0:1783350217.707446:0:24664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659622784 00000100:00100000:0.0:1783350217.707496:0:24664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783350217.707506:0:24664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22689:x1869977659622784:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783350217.707546:0:24664:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1783350217.720083:0:24169:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1783350217.720166:0:24169:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783350217.721483:0:24664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22689:x1869977659622784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13972us (14745us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1783350217.721496:0:24664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783350217.722204:0:22689:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1783350217.722215:0:22689:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1869977659622784:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783350217.722232:0:22689:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000020:01000004:3.0:1783350217.860380:0:24991:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783350217.860384:0:24991:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783350217.860386:0:24991:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783350217.861386:0:24991:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ea2426d0000 00000020:01000004:3.0:1783350217.861404:0:24991:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783350217.861419:0:24991:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783350217.861434:0:24991:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ea349f8cd40) 00000020:00000080:3.0:1783350217.861575:0:24991:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783350217.929952:0:24991:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783350217.933302:0:24991:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1783350217.933532:0:24991:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783350217.934017:0:24991:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1783350217.934275:0:24991:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1783350217.934476:0:24991:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783350217.936412:0:24991:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1783350217.945722:0:24991:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783350217.945936:0:24991:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783350217.945951:0:24991:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783350217.945963:0:24991:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd05e6ae1590e3dbf 00000020:01000004:1.0:1783350217.945970:0:24991:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783350217.945991:0:24991:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783350217.945994:0:24991:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783350217.946000:0:24991:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783350217.946027:0:24991:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1783350217.946031:0:24991:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1783350217.963704:0:24991:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783350217.963741:0:24991:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.150@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1783350217.963746:0:24991:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783350217.963748:0:24991:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783350217.963749:0:24991:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783350217.963750:0:24991:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783350217.963752:0:24991:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783350217.963753:0:24991:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783350217.963755:0:24991:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783350217.963756:0:24991:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783350217.963758:0:24991:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783350217.963761:0:24991:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1783350217.963768:0:24991:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783350217.963769:0:24991:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783350217.963770:0:24991:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783350217.963771:0:24991:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783350217.963772:0:24991:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783350217.963773:0:24991:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783350217.963774:0:24991:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783350217.963776:0:24991:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783350217.963777:0:24991:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783350217.963800:0:24991:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783350217.963820:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659622912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783350217.963886:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350217.963933:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea359308300 going to sleep for 11 seconds 00000100:00100000:2.0:1783350217.964006:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659622912 00000100:00100000:2.0:1783350217.964013:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659622912 00000100:00100000:2.0:1783350217.964095:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783350217.964115:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24991:x1869977659622912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783350217.964182:0:22657:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783350217.964185:0:22657:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1783350217.964189:0:22657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783350217.964605:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24991:x1869977659622912:12345-0@lo:253:mount.lustre.0 Request processed in 490us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350217.964614:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783350217.964703:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659622912:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783350217.964714:0:24991:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783350217.964717:0:24991:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783350217.964718:0:24991:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783350217.964719:0:24991:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783350217.964720:0:24991:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783350217.964721:0:24991:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783350217.964731:0:24991:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783350217.964732:0:24991:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783350217.964733:0:24991:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783350217.964734:0:24991:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783350217.964752:0:24991:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea2426d0000 from lustre-OST0001 10000000:01000000:1.0:1783350217.964777:0:24991:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783350217.964780:0:24991:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783350217.964788:0:24991:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ea370dfb380 local copy 00010000:00010000:1.0:1783350217.964799:0:24991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350217.964894:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350217.964925:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350217.965117:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350217.965442:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659623040 00000100:00100000:0.0:1783350217.965448:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659623040 00000100:00100000:0.0:1783350217.965476:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783350217.965483:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24991:x1869977659623040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350217.965560:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24991:x1869977659623040:12345-0@lo:501:mount.lustre.0 Request processed in 76us (633us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783350217.965567:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783350217.965652:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623040:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783350217.965668:0:24991:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783350217.965686:0:24991:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783350217.965692:0:24991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.965701:0:24991:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea374602800/0xd05e6ae1590e39f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3a00 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350217.965726:0:24991:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea2426d0000 10000000:01000000:1.0:1783350217.965730:0:24991:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783350217.965735:0:24991:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783350217.965739:0:24991:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783350217.965744:0:24991:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783350217.965747:0:24991:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783350217.965767:0:24991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.965783:0:24991:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.965792:0:24991:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350217.965806:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783350217.965831:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350217.965859:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350217.965906:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659623168 00000100:00100000:0.0:1783350217.965910:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659623168 00000100:00100000:0.0:1783350217.965931:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783350217.965937:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:24991:x1869977659623168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350217.965945:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350217.965957:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea37d809a00/0xd05e6ae1590e3dcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3dc6 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.965976:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea37d809a00/0xd05e6ae1590e3dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3dc6 expref: 22 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.965998:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea37d809a00/0xd05e6ae1590e3dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3dc6 expref: 22 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350217.966007:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea37d809a00, rc 0) 00000100:00100000:0.0:1783350217.966046:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24991:x1869977659623168:12345-0@lo:101:mount.lustre.0 Request processed in 108us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350217.966052:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783350217.966162:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350217.966174:0:24991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3dc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3dcd expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350217.966183:0:24991:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3dc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3dcd expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783350217.967743:0:24991:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1783350217.968865:0:24991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783350217.971853:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1783350217.971905:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1783350217.971923:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1783350217.971936:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1783350217.971948:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1783350217.971960:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1783350217.971972:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1783350217.971985:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1783350217.971997:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1783350217.972023:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1783350217.972029:0:24991:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1783350217.972334:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350217.972410:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350217.972450:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350217.972473:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659623296 00000100:00100000:0.0:1783350217.972480:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659623296 00000100:00100000:0.0:1783350217.972529:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783350217.972537:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24991:x1869977659623296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350217.972931:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24991:x1869977659623296:12345-0@lo:501:mount.lustre.0 Request processed in 393us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.972940:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783350217.973028:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350217.973059:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350217.973096:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350217.973193:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350217.973313:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659623424 00000100:00100000:3.0:1783350217.973324:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659623424 00000100:00100000:3.0:1783350217.973448:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783350217.973456:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24991:x1869977659623424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783350217.974589:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24991:x1869977659623424:12345-0@lo:503:mount.lustre.0 Request processed in 1129us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.974598:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783350217.974861:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783350217.975600:0:24991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783350217.975682:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350217.975741:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350217.975769:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350217.975835:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659623552 00000100:00100000:3.0:1783350217.975842:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659623552 00000100:00100000:3.0:1783350217.975882:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783350217.975890:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24991:x1869977659623552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783350217.976678:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24991:x1869977659623552:12345-0@lo:502:mount.lustre.0 Request processed in 785us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.976687:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783350217.976866:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783350217.977053:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1783350217.977083:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1783350217.977377:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1783350217.977399:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1783350217.977427:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1783350217.977444:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1783350217.977457:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1783350217.977468:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1783350217.977492:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1783350217.977528:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350217.977640:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350217.977673:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350217.978351:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659623680 00000100:00100000:3.0:1783350217.978360:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659623680 00000100:00100000:3.0:1783350217.978442:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783350217.978452:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24991:x1869977659623680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783350217.978583:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24991:x1869977659623680:12345-0@lo:502:mount.lustre.0 Request processed in 132us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350217.978590:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783350217.978677:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783350217.978739:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1783350217.978751:0:24991:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1783350217.981255:0:24995:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783350217.981268:0:24995:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1783350217.981275:0:24995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350217.981277:0:24995:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783350217.981284:0:24995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783350217.981302:0:24995:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ea243518000) 00000020:00000080:1.0:1783350217.981328:0:24995:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783350217.981334:0:24995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783350217.981420:0:24995:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea2426d0000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783350217.981429:0:24995:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783350217.981436:0:24995:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd05e6ae1590e3ddb 00010000:00010000:0.0:1783350217.989001:0:24995:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1783350217.990963:0:24995:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1783350217.997702:0:24995:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1783350218.000038:0:24995:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1783350218.000050:0:24995:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350218.000056:0:24995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.000058:0:24995:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1783350218.000061:0:24995:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350218.000066:0:24995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.000067:0:24995:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783350218.000070:0:24995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783350218.000071:0:24995:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783350218.000073:0:24995:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350218.000075:0:24995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.000076:0:24995:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783350218.000078:0:24995:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350218.000080:0:24995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.000081:0:24995:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783350218.000090:0:24995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783350218.000159:0:24995:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350218.000164:0:24995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.000165:0:24995:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783350218.000168:0:24995:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1783350218.000378:0:24991:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1783350218.000407:0:24991:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783350218.000433:0:24991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3dc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3dcd expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.000446:0:24991:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea374603400/0xd05e6ae1590e3dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3dcd expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350218.000454:0:24991:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea2426d0000 from 1 10000000:01000000:1.0:1783350218.000457:0:24991:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783350218.000492:0:24991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.000511:0:24991:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.000522:0:24991:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350218.000545:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783350218.000608:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350218.000659:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350218.000688:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659623808 00000100:00100000:3.0:1783350218.000696:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659623808 00000100:00100000:3.0:1783350218.000747:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783350218.000755:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24991:x1869977659623808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350218.000769:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350218.000780:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cdc00/0xd05e6ae1590e3de9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3de2 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350218.000820:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cdc00/0xd05e6ae1590e3de9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3de2 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350218.000831:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cdc00/0xd05e6ae1590e3de9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3de2 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350218.000840:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cdc00, rc 0) 00000100:00100000:3.0:1783350218.000887:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:24991:x1869977659623808:12345-0@lo:101:mount.lustre.0 Request processed in 132us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350218.000893:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783350218.001965:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350218.001985:0:24991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.001995:0:24991:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783350218.005794:0:24991:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1783350218.006079:0:24991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783350218.006878:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1783350218.006905:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1783350218.006936:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1783350218.006952:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1783350218.006964:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1783350218.006975:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1783350218.006987:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1783350218.007000:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1783350218.007011:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1783350218.007022:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1783350218.007047:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1783350218.007065:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1783350218.007071:0:24991:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1783350218.008818:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350218.008885:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350218.008958:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783350218.009004:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659623936 00000100:00100000:0.0:1783350218.009012:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659623936 00000100:00100000:0.0:1783350218.009095:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783350218.009104:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:24991:x1869977659623936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350218.009291:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:24991:x1869977659623936:12345-0@lo:501:mount.lustre.0 Request processed in 175us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350218.009299:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783350218.009523:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659623936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350218.009561:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624064:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350218.009607:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350218.009645:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783350218.010608:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659624064 00000100:00100000:0.0:1783350218.010617:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659624064 00000100:00100000:0.0:1783350218.010799:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783350218.010809:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:24991:x1869977659624064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783350218.011514:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:24991:x1869977659624064:12345-0@lo:503:mount.lustre.0 Request processed in 704us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350218.011522:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783350218.013325:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624064:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783350218.015984:0:24991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783350218.016101:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783350218.016216:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350218.026128:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea34558b180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350218.027361:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659624192 00000100:00100000:2.0:1783350218.027375:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659624192 00000100:00100000:2.0:1783350218.027435:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783350218.027444:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:24991:x1869977659624192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350218.028758:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:24991:x1869977659624192:12345-0@lo:502:mount.lustre.0 Request processed in 1310us (12537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350218.028769:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783350218.028903:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350218.029181:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1783350218.031448:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1783350218.031486:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1783350218.031503:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1783350218.031514:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1783350218.031527:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1783350218.032742:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1783350218.032774:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1783350218.032789:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1783350218.032804:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1783350218.032819:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1783350218.032873:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350218.032958:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350218.033013:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350218.038351:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659624320 00000100:00100000:1.0:1783350218.038366:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659624320 00000100:00100000:1.0:1783350218.038431:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783350218.038439:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:24991:x1869977659624320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350218.038601:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:24991:x1869977659624320:12345-0@lo:502:mount.lustre.0 Request processed in 162us (5642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350218.038609:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783350218.044478:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783350218.044583:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1783350218.044598:0:24991:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1783350218.045945:0:24999:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350218.045956:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.045958:0:24999:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783350218.045965:0:24999:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea2426d0000 00000020:00000080:0.0:1783350218.045967:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783350218.045974:0:24999:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350218.045976:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.045977:0:24999:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783350218.045979:0:24999:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350218.045981:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.045982:0:24999:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783350218.045990:0:24999:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea2426d0000 00000020:00000080:0.0:1783350218.045992:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783350218.046048:0:24999:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350218.046052:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.046053:0:24999:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783350218.046055:0:24999:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350218.046057:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.046058:0:24999:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783350218.046061:0:24999:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea2426d0000 00000020:00000080:0.0:1783350218.046063:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783350218.046079:0:24999:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350218.046081:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.046082:0:24999:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783350218.046084:0:24999:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350218.046086:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.046087:0:24999:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783350218.046090:0:24999:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea2426d0000 00000020:00000080:0.0:1783350218.046092:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783350218.046110:0:24999:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350218.046113:0:24999:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350218.046114:0:24999:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783350218.046126:0:24999:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000040:00080000:0.0:1783350218.055791:0:23421:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:2.0:1783350218.058352:0:24991:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783350218.058396:0:24991:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783350218.058426:0:24991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350218.058439:0:24991:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350218.058502:0:24991:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783350218.058511:0:24991:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea2426d0000 10000000:01000000:2.0:1783350218.058514:0:24991:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea2426d0000 10000000:01000000:2.0:1783350218.058518:0:24991:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783350218.058524:0:24991:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea2426d0000 from 1 10000000:01000000:2.0:1783350218.058526:0:24991:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783350218.058561:0:24991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350218.058570:0:24991:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350218.058580:0:24991:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350218.059708:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783350218.059778:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350218.059818:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea359256240 going to sleep for 11 seconds 00000100:00100000:2.0:1783350218.059842:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659624448 00000100:00100000:2.0:1783350218.059849:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659624448 00000100:00100000:2.0:1783350218.059895:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783350218.059904:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:24991:x1869977659624448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350218.059921:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350218.059937:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e3df7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3df0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350218.059960:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e3df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3df0 expref: 24 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350218.059972:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e3df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3df0 expref: 24 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350218.059991:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8fe00, rc 0) 00000100:00100000:2.0:1783350218.060030:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659624448:12345-0@lo:101:mount.lustre.0 Request processed in 127us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350218.060037:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783350218.060085:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350218.060205:0:24991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3df0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3df7 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350218.060217:0:24991:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3df0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3df7 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783350218.063505:0:24991:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1783350218.063813:0:24991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783350218.064028:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1783350218.064053:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1783350218.064065:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1783350218.064075:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1783350218.064086:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1783350218.064109:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1783350218.064396:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1783350218.064417:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1783350218.064435:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1783350218.064447:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1783350218.064458:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1783350218.064470:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1783350218.064484:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1783350218.064499:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1783350218.064513:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1783350218.064536:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1783350218.064569:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1783350218.064814:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1783350218.064836:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1783350218.064848:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1783350218.064859:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1783350218.064870:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1783350218.064881:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1783350218.064892:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1783350218.064904:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1783350218.064914:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1783350218.064925:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1783350218.064935:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1783350218.064946:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1783350218.064956:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1783350218.064967:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1783350218.064979:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1783350218.065001:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1783350218.065014:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1783350218.065025:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1783350218.065035:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1783350218.065046:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1783350218.065056:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1783350218.065067:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1783350218.065078:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1783350218.065089:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1783350218.065310:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1783350218.065330:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1783350218.065345:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1783350218.065362:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1783350218.065375:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1783350218.065390:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1783350218.065403:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1783350218.065570:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1783350218.065607:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1783350218.065628:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1783350218.065634:0:24991:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1783350218.065719:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350218.065776:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350218.065811:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea359256300 going to sleep for 11 seconds 00000100:00100000:2.0:1783350218.065844:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659624576 00000100:00100000:2.0:1783350218.065850:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659624576 00000100:00100000:2.0:1783350218.065891:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783350218.065899:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659624576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350218.066002:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659624576:12345-0@lo:501:mount.lustre.0 Request processed in 103us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350218.066009:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783350218.066056:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350218.066084:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350218.066171:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350218.067084:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659624704 00000100:00100000:1.0:1783350218.067092:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659624704 00000100:00100000:1.0:1783350218.067163:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783350218.067172:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659624704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350218.067293:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659624704:12345-0@lo:503:mount.lustre.0 Request processed in 121us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350218.067300:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783350218.069505:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea359256300 going to sleep for 11 seconds 00000100:00100000:2.0:1783350218.069549:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624704:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783350218.070007:0:24991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783350218.070091:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350218.071340:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350218.071384:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659624832 00000100:00100000:2.0:1783350218.071391:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659624832 00000100:00100000:2.0:1783350218.071440:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783350218.071449:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659624832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350218.071568:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659624832:12345-0@lo:502:mount.lustre.0 Request processed in 120us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350218.071577:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783350218.071787:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea359256240 going to sleep for 11 seconds 00000100:00100000:2.0:1783350218.071809:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350218.071995:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1783350218.072024:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1783350218.072039:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1783350218.072051:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1783350218.072062:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1783350218.072075:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1783350218.072089:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1783350218.072278:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1783350218.072296:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1783350218.072310:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1783350218.072338:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1783350218.072354:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1783350218.072367:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1783350218.072380:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1783350218.072393:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1783350218.072404:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1783350218.072416:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1783350218.072429:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1783350218.072442:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1783350218.072454:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1783350218.072467:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1783350218.072481:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1783350218.072495:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1783350218.072512:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1783350218.072528:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1783350218.072554:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1783350218.072581:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1783350218.072828:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1783350218.072848:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1783350218.072861:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1783350218.072875:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1783350218.072887:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1783350218.072898:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1783350218.072911:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1783350218.072924:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1783350218.072937:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1783350218.072950:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1783350218.072963:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1783350218.072976:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1783350218.072989:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1783350218.073002:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1783350218.073016:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1783350218.073041:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1783350218.073057:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1783350218.073070:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1783350218.073084:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1783350218.073347:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1783350218.073372:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1783350218.073423:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350218.073487:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350218.073521:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659624960 00000100:00100000:2.0:1783350218.073526:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659624960 00000100:00100000:2.0:1783350218.073568:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783350218.073579:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659624960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350218.075154:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659624960:12345-0@lo:502:mount.lustre.0 Request processed in 1554us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350218.075177:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783350218.075256:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea359256240 going to sleep for 11 seconds 00000100:00100000:2.0:1783350218.075280:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659624960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350218.075474:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1783350218.075506:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1783350218.075542:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659625088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350218.075612:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350218.075641:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea359256240 going to sleep for 11 seconds 00000100:00100000:1.0:1783350218.075987:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659625088 00000100:00100000:1.0:1783350218.075994:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659625088 00000100:00100000:1.0:1783350218.076046:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783350218.076055:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659625088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350218.076181:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659625088:12345-0@lo:502:mount.lustre.0 Request processed in 126us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350218.076188:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783350218.076390:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659625088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350218.076435:0:24991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1783350218.076444:0:24991:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783350218.077782:0:25004:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783350218.077798:0:25004:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ea2435199c0) 00000020:00000080:1.0:1783350218.077819:0:25004:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1783350218.077954:0:25004:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea2426d0000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783350218.077958:0:25004:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea2426d0000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783350218.077960:0:25004:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea2426d0000 3 00010000:00080000:1.0:1783350218.077986:0:25004:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea348c56800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.150@tcp at head 00010000:00010000:0.0:1783350218.082113:0:25004:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1783350218.082257:0:25004:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1783350218.082314:0:25004:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783350218.082328:0:25004:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd05e6ae1590e3e05 00000100:00080000:0.0:1783350218.082339:0:25004:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783350218.082346:0:25004:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ea348c56800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350218.082383:0:25004:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244776300 x1869977659625216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783350218.082410:0:25004:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783350218.084762:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659625216:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783350218.084852:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350218.084938:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659625216 00000100:00100000:3.0:1783350218.084947:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659625216 00000100:00100000:3.0:1783350218.084982:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783350218.084989:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659625216:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783350218.085016:0:22666:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:3.0:1783350218.085058:0:22666:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd05e6ae1590e3e0c 00000004:00100000:3.0:1783350218.085072:0:22666:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783350218.085105:0:22666:0:(import.c:65:import_set_state_nolock()) ffff8ea2438ec800 : changing import state from RECOVER to FULL 00000020:01000004:0.0:1783350218.085212:0:25004:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783350218.085228:0:25004:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8ea37f45cd40) 00000020:00000080:0.0:1783350218.085248:0:25004:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:3.0:1783350218.087500:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869977659625216:12345-0@lo:38:llog_process_th.0 Request processed in 2502us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350218.087514:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783350218.087616:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea244776300 x1869977659625216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350218.087628:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783350218.087636:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1783350218.087645:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783350218.087651:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783350218.087653:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea348c56800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783350218.087660:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659625216:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1783350218.089601:0:25004:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea2426d0000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783350218.089610:0:25004:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea2426d0000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783350218.089613:0:25004:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea2426d0000 3 00010000:00080000:0.0:1783350218.089648:0:25004:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea243ab4800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.150@tcp at head 00010000:00010000:0.0:1783350218.099867:0:25004:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1783350218.100011:0:25004:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1783350218.100057:0:25004:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783350218.100070:0:25004:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd05e6ae1590e3e1a 00000100:00080000:0.0:1783350218.100081:0:25004:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783350218.100087:0:25004:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ea243ab4800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350218.100130:0:25004:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244776300 x1869977659625344/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783350218.100177:0:25004:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783350218.100576:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869977659625344:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783350218.100648:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350218.100703:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659625344 00000100:00100000:2.0:1783350218.100712:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659625344 00000100:00100000:2.0:1783350218.100754:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783350218.100761:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659625344:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783350218.100787:0:22665:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:2.0:1783350218.100816:0:22665:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd05e6ae1590e3e21 00000004:00100000:2.0:1783350218.100830:0:22665:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783350218.100858:0:22665:0:(import.c:65:import_set_state_nolock()) ffff8ea24368f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783350218.100912:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869977659625344:12345-0@lo:38:llog_process_th.0 Request processed in 150us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350218.100920:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783350218.100986:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea244776300 x1869977659625344/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350218.100996:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783350218.101003:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1783350218.101009:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783350218.101014:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783350218.101016:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243ab4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783350218.101022:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869977659625344:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1783350218.102617:0:25004:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1783350218.107379:0:24991:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783350218.107428:0:24991:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783350218.107456:0:24991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3df0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3df7 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350218.107470:0:24991:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3df7 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783350218.107532:0:24991:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783350218.107535:0:24991:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783350218.107536:0:24991:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783350218.107537:0:24991:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783350218.107539:0:24991:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783350218.107540:0:24991:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783350218.107546:0:24991:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783350218.107547:0:24991:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783350218.107548:0:24991:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783350218.107552:0:24991:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1783350218.107554:0:24991:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783350218.107556:0:24991:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783350218.107557:0:24991:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783350218.107558:0:24991:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783350218.107559:0:24991:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783350218.107560:0:24991:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783350218.107561:0:24991:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783350218.107562:0:24991:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783350218.107562:0:24991:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783350218.107590:0:24991:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783350218.107611:0:24991:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659625472:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783350218.107680:0:24991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350218.107722:0:24991:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc20a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783350218.108415:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659625472 00000100:00100000:2.0:1783350218.108426:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659625472 00000100:00100000:2.0:1783350218.108499:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783350218.108510:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:24991:x1869977659625472:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783350218.108558:0:22658:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783350218.108573:0:22658:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783350218.110298:0:22658:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783350218.110320:0:22658:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783350218.110420:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783350218.110425:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783350218.110448:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.110466:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3780ae200/0xd05e6ae1590e3cbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3cb5 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.110474:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3cca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3cc3 expref: 24 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.110482:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.110531:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3cc3 expref: 24 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.110544:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3cca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3cc3 expref: 24 pid: 22657 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350218.110559:0:22680:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659625600:0@lo:104: 00000100:00100000:0.0:1783350218.110617:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350218.110679:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659625600 00010000:00010000:0.0:1783350218.110682:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3780ae200/0xd05e6ae1590e3cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3cb5 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350218.110687:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659625600 00010000:00010000:0.0:1783350218.110693:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3780ae200/0xd05e6ae1590e3cbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3cb5 expref: 24 pid: 22659 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350218.110703:0:22680:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659625728:0@lo:104: 00000100:00100000:0.0:1783350218.110729:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350218.110734:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783350218.110741:0:22680:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351466cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350218.110743:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659625600:12345-0@lo:104: 00010000:00010000:1.0:1783350218.110775:0:22649:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.110830:0:22649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783350218.110836:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659625600:12345-0@lo:104: Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350218.110843:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783350218.110855:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659625728 00000100:00100000:1.0:1783350218.110858:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659625728 00000100:00100000:1.0:1783350218.110869:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783350218.110873:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659625728:12345-0@lo:104: 00010000:00010000:1.0:1783350218.110880:0:22649:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.110907:0:22649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783350218.110912:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:22680:x1869977659625728:12345-0@lo:104: Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350218.110917:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1783350218.110938:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783350218.110943:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350218.110950:0:22680:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659625600:0@lo:104: 00010000:00010000:1.0:1783350218.110952:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350218.110959:0:22654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.110967:0:22654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350218.110978:0:22680:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1869977659625728:0@lo:104: 10000000:00010000:1.0:1783350218.110992:0:22654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350218.110998:0:22654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783350218.111002:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111024:0:22654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111030:0:22654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783350218.111055:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111062:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea374602600/0xd05e6ae1590e3cc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3cca expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111074:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350218.111077:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111082:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602e00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350218.111085:0:22654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111091:0:22654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783350218.111097:0:22654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350218.111101:0:22654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1783350218.111115:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659625856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350218.111133:0:22654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111162:0:22654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783350218.111182:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783350218.111190:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111198:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea374602e00/0xd05e6ae1590e3cb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3cbc expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111212:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350218.111215:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350218.111217:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350218.111224:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350218.111242:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3648:1869977659625984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350218.111268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350218.111307:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659625856 00000100:00100000:1.0:1783350218.111310:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659625856 00010000:00010000:1.0:1783350218.111336:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3cca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3cc3 expref: 25 pid: 22657 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350218.111362:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659625984 00000100:00100000:1.0:1783350218.111368:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783350218.111368:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659625984 00000100:00100000:1.0:1783350218.111377:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+26:3647:x1869977659625856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350218.111388:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350218.111393:0:22652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3780ae200/0xd05e6ae1590e3cbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3cb5 expref: 26 pid: 22659 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111394:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3cca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3cc3 expref: 26 pid: 22657 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111406:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3cc3 expref: 26 pid: 22657 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111421:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3cca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3cc3 expref: 26 pid: 22657 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350218.111434:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1783350218.111438:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350218.111444:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+25:3648:x1869977659625984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350218.111454:0:22652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350218.111460:0:22652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3780ae200/0xd05e6ae1590e3cbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3cb5 expref: 25 pid: 22659 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.111470:0:22652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3780ae200/0xd05e6ae1590e3cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3cb5 expref: 25 pid: 22659 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350218.111481:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+25:3647:x1869977659625856:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (297us total) trans 0 rc 0/0 00010000:00010000:0.0:1783350218.111482:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3780ae200/0xd05e6ae1590e3cbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3cb5 expref: 25 pid: 22659 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350218.111495:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1783350218.111502:0:22652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.111511:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350218.111520:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3647:1869977659625856:0@lo:103:ldlm_bl.0 20000000:01000000:0.0:1783350218.111523:0:22652:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003659651s 00010000:00010000:0.0:1783350218.111528:0:22652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.111535:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.111540:0:22652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.111546:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.111557:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350218.111560:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.111567:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.111584:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350218.111593:0:22652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350218.111621:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:3648:x1869977659625984:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350218.111628:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783350218.111831:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3648:1869977659625984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350218.111847:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111856:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350218.111863:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea37d808600/0xd05e6ae1590e3e28 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350218.112458:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:24991:x1869977659625472:12345-0@lo:253:mount.lustre.0 Request processed in 3946us (4774us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350218.112468:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783350218.113488:0:24991:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:24991:1869977659625472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783350218.113503:0:24991:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783350218.113506:0:24991:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783350218.113508:0:24991:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783350218.113509:0:24991:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783350218.113510:0:24991:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783350218.113511:0:24991:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783350218.113512:0:24991:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783350218.113514:0:24991:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783350218.113515:0:24991:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783350218.113516:0:24991:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783350218.113527:0:24991:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1783350218.121041:0:24991:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1783350218.124201:0:24991:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783350218.124211:0:24991:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783350218.124248:0:24991:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783350218.124307:0:24991:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783350218.124324:0:24991:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1783350218.124425:0:24991:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1783350218.125380:0:24991:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783350218.125641:0:24991:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783350218.501903:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783350219.137038:0:25057:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783350219.137802:0:25057:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1783350219.461004:0:22662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783350219.461011:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea36d918800 from 14 10000000:01000000:0.0:1783350219.461016:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783350219.461082:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea37d809400/0xd05e6ae1590e3e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350219.461102:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea37d809400/0xd05e6ae1590e3e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350219.461120:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea37d809400/0xd05e6ae1590e3e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350219.461162:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659626112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783350219.461228:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350219.461273:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea35ab59b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350219.465484:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659626112 00000100:00100000:2.0:1783350219.465500:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659626112 00000100:00100000:2.0:1783350219.465572:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783350219.465582:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:22662:x1869977659626112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350219.465599:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350219.465618:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3e36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3e2f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350219.465645:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3e2f expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350219.465657:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3e2f expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350219.465666:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e200, rc 0) 00000100:00100000:2.0:1783350219.465747:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659626112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (4519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350219.465754:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783350219.465872:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659626112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350219.465890:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea37d809400/0xd05e6ae1590e3e2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3e36 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350219.465899:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea37d809400/0xd05e6ae1590e3e2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3e36 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350219.465963:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659626240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783350219.466001:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350219.466035:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350219.466078:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659626240 00000100:00100000:2.0:1783350219.466082:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659626240 00000100:00100000:2.0:1783350219.466121:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783350219.466172:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659626240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783350219.466188:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783350219.466205:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783350219.466208:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1783350219.466278:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659626240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350219.466285:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783350219.466372:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659626240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783350219.466429:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783350219.466436:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea37d809400/0xd05e6ae1590e3e2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3e36 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350219.466444:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea37d809400/0xd05e6ae1590e3e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3e36 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350219.466454:0:22662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783350219.466456:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea37464f800 from 14 10000000:01000000:0.0:1783350219.466459:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783350219.466476:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea37d809200/0xd05e6ae1590e3e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350219.466484:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea37d809200/0xd05e6ae1590e3e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350219.466493:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea37d809200/0xd05e6ae1590e3e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350219.466510:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659626368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783350219.466533:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350219.466559:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea35ab59b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350219.466664:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659626368 00000100:00100000:2.0:1783350219.466668:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659626368 00000100:00100000:2.0:1783350219.466694:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783350219.466700:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659626368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350219.466708:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350219.466717:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e3e44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3e3d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350219.466732:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e3e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3e3d expref: 24 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350219.466740:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e3e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3e3d expref: 24 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350219.466747:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f400, rc 0) 00000100:00100000:2.0:1783350219.466780:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:22662:x1869977659626368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350219.466785:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783350219.466848:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659626368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783350219.466858:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea37d809200/0xd05e6ae1590e3e3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3e44 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350219.466865:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea37d809200/0xd05e6ae1590e3e3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3e44 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350219.466898:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659626496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783350219.466925:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350219.466944:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea35ab59b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350219.466990:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659626496 00000100:00100000:2.0:1783350219.466994:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659626496 00000100:00100000:2.0:1783350219.467020:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783350219.467025:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:22662:x1869977659626496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783350219.467041:0:22657:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783350219.467051:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783350219.467053:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1783350219.467133:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:22662:x1869977659626496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350219.467163:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783350219.467433:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659626496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783350219.467477:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783350219.467483:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea37d809200/0xd05e6ae1590e3e3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3e44 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350219.467491:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea37d809200/0xd05e6ae1590e3e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3e44 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350219.525990:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350220.548347:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350221.583063:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350221.700655:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659626624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783350221.700727:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350221.700839:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659626624 00000100:00100000:3.0:1783350221.700847:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659626624 00000100:00100000:3.0:1783350221.700922:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783350221.700938:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659626624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783350221.700967:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783350221.701011:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659626624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350221.701018:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783350221.701170:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783350221.701572:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659626624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783350222.213525:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659626752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350222.213596:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350222.213658:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659626752 00000100:00100000:2.0:1783350222.213665:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659626752 00000100:00100000:2.0:1783350222.213717:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783350222.213725:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659626752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350222.213757:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783350222.213801:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659626752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350222.213809:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783350222.213856:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659626752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350222.214028:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659626880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350222.214059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350222.215067:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659626880 00000100:00100000:0.0:1783350222.215080:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659626880 00000100:00100000:0.0:1783350222.215152:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783350222.215162:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659626880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783350222.215202:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350222.215260:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659626880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350222.215267:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783350222.216864:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659626880:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783350222.596439:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350222.728283:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659627008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783350222.728352:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350222.728785:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659627008 00000100:00100000:3.0:1783350222.728794:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659627008 00000100:00100000:3.0:1783350222.728853:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783350222.728862:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659627008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783350222.728884:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783350222.728933:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659627008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350222.728941:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783350222.728987:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659627008:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783350222.732866:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783350223.237971:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783350223.237977:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783350223.237980:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea24271b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783350223.237989:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 658 00000100:00080000:0.0:1783350223.237993:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783350223.237999:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ea24271b000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350223.238020:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244775c00 x1869977659627520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783350223.238055:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783350223.238058:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783350223.238060:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea370da1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783350223.238063:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 658 00000100:00080000:0.0:1783350223.238066:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783350223.238069:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea370da1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350223.238090:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36d738a80 x1869977659628032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783350223.238186:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659627648:0@lo:400:kworker.0 00000100:00100000:0.0:1783350223.238248:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350223.238280:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659628288:0@lo:400:kworker.0 00000100:00100000:0.0:1783350223.238301:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350223.238302:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659627136:0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238334:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350223.238360:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659627776:0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238386:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350223.238403:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659628416:0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350223.238430:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659627264:0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238446:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659627520:0@lo:8:kworker.0 00000100:00100000:0.0:1783350223.238454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350223.238467:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350223.238470:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659627904:0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238481:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659628032:0@lo:8:kworker.0 00000100:00100000:0.0:1783350223.238488:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350223.238503:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659628544:0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238515:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659627136 00000100:00100000:1.0:1783350223.238522:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659627136 00000100:00100000:0.0:1783350223.238526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350223.238541:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783350223.238546:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659627392:0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238563:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783350223.238563:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350223.238571:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:3649:x1869977659627136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350223.238575:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659628160:0@lo:400:kworker.0 00000100:00100000:0.0:1783350223.238593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350223.238602:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659628672:0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238621:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:3649:x1869977659627136:12345-0@lo:400:kworker.0 Request processed in 51us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350223.238622:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350223.238628:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783350223.238642:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659627648 00000100:00100000:0.0:1783350223.238645:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659627648 00000100:00100000:1.0:1783350223.238656:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659627776 00000100:00100000:1.0:1783350223.238658:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659627776 00000100:00100000:0.0:1783350223.238664:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659628288 00000100:00100000:0.0:1783350223.238666:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659628288 00000100:00100000:1.0:1783350223.238676:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659627264 00000100:00100000:1.0:1783350223.238684:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659627264 00000100:00100000:0.0:1783350223.238685:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659628416 00000100:00100000:0.0:1783350223.238687:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659628416 00000100:00100000:0.0:1783350223.238696:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659628544 00000100:00100000:1.0:1783350223.238698:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783350223.238698:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659628544 00000100:00100000:1.0:1783350223.238703:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659627776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350223.238708:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659628160 00000100:00100000:0.0:1783350223.238710:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659628160 00000100:00100000:0.0:1783350223.238719:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659628672 00000100:00100000:0.0:1783350223.238721:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659628672 00000100:00100000:0.0:1783350223.238733:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783350223.238735:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659627776:12345-0@lo:400:kworker.0 Request processed in 32us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350223.238738:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659627648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238741:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783350223.238751:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783350223.238756:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659627264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350223.238768:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659627648:12345-0@lo:400:kworker.0 Request processed in 30us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350223.238780:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783350223.238782:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659627264:12345-0@lo:400:kworker.0 Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350223.238786:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783350223.238793:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783350223.238798:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659628288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238801:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783350223.238806:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659628416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350223.238824:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659628288:12345-0@lo:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350223.238830:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783350223.238842:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783350223.238847:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659628544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350223.238873:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659628544:12345-0@lo:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350223.238879:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783350223.238889:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783350223.238894:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659628160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238908:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659628416:12345-0@lo:400:kworker.0 Request processed in 102us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350223.238914:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659628160:12345-0@lo:400:kworker.0 Request processed in 20us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350223.238915:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783350223.238919:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783350223.238927:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783350223.238932:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659628672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.238947:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659627520 00000100:00100000:1.0:1783350223.238951:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659627520 00000100:00100000:1.0:1783350223.238968:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659627904 00000100:00100000:1.0:1783350223.238970:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659627904 00000100:00100000:1.0:1783350223.238986:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659627392 00000100:00100000:1.0:1783350223.238989:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659627392 00000100:00100000:1.0:1783350223.238999:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783350223.239003:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659627904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.239033:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659627904:12345-0@lo:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350223.239039:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783350223.239056:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783350223.239061:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659627392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.239102:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659627392:12345-0@lo:400:kworker.0 Request processed in 41us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350223.239107:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783350223.239117:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783350223.239121:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1869977659627520:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783350223.239164:0:24175:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:1.0:1783350223.239200:0:24175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e3e4b 00002000:00100000:1.0:1783350223.239213:0:24175:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ea367363000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783350223.239217:0:24175:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783350223.239220:0:24175:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783350223.239382:0:24175:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783350223.239404:0:24175:0:(import.c:65:import_set_state_nolock()) ffff8ea367364000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783350223.239437:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869977659627520:12345-0@lo:8:kworker.0 Request processed in 315us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350223.239443:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783350223.239456:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659628672:12345-0@lo:400:kworker.0 Request processed in 524us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350223.239462:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350223.239462:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783350223.239484:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659628032 00000100:00100000:0.0:1783350223.239487:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659628032 00000100:00100000:0.0:1783350223.239499:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783350223.239504:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869977659628032:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783350223.239505:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea244775c00 x1869977659627520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783350248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350223.239515:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783350223.239521:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00010000:00080000:0.0:1783350223.239523:0:24173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000100:00080000:1.0:1783350223.239528:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000020:00000080:0.0:1783350223.239537:0:24173:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e3e52 00002000:00100000:0.0:1783350223.239543:0:24173:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8ea243ab6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1783350223.239546:0:24173:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1783350223.239548:0:24173:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783350223.239575:0:24173:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1783350223.239588:0:24173:0:(import.c:65:import_set_state_nolock()) ffff8ea243ab7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783350223.239615:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869977659628032:12345-0@lo:8:kworker.0 Request processed in 110us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350223.239620:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1783350223.239635:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783350223.239640:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783350223.239642:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783350223.239662:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea244776300 x1869977659627648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350223.239672:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659627648:0@lo:400:kworker.0 00010000:00080000:0.0:1783350223.239682:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36d739c00 x1869977659628288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350223.239689:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659628288:0@lo:400:kworker.0 00000100:00080000:1.0:1783350223.239724:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783350223.239728:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24271b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783350223.239736:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659627136:0@lo:400:kworker.0 00000004:00080000:1.0:1783350223.239741:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783350223.239746:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659627776:0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.239751:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659627520:0@lo:8:kworker.0 00010000:00080000:0.0:1783350223.239754:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36d739f80 x1869977659628416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783350223.239763:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36d738a80 x1869977659628032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783350248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350223.239763:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659628416:0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.239770:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783350223.239774:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1783350223.239779:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783350223.239782:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783350223.239783:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea370da1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783350223.239793:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783350223.239796:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659628032:0@lo:8:kworker.0 00000004:00080000:1.0:1783350223.239891:0:22690:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783350223.239951:0:22690:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 664034814527ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783350223.239957:0:22690:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1783350223.240013:0:23409:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1783350223.240032:0:23409:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1869977659628928:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1783350223.240059:0:23409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350223.240074:0:23409:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350d036c0 going to sleep for 11 seconds 00000004:00080000:1.0:1783350223.240097:0:23408:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783350223.240156:0:23408:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 664034997809ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783350223.240162:0:23408:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1783350223.240305:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783350223.240314:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659628800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783350223.240340:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350223.240370:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659628800 00000100:00100000:1.0:1783350223.240374:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659628800 00000100:00100000:1.0:1783350223.240406:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783350223.240412:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1869977659628800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783350223.240440:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783350223.240475:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1869977659628800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350223.240480:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1783350223.240498:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783350223.240517:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f5c8e00 x1869977659628800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783350239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350223.240532:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659628800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783350223.240550:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659628928 00000100:00100000:1.0:1783350223.240553:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659628928 00000100:00100000:1.0:1783350223.240574:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783350223.240580:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23409:x1869977659628928:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1783350223.246712:0:22645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783350223.248683:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659629056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783350223.248765:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783350223.248822:0:22691:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1783350223.248845:0:22691:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1869977659629184:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783350223.248872:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350223.248890:0:22691:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24310d840 going to sleep for 11 seconds 00000100:00100000:0.0:1783350223.248913:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659629184 00000100:00100000:0.0:1783350223.248919:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659629184 00000100:00100000:0.0:1783350223.248983:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783350223.248992:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22691:x1869977659629184:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783350223.249198:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659629056 00000100:00100000:1.0:1783350223.249202:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659629056 00000100:00100000:1.0:1783350223.249223:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783350223.249228:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659629056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783350223.249249:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1783350223.250052:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783350223.250102:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659627392:0@lo:400:kworker.0 00010000:00080000:0.0:1783350223.250120:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36d739880 x1869977659628160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350223.250131:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659628160:0@lo:400:kworker.0 00010000:00080000:0.0:1783350223.250165:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36d73b480 x1869977659628672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350223.250173:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659628672:0@lo:400:kworker.0 00000100:00100000:0.0:1783350223.250186:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659627264:0@lo:400:kworker.0 00000100:00100000:0.0:1783350223.250198:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659627904:0@lo:400:kworker.0 00010000:00080000:0.0:1783350223.250209:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36d739180 x1869977659628544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350223.250216:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659628544:0@lo:400:kworker.0 00000100:00100000:1.0:1783350223.250640:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659629056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1408us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350223.250655:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783350223.250745:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da6a00 x1869977659629056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783350239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350223.250763:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659629056:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1783350223.253092:0:23397:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:2.0:1783350223.256454:0:24173:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1783350223.256464:0:24173:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1783350223.256557:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23409:x1869977659628928:12345-0@lo:7:osp-pre-1-1.0 Request processed in 15973us (16492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350223.256567:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1783350223.256904:0:23409:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f5c9f80 x1869977659628928/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783350239 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350223.256918:0:23409:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1869977659628928:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1783350223.256929:0:23409:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1783350223.256965:0:23409:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1869977659629312:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1783350223.257002:0:23409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350223.257029:0:23409:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350d036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350223.257074:0:24664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659629312 00000100:00100000:2.0:1783350223.257089:0:24664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659629312 00000100:00100000:2.0:1783350223.257127:0:24664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00002000:00080000:1.0:1783350223.257179:0:24175:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1783350223.257186:0:24175:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1783350223.257191:0:24175:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00000100:00100000:2.0:1783350223.258604:0:24664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23409:x1869977659629312:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1783350223.258638:0:24664:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1783350223.258885:0:24664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23409:x1869977659629312:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1750us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350223.258894:0:24664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1783350223.259126:0:23409:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f5c9f80 x1869977659629312/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783350239 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350223.259171:0:23409:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1869977659629312:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1783350223.259183:0:23409:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1783350223.259232:0:23409:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1869977659629440:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1783350223.259266:0:23409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350223.259289:0:23409:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a600 going to sleep for 11 seconds 00000100:00100000:2.0:1783350223.259773:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659629440 00000100:00100000:2.0:1783350223.259780:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659629440 00000100:00100000:2.0:1783350223.260151:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783350223.260162:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23409:x1869977659629440:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1783350223.260195:0:24173:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1783350223.275456:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.275470:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3e59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.275487:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.275491:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.275498:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.275515:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.275525:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.275533:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.275549:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783350223.277090:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.277106:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3e60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.277121:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.277148:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.277154:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.277168:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.277178:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.277186:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.277203:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783350223.277283:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783350223.277291:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.277444:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.277449:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.277458:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3e59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.277478:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3e59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.277485:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3e59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.277505:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350223.277508:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.277515:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808e00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.277524:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.277531:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3e60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.277541:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3e60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.277546:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3e60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.277558:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.277560:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.277561:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350223.277921:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.277927:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3e67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.277936:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.277939:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.277943:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3e67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.277953:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3e67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.277966:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3e67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.277973:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3e67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.277987:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350223.278095:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350223.278101:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3e67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.278108:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350223.278112:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3e67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.278120:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3e67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.278131:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3e67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.278156:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3e67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.278169:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350223.278175:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350223.278177:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.279020:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.281326:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.281340:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3e6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.281359:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.281364:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.281369:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3e6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.281384:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3e6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.281395:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3e6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.281415:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3e6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.281435:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783350223.284809:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350223.284834:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e308a891/0xd05e6ae1590e3e75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.284852:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1783350223.284856:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350223.284862:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e308a891/0xd05e6ae1590e3e75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.284876:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e308a891/0xd05e6ae1590e3e75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.284886:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e308a891/0xd05e6ae1590e3e75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.284902:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e308a891/0xd05e6ae1590e3e75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.284920:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783350223.285383:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783350223.285390:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3e6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.285398:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350223.285402:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3e6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.285410:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3e6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.285427:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3e6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.285435:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3e6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.285450:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350223.285454:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e308a891/0xd05e6ae1590e3e75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.285460:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374603200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350223.285463:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e308a891/0xd05e6ae1590e3e75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.285484:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e308a891/0xd05e6ae1590e3e75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.285493:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e308a891/0xd05e6ae1590e3e75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.285501:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e308a891/0xd05e6ae1590e3e75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.285515:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350223.285516:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350223.285518:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350223.285533:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350223.290880:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350223.290895:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1596922/0xd05e6ae1590e3e7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.290913:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1783350223.290917:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350223.290921:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1596922/0xd05e6ae1590e3e7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.290934:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1596922/0xd05e6ae1590e3e7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.290943:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1596922/0xd05e6ae1590e3e7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.290950:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1596922/0xd05e6ae1590e3e7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.290970:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783350223.291939:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350223.291949:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d49f219/0xd05e6ae1590e3e83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.291966:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1783350223.291969:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350223.291974:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d49f219/0xd05e6ae1590e3e83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.291984:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d49f219/0xd05e6ae1590e3e83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.291993:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d49f219/0xd05e6ae1590e3e83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.292000:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d49f219/0xd05e6ae1590e3e83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.292022:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783350223.292453:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783350223.292461:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1596922/0xd05e6ae1590e3e7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.292470:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374603000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350223.292475:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1596922/0xd05e6ae1590e3e7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.292496:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1596922/0xd05e6ae1590e3e7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.292516:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1596922/0xd05e6ae1590e3e7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.292524:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1596922/0xd05e6ae1590e3e7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.292541:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350223.292545:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d49f219/0xd05e6ae1590e3e83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.292551:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350223.292554:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d49f219/0xd05e6ae1590e3e83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.292561:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d49f219/0xd05e6ae1590e3e83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.292569:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d49f219/0xd05e6ae1590e3e83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.292576:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d49f219/0xd05e6ae1590e3e83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.292599:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350223.292601:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350223.292603:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350223.292910:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350223.292917:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000367ece1c/0xd05e6ae1590e3e8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.292926:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1783350223.292930:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350223.292934:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000367ece1c/0xd05e6ae1590e3e8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.292945:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000367ece1c/0xd05e6ae1590e3e8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.292964:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000367ece1c/0xd05e6ae1590e3e8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.292972:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000367ece1c/0xd05e6ae1590e3e8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.292985:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350223.293204:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350223.293210:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000367ece1c/0xd05e6ae1590e3e8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.293217:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602e00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350223.293220:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000367ece1c/0xd05e6ae1590e3e8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.293227:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000367ece1c/0xd05e6ae1590e3e8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.293239:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000367ece1c/0xd05e6ae1590e3e8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.293252:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000367ece1c/0xd05e6ae1590e3e8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.293265:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350223.293267:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350223.293269:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350223.293274:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350223.294943:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350223.294955:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3200e6f/0xd05e6ae1590e3e91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.294970:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1783350223.294974:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350223.294979:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3200e6f/0xd05e6ae1590e3e91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.294991:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3200e6f/0xd05e6ae1590e3e91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.295000:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3200e6f/0xd05e6ae1590e3e91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.295008:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3200e6f/0xd05e6ae1590e3e91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.295033:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350223.295295:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350223.295307:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3200e6f/0xd05e6ae1590e3e91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.295318:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350223.295322:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3200e6f/0xd05e6ae1590e3e91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.295330:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3200e6f/0xd05e6ae1590e3e91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.295345:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3200e6f/0xd05e6ae1590e3e91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.295353:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3200e6f/0xd05e6ae1590e3e91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.295368:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350223.295369:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350223.295371:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.297764:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.297776:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3e98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.297790:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.297794:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.297800:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.297813:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.298932:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.298943:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.298966:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783350223.300310:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.300322:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3e9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.300344:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.300349:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.300355:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.300368:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.300377:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.300385:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.300406:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783350223.300618:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783350223.300625:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.300634:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350223.300639:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.300647:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3e98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.300663:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3e98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.300671:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3e98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.300687:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350223.300691:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.300704:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ec00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350223.300707:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.300714:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3e9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.300723:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3e9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.300730:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3e9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.300742:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350223.300744:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350223.300746:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.301007:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.301437:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.301445:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ea6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.301455:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.301459:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.301463:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.301473:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.301493:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.301501:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.301524:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350223.301906:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350223.301912:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.301920:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fc00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.301924:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.301931:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.301944:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ea6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.301951:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ea6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.301967:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.301969:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.301970:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350223.304796:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350223.304808:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008364e90/0xd05e6ae1590e3ead lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.304845:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=664s v=(0 0) 00010000:00010000:3.0:1783350223.304849:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350223.304855:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008364e90/0xd05e6ae1590e3ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.304869:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008364e90/0xd05e6ae1590e3ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.304879:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008364e90/0xd05e6ae1590e3ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.304887:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008364e90/0xd05e6ae1590e3ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.304909:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350223.305323:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350223.305331:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008364e90/0xd05e6ae1590e3ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.305351:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.305355:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008364e90/0xd05e6ae1590e3ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.305364:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008364e90/0xd05e6ae1590e3ead lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.305381:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008364e90/0xd05e6ae1590e3ead lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.305388:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008364e90/0xd05e6ae1590e3ead lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.305406:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.305408:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.305410:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350223.310519:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.310532:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3eb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.310549:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.310554:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.310561:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.310574:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.310594:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.310602:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.310627:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350223.310998:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350223.311006:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.311015:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350223.311020:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.311029:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3eb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.311057:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3eb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.311064:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6dd4c4f/0xd05e6ae1590e3eb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.311093:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350223.311095:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350223.311096:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350223.311569:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.311576:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077a13df4/0xd05e6ae1590e3ebb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.311585:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.311588:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.311593:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077a13df4/0xd05e6ae1590e3ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.311603:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077a13df4/0xd05e6ae1590e3ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.311611:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077a13df4/0xd05e6ae1590e3ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.311623:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077a13df4/0xd05e6ae1590e3ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.311655:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350223.312932:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350223.312941:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077a13df4/0xd05e6ae1590e3ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.312953:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.312957:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077a13df4/0xd05e6ae1590e3ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.312968:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077a13df4/0xd05e6ae1590e3ebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.312993:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077a13df4/0xd05e6ae1590e3ebb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.313001:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077a13df4/0xd05e6ae1590e3ebb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.313020:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.313022:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.313024:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350223.313164:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.313171:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f5f730e/0xd05e6ae1590e3ec2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.313181:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.313185:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.313190:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f5f730e/0xd05e6ae1590e3ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.313201:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f5f730e/0xd05e6ae1590e3ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.313209:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f5f730e/0xd05e6ae1590e3ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.313216:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f5f730e/0xd05e6ae1590e3ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.313237:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350223.314411:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350223.314419:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f5f730e/0xd05e6ae1590e3ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.314430:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.314433:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f5f730e/0xd05e6ae1590e3ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.314442:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f5f730e/0xd05e6ae1590e3ec2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.314459:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f5f730e/0xd05e6ae1590e3ec2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.314466:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f5f730e/0xd05e6ae1590e3ec2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.314497:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.314498:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.314500:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350223.316984:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.316996:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3ec9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.317012:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.317022:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.317030:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.317044:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.317054:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.317063:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.317098:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350223.317218:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350223.317225:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.317233:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d809000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.317237:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.317246:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3ec9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.317262:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3ec9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.317269:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c931fd7b/0xd05e6ae1590e3ec9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.317286:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.317288:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.317290:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783350223.324682:0:24992:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1783350223.324713:0:24992:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1783350223.324718:0:24992:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783350223.324972:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23409:x1869977659629440:12345-0@lo:5:osp-pre-1-1.0 Request processed in 64809us (65701us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1783350223.324984:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783350223.325068:0:23409:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1783350223.325086:0:23409:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1869977659629440:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1783350223.325101:0:23409:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1783350223.325184:0:23409:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23409:1869977659629568:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1783350223.325223:0:23409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350223.325247:0:23409:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350d036c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350223.325469:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659629568 00000100:00100000:3.0:1783350223.325476:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659629568 00000100:00100000:3.0:1783350223.325553:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783350223.325561:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23409:x1869977659629568:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1783350223.325616:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23409:x1869977659629568:12345-0@lo:900:osp-pre-1-1.0 Request processed in 56us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350223.325623:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783350223.325673:0:23409:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f5c9f80 x1869977659629568/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783350239 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350223.325685:0:23409:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23409:1869977659629568:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1783350223.325847:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.325856:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ec1802c/0xd05e6ae1590e3ed0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.325872:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.325877:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.325884:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ec1802c/0xd05e6ae1590e3ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.325896:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ec1802c/0xd05e6ae1590e3ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.325905:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ec1802c/0xd05e6ae1590e3ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.325920:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ec1802c/0xd05e6ae1590e3ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.325941:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350223.326475:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350223.326483:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ec1802c/0xd05e6ae1590e3ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.326493:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.326498:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ec1802c/0xd05e6ae1590e3ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.326507:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ec1802c/0xd05e6ae1590e3ed0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.326525:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ec1802c/0xd05e6ae1590e3ed0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.326533:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ec1802c/0xd05e6ae1590e3ed0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.326567:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.326568:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.326570:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350223.326676:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.326681:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088750ae2/0xd05e6ae1590e3ed7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.326691:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.326693:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.326697:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088750ae2/0xd05e6ae1590e3ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.326706:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088750ae2/0xd05e6ae1590e3ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.326713:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088750ae2/0xd05e6ae1590e3ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.326720:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088750ae2/0xd05e6ae1590e3ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.326742:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350223.326986:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350223.326991:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088750ae2/0xd05e6ae1590e3ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.326999:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808a00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.327003:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088750ae2/0xd05e6ae1590e3ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.327011:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088750ae2/0xd05e6ae1590e3ed7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.327023:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088750ae2/0xd05e6ae1590e3ed7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.327030:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088750ae2/0xd05e6ae1590e3ed7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.327043:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.327045:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.327046:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350223.327128:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.327160:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3ede lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.327175:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.327178:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.327182:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.327191:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.327199:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.327206:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.327220:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350223.327557:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350223.327563:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.327581:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.327585:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.327593:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3ede lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.327605:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3ede lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.327613:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8a371d9/0xd05e6ae1590e3ede lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.327627:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.327628:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.327629:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350223.327707:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.327713:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3ee5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.327721:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.327723:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.327727:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.327737:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.327757:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.327764:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.327785:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783350223.328254:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350223.328262:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3eec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.328270:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1783350223.328273:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350223.328277:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.328285:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.328292:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.328425:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350223.328432:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.328441:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808e00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.328444:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.328452:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3ee5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.328472:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3ee5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.328479:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e3ee5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.328497:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.328499:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.328501:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350223.328530:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350223.328590:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350223.340177:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350223.340190:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.340204:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350223.340209:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.340220:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.340241:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3eec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.340249:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e3eec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350223.340295:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.340297:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350223.340311:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.345490:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.345506:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ef3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.345522:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.345526:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.345532:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.345546:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.345555:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.345564:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.345597:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350223.345610:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350223.345617:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.345624:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fc00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350223.345628:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.345635:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.345650:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ef3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.345656:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3ef3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.345671:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.345672:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.345674:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.347085:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.347097:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3efa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.347110:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.347122:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.347127:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.347155:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.347165:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.347172:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.347188:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350223.347197:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350223.347202:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.347209:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ec00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350223.347213:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.347223:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3efa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.347240:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3efa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.347258:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b07ee184/0xd05e6ae1590e3efa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.347275:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.347277:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.347279:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.350777:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.350790:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3f01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.350806:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.350810:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.350815:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.350828:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.350837:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.350845:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.350863:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350223.350872:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350223.350888:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.350895:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350223.350899:0:23820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.350907:0:23820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3f01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.350920:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3f01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.350927:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3f01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.350942:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.350943:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.350945:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.351970:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.351980:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3f08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.351991:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.351994:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.351999:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.352023:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.352032:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.352040:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.352057:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350223.352068:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350223.352072:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.352094:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350223.352098:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.352106:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3f08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.352119:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3f08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.352125:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8541dda/0xd05e6ae1590e3f08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.352167:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.352168:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.352170:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.354236:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.354248:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052f58715/0xd05e6ae1590e3f0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.354264:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.354268:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.354274:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052f58715/0xd05e6ae1590e3f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.354287:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052f58715/0xd05e6ae1590e3f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.358144:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052f58715/0xd05e6ae1590e3f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.358169:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052f58715/0xd05e6ae1590e3f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.358193:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350223.358206:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350223.358211:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052f58715/0xd05e6ae1590e3f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.358231:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6e00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350223.358235:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052f58715/0xd05e6ae1590e3f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.358247:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052f58715/0xd05e6ae1590e3f0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.358267:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052f58715/0xd05e6ae1590e3f0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.358274:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052f58715/0xd05e6ae1590e3f0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.358294:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.358296:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.358298:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.358983:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.358992:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e3f16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359005:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.359010:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.359016:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e3f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359030:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e3f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359047:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e3f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359054:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e3f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359090:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783350223.359485:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.359492:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e3f1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359501:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.359514:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.359518:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e3f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359528:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e3f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359535:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e3f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359542:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e3f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359569:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783350223.359580:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783350223.359584:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e3f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359592:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350223.359595:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e3f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359603:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e3f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359617:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e3f16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359624:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e3f16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359638:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350223.359641:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e3f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359647:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7a00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350223.359650:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e3f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359669:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e3f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359681:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e3f1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359689:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e3f1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.359701:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.359703:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.359704:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.360037:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.360043:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000675647c1/0xd05e6ae1590e3f24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360051:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.360054:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.360058:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000675647c1/0xd05e6ae1590e3f24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360067:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000675647c1/0xd05e6ae1590e3f24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360085:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000675647c1/0xd05e6ae1590e3f24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360099:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000675647c1/0xd05e6ae1590e3f24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360114:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350223.360123:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350223.360127:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000675647c1/0xd05e6ae1590e3f24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360164:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350223.360169:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000675647c1/0xd05e6ae1590e3f24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360178:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000675647c1/0xd05e6ae1590e3f24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360189:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000675647c1/0xd05e6ae1590e3f24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360196:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000675647c1/0xd05e6ae1590e3f24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360209:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.360211:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.360212:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.360650:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.360665:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001426ee25/0xd05e6ae1590e3f2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360676:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.360679:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.360684:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001426ee25/0xd05e6ae1590e3f2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360694:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001426ee25/0xd05e6ae1590e3f2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360703:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001426ee25/0xd05e6ae1590e3f2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360710:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001426ee25/0xd05e6ae1590e3f2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360726:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350223.360735:0:22654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350223.360739:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001426ee25/0xd05e6ae1590e3f2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360745:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350223.360749:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001426ee25/0xd05e6ae1590e3f2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360757:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001426ee25/0xd05e6ae1590e3f2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360776:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001426ee25/0xd05e6ae1590e3f2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360783:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001426ee25/0xd05e6ae1590e3f2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.360797:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.360799:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350223.360800:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350223.361388:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350223.361628:0:24175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350223.361636:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2eab39/0xd05e6ae1590e3f32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.361648:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1783350223.361651:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350223.361656:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da2eab39/0xd05e6ae1590e3f32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.361667:0:24175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da2eab39/0xd05e6ae1590e3f32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.361676:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2eab39/0xd05e6ae1590e3f32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.361683:0:24175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da2eab39/0xd05e6ae1590e3f32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350223.361720:0:24175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350223.362214:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350223.362221:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da2eab39/0xd05e6ae1590e3f32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.362229:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6a00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350223.362232:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2eab39/0xd05e6ae1590e3f32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.362248:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2eab39/0xd05e6ae1590e3f32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.362264:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da2eab39/0xd05e6ae1590e3f32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.362270:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da2eab39/0xd05e6ae1590e3f32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350223.362288:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350223.362290:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350223.362292:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783350223.362463:0:24175:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1783350223.362674:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22691:x1869977659629184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 113677us (113794us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350223.362684:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783350223.367715:0:22691:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1869977659629184:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783350223.367733:0:22691:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1783350223.367784:0:22691:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1869977659629696:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783350223.367840:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350223.369430:0:22691:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea34b640480 going to sleep for 11 seconds 00000100:00100000:2.0:1783350223.370695:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659629696 00000100:00100000:2.0:1783350223.370708:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659629696 00000100:00100000:2.0:1783350223.370807:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783350223.370817:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22691:x1869977659629696:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783350223.370860:0:24174:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1783350223.372610:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22691:x1869977659629696:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1790us (4766us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1783350223.372620:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783350223.372748:0:22691:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1869977659629696:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783350223.372763:0:22691:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1783350223.620465:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350224.644292:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783350224.826947:0:25347:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1783350224.969475:0:22698:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783350225.670454:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783350225.781759:0:25399:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783350225.782051:0:25399:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1783350226.629415:0:25451:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783350226.629629:0:25451:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783350226.692652:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350226.820474:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783350226.820499:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659629824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783350226.820567:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350226.820648:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659629824 00000100:00100000:0.0:1783350226.820656:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659629824 00000100:00100000:0.0:1783350226.820711:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783350226.820720:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659629824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783350226.820745:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783350226.820798:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659629824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350226.820805:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1783350226.820851:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783350226.820885:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659629824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783350226.916384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350226.919438:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642746240 00000100:00100000:1.0:1783350226.919453:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642746240 00000100:00100000:2.0:1783350226.922704:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:2.0:1783350226.922714:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1869977642746240:12345-192.168.203.50@tcp:250:mount.lustre.0 00010000:00080000:2.0:1783350226.922742:0:22659:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d@192.168.203.50@tcp t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1783350226.922770:0:22659:0:(genops.c:1406:class_connect()) connect: client 90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d, cookie 0xd05e6ae1590e3f39 00000100:00080000:2.0:1783350226.922896:0:22659:0:(import.c:65:import_set_state_nolock()) ffff8ea24368a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783350226.922972:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+5:2398:x1869977642746240:12345-192.168.203.50@tcp:250:mount.lustre.0 Request processed in 256us (6597us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350226.922980:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:0.0:1783350226.928782:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350226.928994:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642746368 00000100:00100000:3.0:1783350226.929005:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642746368 00000100:00100000:3.0:1783350226.929072:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:3.0:1783350226.929083:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+5:18038:x1869977642746368:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783350226.929100:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350226.929118:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cde00/0xd05e6ae1590e3f40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded413 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350226.929190:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cde00/0xd05e6ae1590e3f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded413 expref: 6 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350226.929216:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cde00/0xd05e6ae1590e3f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded413 expref: 6 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350226.929226:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cde00, rc 0) 00000100:00100000:3.0:1783350226.929291:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+6:18038:x1869977642746368:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 209us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350226.929299:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:3.0:1783350226.934081:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350226.934957:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642746496 00000100:00100000:1.0:1783350226.934968:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642746496 00000100:00100000:2.0:1783350226.935173:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 117 00000100:00100000:2.0:1783350226.935212:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+6:18038:x1869977642746496:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783350226.935347:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+6:18038:x1869977642746496:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 163us (1275us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783350226.935355:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 117 00000100:00100000:1.0:1783350226.945554:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350226.945706:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642746624 00000100:00100000:3.0:1783350226.945717:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642746624 00000100:00100000:3.0:1783350226.945774:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 118 00000100:00100000:3.0:1783350226.945784:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+6:18038:x1869977642746624:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783350226.945801:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350226.945818:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3f47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded41a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350226.945855:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded41a expref: 7 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350226.945869:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e3f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded41a expref: 7 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350226.945878:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd400, rc 0) 00000100:00100000:3.0:1783350226.945937:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+7:18038:x1869977642746624:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 155us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350226.945944:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 118 00000100:00100000:0.0:1783350226.952238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350226.953081:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642746752 00000100:00100000:1.0:1783350226.953092:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642746752 00000100:00100000:1.0:1783350226.953174:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 119 00000100:00100000:1.0:1783350226.953185:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+7:18038:x1869977642746752:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783350226.956006:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+8:18038:x1869977642746752:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 2813us (3767us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350226.956020:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 119 00000100:00100000:1.0:1783350226.964428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350226.965642:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642746880 00000100:00100000:3.0:1783350226.965655:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642746880 00000100:00100000:3.0:1783350226.965807:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:3.0:1783350226.965816:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+8:18038:x1869977642746880:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783350226.966529:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+8:18038:x1869977642746880:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 711us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350226.966538:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:0.0:1783350226.970617:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350226.970759:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642747008 00000100:00100000:2.0:1783350226.970770:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642747008 00000100:00100000:2.0:1783350226.970828:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:2.0:1783350226.970838:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24302ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+8:18057:x1869977642747008:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783350226.971296:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24302ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+8:18057:x1869977642747008:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 458us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350226.971305:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:0.0:1783350226.997092:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350227.000884:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642747136 00000100:00100000:3.0:1783350227.000897:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642747136 00000100:00100000:2.0:1783350227.001504:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:2.0:1783350227.001515:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+8:18057:x1869977642747136:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783350227.001670:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+8:18057:x1869977642747136:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 156us (4587us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.001679:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:1.0:1783350227.010876:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350227.011386:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642747264 00000100:00100000:2.0:1783350227.011396:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642747264 00000100:00100000:2.0:1783350227.011446:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 123 00000100:00100000:2.0:1783350227.011456:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+8:18057:x1869977642747264:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783350227.011603:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+8:18057:x1869977642747264:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 148us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.011611:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 123 00000100:00100000:0.0:1783350227.023738:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350227.023935:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642747392 00000100:00100000:3.0:1783350227.023945:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642747392 00000100:00100000:3.0:1783350227.024069:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 124 00000100:00100000:3.0:1783350227.024080:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+8:18038:x1869977642747392:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783350227.024099:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350227.024116:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e3f4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded44b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350227.024182:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e3f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded44b expref: 9 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350227.024193:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e3f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded44b expref: 9 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350227.024201:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cca00, rc 0) 00000100:00100000:3.0:1783350227.024269:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+9:18038:x1869977642747392:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 191us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350227.024277:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 124 00000100:00100000:1.0:1783350227.030517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350227.030660:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642747520 00000100:00100000:0.0:1783350227.030670:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642747520 00000100:00100000:0.0:1783350227.030725:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 125 00000100:00100000:0.0:1783350227.030735:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+9:18038:x1869977642747520:12345-192.168.203.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783350227.030761:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783350227.030793:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783350227.030798:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783350227.030801:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783350227.030804:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783350227.030806:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1783350227.037449:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+9:18038:x1869977642747520:12345-192.168.203.50@tcp:256:mount.lustre.0 Request processed in 6707us (6933us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350227.037463:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 125 00000100:00100000:1.0:1783350227.041510:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350227.041603:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642747648 00000100:00100000:3.0:1783350227.041627:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642747648 00000100:00100000:3.0:1783350227.041685:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:3.0:1783350227.041812:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+9:18038:x1869977642747648:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783350227.041831:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350227.041850:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e3f55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded452 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350227.041881:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e3f55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded452 expref: 10 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350227.041894:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e3f55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded452 expref: 10 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350227.041904:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc000, rc 0) 00000100:00100000:3.0:1783350227.041959:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+10:18038:x1869977642747648:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 266us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350227.041967:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:1.0:1783350227.049538:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350227.049724:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642747776 00000100:00100000:0.0:1783350227.049735:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642747776 00000100:00100000:0.0:1783350227.049788:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 127 00000100:00100000:0.0:1783350227.049798:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea376a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+10:18038:x1869977642747776:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783350227.049952:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea376a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+10:18038:x1869977642747776:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 155us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350227.049961:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 127 00000100:00100000:1.0:1783350227.056721:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350227.056865:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642747904 00000100:00100000:2.0:1783350227.056875:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642747904 00000100:00100000:2.0:1783350227.056932:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 128 00000100:00100000:2.0:1783350227.056942:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+10:18038:x1869977642747904:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783350227.057084:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+10:18038:x1869977642747904:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 143us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.057093:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 128 00000100:00100000:1.0:1783350227.064755:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350227.065186:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642748032 00000100:00100000:0.0:1783350227.065198:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642748032 00000100:00100000:2.0:1783350227.065423:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 129 00000100:00100000:2.0:1783350227.065434:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+10:18064:x1869977642748032:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783350227.065599:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+10:18064:x1869977642748032:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 165us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.065608:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 129 00000100:00100000:1.0:1783350227.069983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350227.070131:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642748160 00000100:00100000:3.0:1783350227.070177:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642748160 00000100:00100000:3.0:1783350227.070466:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:3.0:1783350227.070478:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+10:18064:x1869977642748160:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783350227.071018:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+10:18064:x1869977642748160:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 540us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350227.071028:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:1.0:1783350227.079917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350227.080022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350227.080103:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642748288 00000100:00100000:2.0:1783350227.080113:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642748288 00000100:00100000:2.0:1783350227.080182:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642748544 00000100:00100000:2.0:1783350227.080186:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642748544 00000100:00100000:2.0:1783350227.080204:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:2.0:1783350227.080212:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1869977642748288:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783350227.080241:0:22665:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from d2fd8619-94bf-44d4-83ae-710347291d72@192.168.203.50@tcp t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1783350227.080289:0:22665:0:(genops.c:1406:class_connect()) connect: client d2fd8619-94bf-44d4-83ae-710347291d72, cookie 0xd05e6ae1590e3f5c 00000004:00100000:2.0:1783350227.080314:0:22665:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783350227.080380:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:3.0:1783350227.080389:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1869977642748544:12345-192.168.203.50@tcp:38:mount.lustre.0 00000100:00080000:2.0:1783350227.080506:0:22665:0:(import.c:65:import_set_state_nolock()) ffff8ea243689000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783350227.080572:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+6:2398:x1869977642748288:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 359us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.080581:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00010000:00080000:3.0:1783350227.081312:0:22664:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from d2fd8619-94bf-44d4-83ae-710347291d72@192.168.203.50@tcp t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1783350227.082006:0:22664:0:(genops.c:1406:class_connect()) connect: client d2fd8619-94bf-44d4-83ae-710347291d72, cookie 0xd05e6ae1590e3f63 00000004:00100000:2.0:1783350227.082032:0:22664:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783350227.082307:0:22664:0:(import.c:65:import_set_state_nolock()) ffff8ea37e5dc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783350227.082364:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+6:2398:x1869977642748544:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 1975us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.082373:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:1.0:1783350227.097786:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350227.097834:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350227.098358:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642748416 00000100:00100000:2.0:1783350227.098369:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642748416 00000100:00100000:0.0:1783350227.098418:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642748800 00000100:00100000:0.0:1783350227.098423:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642748800 00000100:00100000:2.0:1783350227.098492:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:2.0:1783350227.098503:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+7:0:x1869977642748416:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783350227.098543:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783350227.098621:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+7:0:x1869977642748416:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 120us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.098628:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:2.0:1783350227.098645:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:2.0:1783350227.098652:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+6:18038:x1869977642748800:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783350227.098665:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783350227.098687:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+6:18038:x1869977642748800:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 36us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.098694:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00080000:1.0:1783350227.098745:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783350227.103824:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350227.104469:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642748672 00000100:00100000:2.0:1783350227.104481:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642748672 00000100:00100000:2.0:1783350227.104556:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:2.0:1783350227.104565:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+6:0:x1869977642748672:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783350227.104604:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783350227.104681:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+6:0:x1869977642748672:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 117us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.104703:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00080000:1.0:1783350227.105555:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783350227.110356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350227.110439:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642748928 00000100:00100000:3.0:1783350227.110449:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642748928 00000100:00100000:3.0:1783350227.110545:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:3.0:1783350227.110568:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+6:18038:x1869977642748928:12345-192.168.203.50@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783350227.110658:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+6:18038:x1869977642748928:12345-192.168.203.50@tcp:40:mount.lustre.0 Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350227.110665:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:1.0:1783350227.121325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350227.121435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350227.121473:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350227.121529:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642749312 00000100:00100000:2.0:1783350227.121550:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642749312 00000100:00100000:2.0:1783350227.121624:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:2.0:1783350227.121634:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d2fd8619-94bf-44d4-83ae-710347291d72+6:18038:x1869977642749312:12345-192.168.203.50@tcp:900:mount.lustre.0 00000100:00100000:2.0:1783350227.121722:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d2fd8619-94bf-44d4-83ae-710347291d72+6:18038:x1869977642749312:12345-192.168.203.50@tcp:900:mount.lustre.0 Request processed in 89us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.121730:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:3.0:1783350227.122922:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642749056 00000100:00100000:3.0:1783350227.122932:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642749056 00000100:00100000:2.0:1783350227.122975:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642749184 00000100:00100000:2.0:1783350227.122978:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642749184 00000100:00100000:2.0:1783350227.123124:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:2.0:1783350227.123131:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1869977642749184:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783350227.123190:0:24175:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from d2fd8619-94bf-44d4-83ae-710347291d72@192.168.203.50@tcp t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1783350227.123229:0:24175:0:(genops.c:1406:class_connect()) connect: client d2fd8619-94bf-44d4-83ae-710347291d72, cookie 0xd05e6ae1590e3f6a 00002000:00100000:2.0:1783350227.123241:0:24175:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d2fd8619-94bf-44d4-83ae-710347291d72/ffff8ea37e5dd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783350227.123259:0:24175:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783350227.123420:0:24175:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783350227.123447:0:24175:0:(import.c:65:import_set_state_nolock()) ffff8ea37e5da800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783350227.123497:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fd8619-94bf-44d4-83ae-710347291d72+6:2398:x1869977642749184:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 365us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.123504:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:2.0:1783350227.124924:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:2.0:1783350227.124933:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1869977642749056:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783350227.124961:0:24173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d2fd8619-94bf-44d4-83ae-710347291d72@192.168.203.50@tcp t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1783350227.124996:0:24173:0:(genops.c:1406:class_connect()) connect: client d2fd8619-94bf-44d4-83ae-710347291d72, cookie 0xd05e6ae1590e3f71 00002000:00100000:2.0:1783350227.125022:0:24173:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d2fd8619-94bf-44d4-83ae-710347291d72/ffff8ea37e5d8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783350227.125033:0:24173:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783350227.125386:0:24173:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783350227.125413:0:24173:0:(import.c:65:import_set_state_nolock()) ffff8ea37e5d8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783350227.125469:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fd8619-94bf-44d4-83ae-710347291d72+6:2398:x1869977642749056:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 535us (4254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.125477:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:1.0:1783350227.129236:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350227.130201:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642749440 00000100:00100000:3.0:1783350227.130212:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642749440 00000100:00100000:3.0:1783350227.130265:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:3.0:1783350227.130283:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fd8619-94bf-44d4-83ae-710347291d72+6:18038:x1869977642749440:12345-192.168.203.50@tcp:33:mount.lustre.0 00000004:00080000:3.0:1783350227.130901:0:22667:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 539us 00000004:00200000:2.0:1783350227.154071:0:22667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783350227.154218:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fd8619-94bf-44d4-83ae-710347291d72+6:18038:x1869977642749440:12345-192.168.203.50@tcp:33:mount.lustre.0 Request processed in 23939us (24986us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350227.154233:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:1.0:1783350227.332482:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37b5d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659629952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783350227.332567:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350227.332688:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659630080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783350227.332717:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350227.332769:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659629952 00000100:00100000:0.0:1783350227.332776:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659629952 00000100:00100000:0.0:1783350227.332817:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659630080 00000100:00100000:0.0:1783350227.332820:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659630080 00000100:00100000:0.0:1783350227.332835:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783350227.332843:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659629952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783350227.332877:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783350227.333020:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783350227.333030:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659630080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783350227.333059:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783350227.333107:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659630080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350227.333113:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783350227.333479:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659630080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783350227.335763:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659629952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2908us (3182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350227.335778:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783350227.335925:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37b5d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659629952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783350227.342792:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350227.342887:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642749568 00000100:00100000:0.0:1783350227.342896:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642749568 00000100:00100000:0.0:1783350227.342960:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:0.0:1783350227.342971:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+6:18087:x1869977642749568:12345-192.168.203.50@tcp:101:mkdir.0 00010000:00010000:0.0:1783350227.342992:0:24663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350227.343035:0:24663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e3f78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded483 expref: -99 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350227.343117:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e3f7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350227.343130:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e3f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350227.343177:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e3f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783350227.343238:0:24663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783350227.343243:0:24663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783350227.343274:0:24663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e3f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350227.343301:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e3f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded483 expref: 8 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350227.343331:0:24663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e3f7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded483 expref: 7 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350227.343339:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e99c00) 00010000:00010000:0.0:1783350227.343343:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783350227.343346:0:24663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea37d808800, rc 0) 00000100:00100000:0.0:1783350227.343405:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+7:18087:x1869977642749568:12345-192.168.203.50@tcp:101:mkdir.0 Request processed in 436us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350227.343413:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00010000:00010000:3.0:1783350227.716349:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350227.845443:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659630208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783350227.845518:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350227.846194:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659630208 00000100:00100000:1.0:1783350227.846202:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659630208 00000100:00100000:1.0:1783350227.846274:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783350227.846283:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659630208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783350227.846305:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783350227.846367:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659630208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350227.846375:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783350227.846472:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659630208:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783350227.846534:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1783350228.296841:0:23421:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783350228.356633:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659630592:0@lo:400:kworker.0 00000100:00100000:0.0:1783350228.356700:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350228.356737:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659631104:0@lo:400:kworker.0 00000100:00100000:0.0:1783350228.356762:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350228.356778:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659631616:0@lo:400:kworker.0 00000100:00100000:0.0:1783350228.356799:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350228.356849:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783350228.356856:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659630720:0@lo:400:kworker.0 00000100:00100000:0.0:1783350228.356880:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350228.356898:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659631232:0@lo:400:kworker.0 00000100:00100000:0.0:1783350228.356918:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350228.356931:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659631744:0@lo:400:kworker.0 00000100:00100000:0.0:1783350228.356950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350228.356979:0:24664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659630720 00000100:00100000:0.0:1783350228.356986:0:24664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659630720 00000100:00100000:0.0:1783350228.357027:0:24664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659631232 00000100:00100000:0.0:1783350228.357031:0:24664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659631232 00000100:00100000:0.0:1783350228.357075:0:24664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783350228.357083:0:24664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659630720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350228.357158:0:24664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659630720:12345-0@lo:400:kworker.0 Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350228.357166:0:24664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783350228.357182:0:24664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783350228.357188:0:24664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659631232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350228.357216:0:24664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659631232:12345-0@lo:400:kworker.0 Request processed in 28us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350228.357222:0:24664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783350228.357242:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783350228.357273:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659630720:0@lo:400:kworker.0 00000100:00100000:0.0:1783350228.357283:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659631232:0@lo:400:kworker.0 00000100:00100000:1.0:1783350228.357432:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659630592 00000100:00100000:1.0:1783350228.357437:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659630592 00000100:00100000:1.0:1783350228.357479:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659631104 00000100:00100000:1.0:1783350228.357482:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659631104 00000100:00100000:1.0:1783350228.357496:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783350228.357502:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659630592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350228.357543:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659630592:12345-0@lo:400:kworker.0 Request processed in 42us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350228.357549:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783350228.357562:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783350228.357567:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659631104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350228.357594:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659631104:12345-0@lo:400:kworker.0 Request processed in 28us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350228.357599:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783350228.357624:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659630592:0@lo:400:kworker.0 00000100:00100000:1.0:1783350228.357634:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659631104:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.357714:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659630336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783350228.357749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350228.357778:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659630848:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.357804:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350228.357832:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659631360:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.357852:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350228.357868:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659631872:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.357891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350228.357921:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1783350228.357928:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659630464:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.357954:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350228.357975:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659630976:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.357995:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350228.358012:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659631488:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350228.358051:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659632000:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358073:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350228.358092:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659630848 00000100:00100000:2.0:1783350228.358096:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659630848 00000100:00100000:2.0:1783350228.358122:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659631360 00000100:00100000:2.0:1783350228.358125:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659631360 00000100:00100000:2.0:1783350228.358170:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783350228.358176:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869977659630848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358218:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869977659630848:12345-0@lo:400:kworker.0 Request processed in 35us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350228.358225:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783350228.358238:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783350228.358244:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659631360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358270:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659631360:12345-0@lo:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350228.358276:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783350228.358292:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659631616 00000100:00100000:2.0:1783350228.358295:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659631616 00000100:00100000:2.0:1783350228.358313:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659631744 00000100:00100000:2.0:1783350228.358315:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659631744 00000100:00100000:2.0:1783350228.358336:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659631872 00000100:00100000:2.0:1783350228.358338:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659631872 00000100:00100000:2.0:1783350228.358349:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659630976 00000100:00100000:2.0:1783350228.358351:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659630976 00000100:00100000:2.0:1783350228.358360:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659631488 00000100:00100000:2.0:1783350228.358363:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659631488 00000100:00100000:2.0:1783350228.358372:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659632000 00000100:00100000:2.0:1783350228.358374:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659632000 00000100:00100000:2.0:1783350228.358386:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783350228.358392:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659631616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358428:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659631616:12345-0@lo:400:kworker.0 Request processed in 36us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350228.358434:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783350228.358446:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783350228.358452:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659631744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358477:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659631744:12345-0@lo:400:kworker.0 Request processed in 26us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350228.358483:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783350228.358493:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783350228.358498:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659631872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358521:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659631872:12345-0@lo:400:kworker.0 Request processed in 23us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350228.358527:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783350228.358536:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783350228.358541:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659630976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358564:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659630976:12345-0@lo:400:kworker.0 Request processed in 23us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350228.358578:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783350228.358590:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783350228.358594:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659631488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358620:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659631488:12345-0@lo:400:kworker.0 Request processed in 26us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350228.358626:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783350228.358636:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783350228.358641:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659632000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358664:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659632000:12345-0@lo:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350228.358670:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1783350228.358684:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783350228.358688:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783350228.358690:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783350228.358715:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659630976:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358725:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659631488:0@lo:400:kworker.0 00010000:00080000:2.0:1783350228.358736:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36d73b480 x1869977659632000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350228.358746:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659632000:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358756:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659630848:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358764:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659631360:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358772:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659631872:0@lo:400:kworker.0 00010000:00080000:2.0:1783350228.358808:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36d739180 x1869977659631744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350228.358824:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659631744:0@lo:400:kworker.0 00000100:00100000:2.0:1783350228.358838:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659631616:0@lo:400:kworker.0 00000100:00100000:1.0:1783350228.358998:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659630336 00000100:00100000:1.0:1783350228.359004:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659630336 00000100:00100000:1.0:1783350228.359051:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350228.359058:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37b5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659630336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783350228.359080:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783350228.359121:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37b5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659630336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350228.359127:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350228.359180:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659630336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783350228.359434:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783350228.359467:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350228.359538:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659632128 00000100:00100000:1.0:1783350228.359542:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659632128 00000100:00100000:1.0:1783350228.359561:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783350228.359577:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659632128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783350228.359589:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783350228.359625:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659632128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350228.359631:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783350228.359699:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659630464 00000100:00100000:0.0:1783350228.359704:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659630464 00000100:00100000:0.0:1783350228.359746:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783350228.359752:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:3646:x1869977659630464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350228.359790:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:3646:x1869977659630464:12345-0@lo:400:kworker.0 Request processed in 39us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350228.359796:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783350228.359956:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659630464:0@lo:400:kworker.0 00000100:00100000:3.0:1783350228.360030:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659632128:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783350228.741190:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783350229.386849:0:24992:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2fd8619-94bf-44d4-83ae-710347291d72 00000001:00080000:1.0:1783350229.386864:0:24992:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1783350229.477634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350229.477731:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642749696 00000100:00100000:3.0:1783350229.477742:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642749696 00000100:00100000:3.0:1783350229.477835:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:3.0:1783350229.477846:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+7:18140:x1869977642749696:12345-192.168.203.50@tcp:41:lfs.0 00000004:00000024:3.0:1783350229.477884:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783350229.477970:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+7:18140:x1869977642749696:12345-192.168.203.50@tcp:41:lfs.0 Request processed in 126us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350229.477978:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00080000:2.0:1783350229.478202:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783350229.486975:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350229.487076:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642749824 00000100:00100000:2.0:1783350229.487085:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642749824 00000100:00100000:2.0:1783350229.487185:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:2.0:1783350229.487195:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+6:18140:x1869977642749824:12345-192.168.203.50@tcp:41:lfs.0 00000004:00000024:2.0:1783350229.487233:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783350229.487334:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+6:18140:x1869977642749824:12345-192.168.203.50@tcp:41:lfs.0 Request processed in 141us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350229.487342:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00080000:0.0:1783350229.487466:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783350229.492065:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350229.492764:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642749952 00000100:00100000:0.0:1783350229.492774:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642749952 00000100:00100000:0.0:1783350229.492893:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:0.0:1783350229.492903:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2fd8619-94bf-44d4-83ae-710347291d72+6:18140:x1869977642749952:12345-192.168.203.50@tcp:13:lfs.0 00002000:00000024:0.0:1783350229.492936:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783350229.493023:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2fd8619-94bf-44d4-83ae-710347291d72+6:18140:x1869977642749952:12345-192.168.203.50@tcp:13:lfs.0 Request processed in 121us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350229.493040:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00080000:2.0:1783350229.495656:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783350229.495983:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350229.496235:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642750080 00000100:00100000:0.0:1783350229.496245:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642750080 00000100:00100000:0.0:1783350229.496326:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:0.0:1783350229.496336:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2fd8619-94bf-44d4-83ae-710347291d72+5:18140:x1869977642750080:12345-192.168.203.50@tcp:13:lfs.0 00002000:00000024:0.0:1783350229.496382:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783350229.496476:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2fd8619-94bf-44d4-83ae-710347291d72+5:18140:x1869977642750080:12345-192.168.203.50@tcp:13:lfs.0 Request processed in 141us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350229.496483:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00080000:2.0:1783350229.496848:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783350229.683072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350229.689178:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642750208 00000100:00100000:2.0:1783350229.689196:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642750208 00000100:00100000:3.0:1783350229.689730:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 132 00000100:00100000:3.0:1783350229.689743:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+10:18172:x1869977642750208:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783350229.689762:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350229.689781:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3f86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded48a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350229.689812:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded48a expref: 11 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350229.689824:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e3f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded48a expref: 11 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350229.689834:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd000, rc 0) 00000100:00100000:3.0:1783350229.689910:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18172:x1869977642750208:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 169us (6846us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350229.689917:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 132 00000100:00100000:0.0:1783350229.692082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350229.692186:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642750336 00000100:00100000:2.0:1783350229.692195:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642750336 00000100:00100000:2.0:1783350229.692241:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:2.0:1783350229.692249:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18172:x1869977642750336:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783350229.692411:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18172:x1869977642750336:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 161us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350229.692419:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:2.0:1783350229.697833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350229.698483:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642750464 00000100:00100000:0.0:1783350229.698494:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642750464 00000100:00100000:0.0:1783350229.698595:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 134 00000100:00100000:0.0:1783350229.698606:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18172:x1869977642750464:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783350229.698758:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18172:x1869977642750464:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 153us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350229.698767:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 134 00000100:00100000:1.0:1783350229.726485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350229.726895:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642750592 00000100:00100000:3.0:1783350229.726905:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642750592 00000100:00100000:3.0:1783350229.726961:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 135 00000100:00100000:3.0:1783350229.726971:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18178:x1869977642750592:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783350229.727910:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18178:x1869977642750592:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 936us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350229.727920:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 135 00000100:00100000:1.0:1783350229.759227:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350229.759327:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642750720 00000100:00100000:0.0:1783350229.759337:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642750720 00000100:00100000:0.0:1783350229.759394:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 136 00000100:00100000:0.0:1783350229.759403:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18178:x1869977642750720:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783350229.759557:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18178:x1869977642750720:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 154us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350229.759565:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 136 00000100:00100000:2.0:1783350229.763585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350229.763680:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642750848 00000100:00100000:3.0:1783350229.763688:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642750848 00000100:00100000:3.0:1783350229.763734:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 137 00000100:00100000:3.0:1783350229.763742:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18178:x1869977642750848:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783350229.763883:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18178:x1869977642750848:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 141us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350229.763892:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 137 00000100:00100000:1.0:1783350229.771822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350229.772128:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642750976 00000100:00100000:2.0:1783350229.772167:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642750976 00000100:00100000:2.0:1783350229.772222:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 138 00000100:00100000:2.0:1783350229.772232:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36735f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18172:x1869977642750976:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783350229.772258:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350229.772275:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded4bb expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350229.772304:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4bb expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350229.772316:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4bb expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350229.772325:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6c00, rc 0) 00000100:00100000:2.0:1783350229.772373:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36735f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+12:18172:x1869977642750976:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 142us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350229.772381:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 138 00010000:00010000:0.0:1783350229.776436:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350229.778106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350229.778446:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642751104 00000100:00100000:0.0:1783350229.778457:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642751104 00000100:00100000:0.0:1783350229.778512:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 139 00000100:00100000:0.0:1783350229.778523:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+12:18172:x1869977642751104:12345-192.168.203.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783350229.778548:0:22657:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783350229.778572:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783350229.778576:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783350229.778579:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783350229.778582:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783350229.778584:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1783350229.782278:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+12:18172:x1869977642751104:12345-192.168.203.50@tcp:256:mount.lustre.0 Request processed in 3746us (4169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350229.782292:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 139 00000100:00100000:1.0:1783350229.785972:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350229.786181:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642751232 00000100:00100000:3.0:1783350229.786191:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642751232 00000100:00100000:3.0:1783350229.786291:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 140 00000100:00100000:3.0:1783350229.786301:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+12:18172:x1869977642751232:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783350229.786328:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350229.786346:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3f94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded4c2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350229.786381:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4c2 expref: 13 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350229.786392:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4c2 expref: 13 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350229.786410:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc800, rc 0) 00000100:00100000:3.0:1783350229.786470:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18172:x1869977642751232:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 170us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350229.786490:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 140 00000100:00100000:1.0:1783350229.793558:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350229.793631:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642751360 00000100:00100000:0.0:1783350229.793640:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642751360 00000100:00100000:0.0:1783350229.793707:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 141 00000100:00100000:0.0:1783350229.793716:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18172:x1869977642751360:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783350229.793863:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18172:x1869977642751360:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 148us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350229.793872:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 141 00000100:00100000:1.0:1783350229.797659:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350229.797853:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642751488 00000100:00100000:3.0:1783350229.797864:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642751488 00000100:00100000:3.0:1783350229.797919:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:3.0:1783350229.797929:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18172:x1869977642751488:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783350229.798087:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18172:x1869977642751488:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 159us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350229.798095:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:1.0:1783350229.800875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350229.800964:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642751616 00000100:00100000:2.0:1783350229.800972:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642751616 00000100:00100000:2.0:1783350229.801033:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 143 00000100:00100000:2.0:1783350229.801043:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18181:x1869977642751616:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783350229.801230:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18181:x1869977642751616:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 187us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350229.801239:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 143 00000100:00100000:1.0:1783350229.805594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350229.805684:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642751744 00000100:00100000:0.0:1783350229.805694:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642751744 00000100:00100000:0.0:1783350229.805752:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 144 00000100:00100000:0.0:1783350229.805762:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18181:x1869977642751744:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783350229.805914:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18181:x1869977642751744:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 152us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350229.805923:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 144 00000100:00100000:1.0:1783350229.823892:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350229.823986:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350229.824218:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642751872 00000100:00100000:3.0:1783350229.824229:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642751872 00000100:00100000:3.0:1783350229.824282:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642752128 00000100:00100000:3.0:1783350229.824286:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642752128 00000100:00100000:3.0:1783350229.824319:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:3.0:1783350229.824329:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1869977642751872:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783350229.824361:0:22666:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from dfa17c46-c0cf-418b-9e96-4c0ccaabd42c@192.168.203.50@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:3.0:1783350229.824400:0:22666:0:(genops.c:1406:class_connect()) connect: client dfa17c46-c0cf-418b-9e96-4c0ccaabd42c, cookie 0xd05e6ae1590e3f9b 00000004:00100000:3.0:1783350229.824426:0:22666:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783350229.824519:0:22666:0:(import.c:65:import_set_state_nolock()) ffff8ea2438ed800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783350229.824520:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:1.0:1783350229.824530:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1869977642752128:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783350229.824551:0:22664:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from dfa17c46-c0cf-418b-9e96-4c0ccaabd42c@192.168.203.50@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:1.0:1783350229.824590:0:22664:0:(genops.c:1406:class_connect()) connect: client dfa17c46-c0cf-418b-9e96-4c0ccaabd42c, cookie 0xd05e6ae1590e3fa2 00000100:00100000:3.0:1783350229.824596:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:2398:x1869977642751872:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 264us (709us total) trans 0 rc 0/0 00000004:00100000:1.0:1783350229.824606:0:22664:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783350229.824607:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00080000:1.0:1783350229.824677:0:22664:0:(import.c:65:import_set_state_nolock()) ffff8ea367365000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783350229.824708:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:2398:x1869977642752128:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 176us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350229.824716:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:1.0:1783350229.833526:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350229.833569:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350229.833651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350229.833815:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642752000 00000100:00100000:0.0:1783350229.833834:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642752000 00000100:00100000:0.0:1783350229.833899:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642752384 00000100:00100000:0.0:1783350229.833902:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642752384 00000100:00100000:0.0:1783350229.833915:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642752256 00000100:00100000:0.0:1783350229.833918:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642752256 00000100:00100000:0.0:1783350229.833936:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:0.0:1783350229.833945:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+7:0:x1869977642752000:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783350229.833976:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783350229.833979:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:3.0:1783350229.833991:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+7:18172:x1869977642752384:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783350229.834014:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783350229.834058:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+7:0:x1869977642752000:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 113us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350229.834066:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1783350229.834073:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+7:18172:x1869977642752384:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 83us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350229.834082:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1783350229.834089:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:0.0:1783350229.834099:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:0:x1869977642752256:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783350229.834125:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350229.834196:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:0:x1869977642752256:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 99us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350229.834202:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00080000:1.0:1783350229.834535:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783350229.834540:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783350229.839693:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350229.839777:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642752512 00000100:00100000:3.0:1783350229.839786:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642752512 00000100:00100000:3.0:1783350229.839845:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:3.0:1783350229.839854:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:18172:x1869977642752512:12345-192.168.203.50@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783350229.839967:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:18172:x1869977642752512:12345-192.168.203.50@tcp:40:mount.lustre.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350229.839975:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:1.0:1783350229.844780:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350229.844810:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350229.844885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350229.844961:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642752896 00000100:00100000:2.0:1783350229.844972:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642752896 00000100:00100000:2.0:1783350229.845054:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:2.0:1783350229.845065:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:18172:x1869977642752896:12345-192.168.203.50@tcp:900:mount.lustre.0 00000100:00100000:2.0:1783350229.845158:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:18172:x1869977642752896:12345-192.168.203.50@tcp:900:mount.lustre.0 Request processed in 95us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350229.845174:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:1.0:1783350229.849899:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350229.850198:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642753024 00000100:00100000:3.0:1783350229.850207:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642753024 00000100:00100000:3.0:1783350229.850257:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:3.0:1783350229.850266:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:18172:x1869977642753024:12345-192.168.203.50@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783350229.850357:0:22668:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783350229.850437:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:18172:x1869977642753024:12345-192.168.203.50@tcp:33:mount.lustre.0 Request processed in 172us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350229.850445:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:0.0:1783350229.850956:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642752640 00000100:00100000:0.0:1783350229.850962:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642752640 00000100:00100000:0.0:1783350229.850996:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642752768 00000100:00100000:0.0:1783350229.850999:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642752768 00000100:00100000:0.0:1783350229.851252:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:0.0:1783350229.851259:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1869977642752640:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783350229.851289:0:24174:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from dfa17c46-c0cf-418b-9e96-4c0ccaabd42c@192.168.203.50@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:0.0:1783350229.851321:0:24174:0:(genops.c:1406:class_connect()) connect: client dfa17c46-c0cf-418b-9e96-4c0ccaabd42c, cookie 0xd05e6ae1590e3fa9 00002000:00100000:0.0:1783350229.851334:0:24174:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dfa17c46-c0cf-418b-9e96-4c0ccaabd42c/ffff8ea243ab3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783350229.851345:0:24174:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783350229.851408:0:24174:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783350229.851437:0:24174:0:(import.c:65:import_set_state_nolock()) ffff8ea243ab5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783350229.851485:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:2398:x1869977642752640:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 224us (6673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350229.851491:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:0.0:1783350229.851508:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:0.0:1783350229.851511:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1869977642752768:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783350229.851527:0:24174:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from dfa17c46-c0cf-418b-9e96-4c0ccaabd42c@192.168.203.50@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:0.0:1783350229.851557:0:24174:0:(genops.c:1406:class_connect()) connect: client dfa17c46-c0cf-418b-9e96-4c0ccaabd42c, cookie 0xd05e6ae1590e3fb0 00002000:00100000:0.0:1783350229.851562:0:24174:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dfa17c46-c0cf-418b-9e96-4c0ccaabd42c/ffff8ea243ab3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783350229.851580:0:24174:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783350229.851619:0:24174:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783350229.851635:0:24174:0:(import.c:65:import_set_state_nolock()) ffff8ea3497b8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783350229.851659:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:2398:x1869977642752768:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 145us (6774us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350229.851665:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:1.0:1783350230.025426:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350230.025530:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642753152 00000100:00100000:0.0:1783350230.025540:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642753152 00000100:00100000:0.0:1783350230.025600:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:0.0:1783350230.025611:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:18204:x1869977642753152:12345-192.168.203.50@tcp:101:mkdir.0 00010000:00010000:0.0:1783350230.025631:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350230.025650:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e3fb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded4f3 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350230.025716:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350230.025729:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350230.025741:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783350230.025783:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783350230.025787:0:22665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783350230.025804:0:22665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350230.025829:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e3fb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4f3 expref: 8 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350230.025862:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4f3 expref: 7 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350230.025871:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e99c00) 00010000:00010000:0.0:1783350230.025874:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783350230.025877:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea37d808e00, rc 0) 00000100:00100000:0.0:1783350230.025982:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+7:18204:x1869977642753152:12345-192.168.203.50@tcp:101:mkdir.0 Request processed in 372us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350230.025989:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00010000:00010000:2.0:1783350230.789743:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350231.822833:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350231.941374:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659632256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783350231.941459:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350231.941725:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659632256 00000100:00100000:0.0:1783350231.941733:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659632256 00000100:00100000:0.0:1783350231.941800:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783350231.941810:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659632256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783350231.941840:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783350231.941898:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659632256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350231.941905:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783350231.941987:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659632256:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783350231.942096:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350232.452436:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659632384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783350232.452516:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350232.452609:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659632384 00000100:00100000:2.0:1783350232.452617:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659632384 00000100:00100000:2.0:1783350232.452668:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783350232.452677:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659632384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350232.452708:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783350232.452753:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659632384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350232.452760:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783350232.454247:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659632384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783350232.454724:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659632512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783350232.454778:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350232.454870:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659632512 00000100:00100000:0.0:1783350232.454877:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659632512 00000100:00100000:0.0:1783350232.454927:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783350232.454937:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659632512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783350232.454969:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350232.455049:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659632512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350232.455056:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783350232.455203:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659632512:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783350232.838109:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350232.964476:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659632640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783350232.964541:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350232.964597:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659632640 00000100:00100000:0.0:1783350232.964605:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659632640 00000100:00100000:0.0:1783350232.964654:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783350232.964661:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659632640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783350232.964682:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783350232.964723:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659632640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350232.964730:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1783350232.964749:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783350232.964783:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659632640:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1783350232.977630:0:24169:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dfa17c46-c0cf-418b-9e96-4c0ccaabd42c 00000001:00100000:3.0:1783350232.977646:0:24169:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2fd8619-94bf-44d4-83ae-710347291d72 00000001:00100000:0.0:1783350232.980188:0:23397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dfa17c46-c0cf-418b-9e96-4c0ccaabd42c 00000001:00100000:0.0:1783350232.980200:0:23397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d2fd8619-94bf-44d4-83ae-710347291d72 00000001:00100000:3.0:1783350232.989197:0:22645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dfa17c46-c0cf-418b-9e96-4c0ccaabd42c 00000001:00100000:3.0:1783350232.989212:0:22645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d2fd8619-94bf-44d4-83ae-710347291d72 00000001:02000400:1.0:1783350233.106096:0:25548:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1783350233.476452:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659632768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783350233.476534:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350233.476595:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659632896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783350233.476620:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350233.476657:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659632768 00000100:00100000:1.0:1783350233.476664:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659632768 00000100:00100000:1.0:1783350233.476705:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659632896 00000100:00100000:1.0:1783350233.476708:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659632896 00000100:00100000:1.0:1783350233.476726:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783350233.476748:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659632768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783350233.476778:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783350233.476821:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659632768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350233.476827:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783350233.476843:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783350233.476850:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659632896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783350233.476860:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783350233.476882:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659632896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350233.476887:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1783350233.476902:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783350233.476927:0:3649:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1783350233.476948:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659632768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783350233.476960:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659632896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783350233.479417:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659633152:0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.479479:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350233.479516:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659633024:0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.479525:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659633664:0@lo:400:kworker.0 00000100:00100000:0.0:1783350233.479831:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659633152 00000100:00100000:0.0:1783350233.479839:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659633152 00000100:00100000:0.0:1783350233.479886:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783350233.479894:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659633152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.479980:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659633408:0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.485912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350233.485980:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659634176:0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.486069:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350233.486178:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659634176 00000100:00100000:2.0:1783350233.489825:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659634176 00000100:00100000:2.0:1783350233.489912:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783350233.489924:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659634176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.490026:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659634176:12345-0@lo:400:kworker.0 Request processed in 106us (3956us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350233.490033:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783350233.490075:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659633280:0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.490113:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350233.490155:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659633792:0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.490180:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350233.490197:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659634304:0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.490215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350233.490245:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659633792 00000100:00100000:2.0:1783350233.490249:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659633792 00000100:00100000:2.0:1783350233.490271:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659634304 00000100:00100000:2.0:1783350233.490274:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659634304 00000100:00100000:0.0:1783350233.490784:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659633152:12345-0@lo:400:kworker.0 Request processed in 10888us (11303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350233.490794:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1783350233.491163:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783350233.491169:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783350233.491181:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659633664 00000100:00100000:1.0:1783350233.491185:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659633664 00000100:00100000:1.0:1783350233.491234:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659633280 00000100:00100000:1.0:1783350233.491238:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659633280 00000100:00100000:1.0:1783350233.491261:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783350233.491267:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659633664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.491311:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659633664:12345-0@lo:400:kworker.0 Request processed in 45us (5407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350233.491328:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783350233.491340:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350233.491345:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659633280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.491379:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659633280:12345-0@lo:400:kworker.0 Request processed in 34us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350233.491385:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350233.491409:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350233.491431:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659633408 00000100:00100000:1.0:1783350233.491434:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659633408 00000100:00100000:1.0:1783350233.491450:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783350233.491456:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659633792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.491485:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659633792:12345-0@lo:400:kworker.0 Request processed in 29us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350233.491491:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783350233.491503:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783350233.491508:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659633408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.491555:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659633408:12345-0@lo:400:kworker.0 Request processed in 47us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350233.491561:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783350233.491597:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659633408:0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.491606:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659633920:0@lo:400:kworker.0 00000100:00080000:0.0:1783350233.491907:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783350233.491980:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350233.492077:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659633280:0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.492090:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659633792:0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.492156:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659633920 00000100:00100000:1.0:1783350233.492161:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659633920 00000100:00100000:1.0:1783350233.492193:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783350233.492199:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659633920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.492466:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659633920:12345-0@lo:400:kworker.0 Request processed in 267us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350233.492474:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1783350233.492491:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783350233.492779:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783350233.492789:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659634304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.492831:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659634304:12345-0@lo:400:kworker.0 Request processed in 46us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350233.492837:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1783350233.492867:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36d739180 x1869977659634304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350233.492880:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36d739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659634304:0@lo:400:kworker.0 00000100:00100000:0.0:1783350233.493422:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659633920:0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.493486:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659633152:0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.493500:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659633664:0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.493516:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659634176:0@lo:400:kworker.0 00000100:00100000:3.0:1783350233.495023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350233.495164:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659633536:0@lo:400:kworker.0 00000100:00100000:3.0:1783350233.495222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350233.495404:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659634048:0@lo:400:kworker.0 00000100:00100000:3.0:1783350233.495432:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350233.495910:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659633024 00000100:00100000:2.0:1783350233.495919:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659633024 00000100:00100000:2.0:1783350233.495982:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783350233.495990:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:3646:x1869977659633024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.496065:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:3646:x1869977659633024:12345-0@lo:400:kworker.0 Request processed in 76us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350233.496072:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783350233.496271:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659633024:0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.499378:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659634048 00000100:00100000:2.0:1783350233.499393:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659634048 00000100:00100000:2.0:1783350233.499480:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783350233.499491:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659634048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350233.500063:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659634048:12345-0@lo:400:kworker.0 Request processed in 572us (4627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350233.500072:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1783350233.500189:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea24477ed80 x1869977659634048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350233.500206:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659634048:0@lo:400:kworker.0 00000100:00080000:0.0:1783350233.501376:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783350233.503394:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659633536 00000100:00100000:1.0:1783350233.503408:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659633536 00000100:00100000:1.0:1783350233.503473:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783350233.503483:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659633536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350233.503603:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659633536:12345-0@lo:400:kworker.0 Request processed in 121us (8379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350233.503611:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783350233.504368:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659633536:0@lo:400:kworker.0 00010000:00010000:2.0:1783350233.862426:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783350234.180831:0:22698:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783350234.888115:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783350235.020368:0:24992:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dfa17c46-c0cf-418b-9e96-4c0ccaabd42c 00000100:00100000:3.0:1783350235.223624:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350235.223925:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642753280 00000100:00100000:2.0:1783350235.223937:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642753280 00000100:00100000:2.0:1783350235.224018:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 146 00000100:00100000:2.0:1783350235.224028:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:2400:x1869977642753280:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350235.224103:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:2400:x1869977642753280:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 76us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350235.224111:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 146 00000100:00100000:3.0:1783350235.231233:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350235.231269:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350235.231291:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350235.231310:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350235.231328:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350235.231345:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350235.231385:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350235.231411:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350235.231438:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642753664 00000100:00100000:3.0:1783350235.231447:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642753664 00000100:00100000:3.0:1783350235.231507:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642754176 00000100:00100000:3.0:1783350235.231510:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642754176 00000100:00100000:3.0:1783350235.231523:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642753792 00000100:00100000:3.0:1783350235.231525:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642753792 00000100:00100000:3.0:1783350235.231535:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642754304 00000100:00100000:3.0:1783350235.231537:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642754304 00000100:00100000:3.0:1783350235.231551:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:3.0:1783350235.231559:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fd8619-94bf-44d4-83ae-710347291d72+5:2399:x1869977642753664:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350235.231624:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fd8619-94bf-44d4-83ae-710347291d72+5:2399:x1869977642753664:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 65us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350235.231631:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:3.0:1783350235.231647:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:3.0:1783350235.231653:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2399:x1869977642754176:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350235.231676:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2399:x1869977642754176:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 24us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350235.231682:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:3.0:1783350235.231692:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:3.0:1783350235.231698:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fd8619-94bf-44d4-83ae-710347291d72+5:2399:x1869977642753792:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350235.231736:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fd8619-94bf-44d4-83ae-710347291d72+5:2399:x1869977642753792:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 37us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350235.231743:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:3.0:1783350235.231754:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:3.0:1783350235.231766:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2399:x1869977642754304:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350235.231790:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2399:x1869977642754304:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350235.231795:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:3.0:1783350235.231813:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642753408 00000100:00100000:3.0:1783350235.231817:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642753408 00000100:00100000:3.0:1783350235.231836:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642753920 00000100:00100000:3.0:1783350235.231838:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642753920 00000100:00100000:3.0:1783350235.231849:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642753536 00000100:00100000:3.0:1783350235.231851:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642753536 00000100:00100000:3.0:1783350235.231861:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642754048 00000100:00100000:3.0:1783350235.231863:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642754048 00000100:00100000:3.0:1783350235.231876:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:3.0:1783350235.231882:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+6:2399:x1869977642753408:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350235.231907:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+6:2399:x1869977642753408:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350235.231913:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:3.0:1783350235.231922:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:3.0:1783350235.231928:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:2399:x1869977642753920:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350235.231949:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:2399:x1869977642753920:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350235.231954:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:3.0:1783350235.231964:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:3.0:1783350235.231970:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+5:2399:x1869977642753536:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350235.232002:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+5:2399:x1869977642753536:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 32us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350235.232014:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:3.0:1783350235.232025:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:3.0:1783350235.232030:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2399:x1869977642754048:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350235.232055:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2399:x1869977642754048:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 24us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350235.232061:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00080000:3.0:1783350235.232090:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783350235.232093:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783350235.232096:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783350235.232097:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783350235.910996:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783350236.825795:0:25696:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5ab289d0 20000000:00000080:2.0:1783350236.825811:0:25696:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ea37e5ca400 uarg=0000000000000000 20000000:01000000:2.0:1783350236.825856:0:25696:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783350236.825861:0:25696:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783350236.825866:0:25696:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783350236.826616:0:25697:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1783350236.826760:0:25696:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783350236.834843:0:25696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783350236.834873:0:25696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.834893:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3780af400/0xd05e6ae1590e3c22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c1b expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.834902:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3c30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c29 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.834909:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e3c6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3c68 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.834916:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cdc00/0xd05e6ae1590e3de9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3de2 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.834926:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e3f55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded452 expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.834932:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3f94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4c2 expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.834940:0:25696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.834996:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4c2 expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.835011:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3f94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4c2 expref: 12 pid: 22658 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350236.835026:0:25696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659634432:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783350236.835185:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e3f55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded452 expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.835195:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e3f55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded452 expref: 12 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350236.835204:0:25696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659634560:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783350236.835237:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cdc00/0xd05e6ae1590e3de9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3de2 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.835245:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3582cdc00/0xd05e6ae1590e3de9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3de2 expref: 23 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350236.835255:0:25696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659634688:0@lo:104: 00000100:00100000:2.0:1783350236.835292:0:25696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783350236.835319:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e3c6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3c68 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.835326:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e3c6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c68 expref: 23 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350236.835333:0:25696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659634816:0@lo:104: 00000100:00100000:2.0:1783350236.835351:0:25696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783350236.835370:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3c30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3c29 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.835376:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3c30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c29 expref: 23 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350236.835383:0:25696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659634944:0@lo:104: 00000100:00100000:2.0:1783350236.835409:0:25696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783350236.835424:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3780af400/0xd05e6ae1590e3c22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3c1b expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350236.835432:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3780af400/0xd05e6ae1590e3c22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c1b expref: 23 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350236.835439:0:25696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659635072:0@lo:104: 00000100:00100000:2.0:1783350236.835458:0:25696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350236.835467:0:25696:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36daca780 going to sleep for 11 seconds 00000100:00100000:0.0:1783350236.836642:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659634688 00000100:00100000:0.0:1783350236.836652:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659634688 00000100:00100000:0.0:1783350236.836696:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659634816 00000100:00100000:0.0:1783350236.836699:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659634816 00000100:00100000:0.0:1783350236.836710:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659634944 00000100:00100000:0.0:1783350236.836712:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659634944 00000100:00100000:0.0:1783350236.836719:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659635072 00000100:00100000:0.0:1783350236.836721:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659635072 00000100:00100000:0.0:1783350236.836733:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783350236.836742:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+6:25696:x1869977659634688:12345-0@lo:104: 00010000:00010000:0.0:1783350236.836756:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.836829:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783350236.836836:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+6:25696:x1869977659634688:12345-0@lo:104: Request processed in 95us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350236.836843:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783350236.836861:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783350236.836867:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+5:25696:x1869977659634816:12345-0@lo:104: 00010000:00010000:0.0:1783350236.836874:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.836907:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783350236.836912:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+5:25696:x1869977659634816:12345-0@lo:104: Request processed in 46us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350236.836918:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783350236.836929:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783350236.836934:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+4:25696:x1869977659634944:12345-0@lo:104: 00010000:00010000:0.0:1783350236.836941:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.836995:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783350236.837001:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+4:25696:x1869977659634944:12345-0@lo:104: Request processed in 67us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350236.837007:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783350236.837019:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783350236.837025:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:25696:x1869977659635072:12345-0@lo:104: 00010000:00010000:0.0:1783350236.837033:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837058:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783350236.837063:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+3:25696:x1869977659635072:12345-0@lo:104: Request processed in 38us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350236.837068:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1783350236.837089:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783350236.837094:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837101:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350236.837105:0:23820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837113:0:23820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350236.837120:0:23820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350236.837126:0:23820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783350236.837256:0:23820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837263:0:23820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350236.837283:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837290:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea374602200/0xd05e6ae1590e3de2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3de9 expref: -99 pid: 24991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837302:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783350236.837305:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837310:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cce00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350236.837313:0:23820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837319:0:23820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350236.837326:0:23820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350236.837330:0:23820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783350236.837343:0:23820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837349:0:23820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350236.837365:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837381:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e3c68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c6f expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837390:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783350236.837392:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837397:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350236.837400:0:23820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837406:0:23820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350236.837412:0:23820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350236.837417:0:23820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783350236.837429:0:23820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837434:0:23820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350236.837440:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837446:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e3c29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c30 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837454:0:23820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350236.837462:0:23820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837467:0:23820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc400 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350236.837470:0:23820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837477:0:23820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350236.837483:0:23820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350236.837488:0:23820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783350236.837501:0:23820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837506:0:23820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350236.837512:0:23820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837517:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e3c1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3c22 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.837530:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350236.837531:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350236.837533:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350236.837540:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350236.837545:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350236.837566:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659635200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350236.837602:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350236.837636:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783350236.837642:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659635584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350236.837665:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350236.837692:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659635328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350236.837712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350236.837796:0:25696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659634688:0@lo:104: 00000100:00100000:2.0:1783350236.837806:0:25696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659634816:0@lo:104: 00000100:00100000:2.0:1783350236.837812:0:25696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659634944:0@lo:104: 00000100:00100000:2.0:1783350236.837819:0:25696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659635072:0@lo:104: 00000100:00100000:1.0:1783350236.838214:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659635200 00000100:00100000:1.0:1783350236.838220:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659635200 00010000:00010000:1.0:1783350236.838246:0:22652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cdc00/0xd05e6ae1590e3de9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3de2 expref: 24 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350236.838272:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659635584 00000100:00100000:1.0:1783350236.838275:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659635584 00010000:00010000:1.0:1783350236.838294:0:22652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3780af400/0xd05e6ae1590e3c22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c1b expref: 25 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350236.838305:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659635328 00000100:00100000:1.0:1783350236.838308:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659635328 00010000:00010000:1.0:1783350236.838316:0:22652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e3c6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c68 expref: 26 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350236.838328:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350236.838335:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+26:3649:x1869977659635200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350236.838347:0:22652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350236.838352:0:22652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cdc00/0xd05e6ae1590e3de9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3de2 expref: 26 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.838360:0:22652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cdc00/0xd05e6ae1590e3de9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3de2 expref: 26 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.838373:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cdc00/0xd05e6ae1590e3de9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3de2 expref: 26 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.838384:0:22652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350236.838419:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+25:3649:x1869977659635200:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350236.838425:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350236.838439:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783350236.838445:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:3649:x1869977659635584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350236.838453:0:22652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350236.838457:0:22652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3780af400/0xd05e6ae1590e3c22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c1b expref: 24 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.838476:0:22652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3780af400/0xd05e6ae1590e3c22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c1b expref: 24 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.838486:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3780af400/0xd05e6ae1590e3c22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3c1b expref: 24 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.838494:0:22652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350236.838519:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:3649:x1869977659635584:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350236.838525:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783350236.838539:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783350236.838544:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:3646:x1869977659635328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350236.838551:0:22652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350236.838556:0:22652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e3c6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c68 expref: 22 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.838564:0:22652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e3c6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c68 expref: 22 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.838573:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e3c6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3c68 expref: 22 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.838582:0:22652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350236.838604:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:3646:x1869977659635328:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350236.838610:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783350236.839546:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783350236.839567:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659635456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350236.839614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350236.839661:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659635328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350236.839686:0:24200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659635456 00000100:00100000:0.0:1783350236.839690:0:24200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659635456 00010000:00010000:0.0:1783350236.839708:0:24200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3c30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c29 expref: 21 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350236.839737:0:24200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783350236.839744:0:24200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:3646:x1869977659635456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350236.839755:0:24200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350236.839759:0:24200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3c30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c29 expref: 21 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.839767:0:24200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3c30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3c29 expref: 21 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.839782:0:24200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3c30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3c29 expref: 21 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.839792:0:24200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350236.839922:0:24200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:3646:x1869977659635456:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350236.839937:0:24200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783350236.839970:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659635584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350236.839988:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3649:1869977659635200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783350236.840093:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3646:1869977659635456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783350236.844515:0:25696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659634432:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783350236.844700:0:25696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1869977659634560:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783350236.844739:0:25696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350236.845777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350236.845898:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350236.846188:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642754432 00000100:00100000:1.0:1783350236.846209:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642754432 00000100:00100000:0.0:1783350236.846373:0:24200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642754560 00000100:00100000:0.0:1783350236.846378:0:24200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642754560 00010000:00010000:0.0:1783350236.846396:0:24200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e3f55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded452 expref: 14 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350236.846432:0:24200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:0.0:1783350236.846441:0:24200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+14:2399:x1869977642754560:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350236.846521:0:24200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350236.846529:0:24200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e3f55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded452 expref: 14 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.846744:0:22652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3f94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4c2 expref: 14 pid: 22658 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.846766:0:24200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e3f55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded452 expref: 14 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350236.846773:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:1.0:1783350236.846780:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea357eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+14:2399:x1869977642754432:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350236.846784:0:24200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e3f55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded452 expref: 14 pid: 22659 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350236.846798:0:24200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783350236.846886:0:22652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783350236.846891:0:24200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:2399:x1869977642754560:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 451us (993us total) trans 0 rc 0/0 00010000:00010000:1.0:1783350236.846892:0:22652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3f94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4c2 expref: 13 pid: 22658 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350236.846898:0:24200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00010000:00010000:1.0:1783350236.846965:0:22652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4c2 expref: 12 pid: 22658 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.846992:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cc800/0xd05e6ae1590e3f94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4c2 expref: 12 pid: 22658 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.847004:0:22652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.847011:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.847026:0:22652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.847033:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.847040:0:22652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.847046:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.847062:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350236.847067:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.847075:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.847093:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350236.847103:0:22652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350236.847162:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea357eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:2399:x1869977642754432:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 382us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350236.847169:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00010000:00010000:3.0:1783350236.847287:0:25696:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350236.847747:0:25696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350236.847753:0:25696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3417c6400/0xd05e6ae1590e3fc5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350236.933212:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350237.066262:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783350237.066284:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659635712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783350237.066359:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350237.067443:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659635712 00000100:00100000:1.0:1783350237.067453:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659635712 00000100:00080000:3.0:1783350237.067507:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783350237.067522:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783350237.067532:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659635712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783350237.067559:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783350237.067862:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659635712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 331us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350237.068003:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783350237.068035:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659635712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783350237.574108:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659635840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783350237.574193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350237.574292:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659635840 00000100:00100000:2.0:1783350237.574300:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659635840 00000100:00100000:2.0:1783350237.574364:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783350237.574373:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659635840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350237.574406:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783350237.574452:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659635840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350237.574459:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783350237.574556:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659635840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783350237.574583:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783350237.574590:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659635968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783350237.574614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350237.575384:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659635968 00000100:00100000:0.0:1783350237.575390:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659635968 00000100:00100000:0.0:1783350237.575438:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783350237.575446:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659635968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783350237.575467:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350237.575522:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659635968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350237.575529:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783350237.577395:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659635968:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783350237.962644:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350238.039394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.039480:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642754688 00000100:00100000:2.0:1783350238.039491:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642754688 00000100:00100000:2.0:1783350238.039557:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 147 00000100:00100000:2.0:1783350238.039568:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+11:18053:x1869977642754688:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350238.039598:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350238.039616:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3417c7a00/0xd05e6ae1590e3fcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded4fa expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.039643:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c7a00/0xd05e6ae1590e3fcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4fa expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.039654:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3417c7a00/0xd05e6ae1590e3fcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4fa expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.039663:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7a00, rc 0) 00000100:00100000:2.0:1783350238.039824:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+12:18053:x1869977642754688:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 257us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.039832:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 147 00000100:00100000:2.0:1783350238.042002:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350238.042073:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642754816 00000100:00100000:3.0:1783350238.042081:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642754816 00000100:00100000:3.0:1783350238.042127:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 148 00000100:00100000:3.0:1783350238.042157:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+12:18053:x1869977642754816:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350238.042311:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+12:18053:x1869977642754816:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 175us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350238.042319:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 148 00000100:00100000:3.0:1783350238.045502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350238.045825:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642754944 00000100:00100000:1.0:1783350238.045834:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642754944 00000100:00100000:1.0:1783350238.045892:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 149 00000100:00100000:1.0:1783350238.045903:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+12:18053:x1869977642754944:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783350238.046501:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+12:18053:x1869977642754944:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 597us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350238.046526:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 149 00000100:00100000:0.0:1783350238.056818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.056897:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642755072 00000100:00100000:2.0:1783350238.056907:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642755072 00000100:00100000:2.0:1783350238.056957:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 150 00000100:00100000:2.0:1783350238.056977:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+12:18053:x1869977642755072:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350238.056993:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350238.057010:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3417c6e00/0xd05e6ae1590e3fd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded501 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.057039:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c6e00/0xd05e6ae1590e3fd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded501 expref: 13 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.057052:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3417c6e00/0xd05e6ae1590e3fd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded501 expref: 13 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.057079:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6e00, rc 0) 00000100:00100000:2.0:1783350238.057183:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18053:x1869977642755072:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 217us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.057304:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 150 00000100:00100000:2.0:1783350238.063660:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350238.063763:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642755200 00000100:00100000:1.0:1783350238.063773:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642755200 00000100:00100000:3.0:1783350238.063928:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 151 00000100:00100000:3.0:1783350238.063941:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18053:x1869977642755200:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350238.064123:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18053:x1869977642755200:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 185us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350238.064132:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 151 00000100:00100000:3.0:1783350238.066867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.067055:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642755328 00000100:00100000:2.0:1783350238.067064:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642755328 00000100:00100000:2.0:1783350238.067118:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 152 00000100:00100000:2.0:1783350238.067129:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18053:x1869977642755328:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783350238.067310:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:18053:x1869977642755328:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 182us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.067318:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 152 00000100:00100000:3.0:1783350238.084458:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783350238.084496:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659636096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783350238.084560:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350238.084676:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659636096 00000100:00100000:0.0:1783350238.084685:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659636096 00000100:00100000:0.0:1783350238.085061:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783350238.085071:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659636096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783350238.085096:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783350238.085172:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659636096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.085180:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783350238.085221:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659636096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783350238.091083:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1783350238.340400:0:22662:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783350238.340407:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea2426d0000 from 13 10000000:01000000:2.0:1783350238.340412:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783350238.340459:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6000/0xd05e6ae1590e3fda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.340471:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6000/0xd05e6ae1590e3fda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.340481:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6000/0xd05e6ae1590e3fda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350238.340506:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783350238.340598:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.340693:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36daca840 going to sleep for 11 seconds 00000100:00100000:1.0:1783350238.349365:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659636224 00000100:00100000:1.0:1783350238.349379:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659636224 00000100:00100000:1.0:1783350238.349447:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783350238.349456:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+20:22662:x1869977659636224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350238.349472:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350238.349490:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3fe1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3fda expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.349518:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3fe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3fda expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.349529:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea374603200/0xd05e6ae1590e3fe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3fda expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.349537:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374603200, rc 0) 00000100:00100000:1.0:1783350238.349636:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:22662:x1869977659636224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (9038us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350238.349644:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783350238.349781:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783350238.349798:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6000/0xd05e6ae1590e3fda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3fe1 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.349806:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6000/0xd05e6ae1590e3fda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3fe1 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350238.349890:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783350238.349922:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350238.349955:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1783350238.350065:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659636352 00000100:00100000:3.0:1783350238.350070:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659636352 00000100:00100000:3.0:1783350238.350101:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783350238.350108:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea367368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:22662:x1869977659636352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350238.350228:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea367368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:22662:x1869977659636352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350238.350234:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783350238.350461:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783350238.350490:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783350238.350526:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350238.350562:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1783350238.350652:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659636480 00000100:00100000:3.0:1783350238.350657:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659636480 00000100:00100000:3.0:1783350238.350686:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783350238.350693:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:22662:x1869977659636480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783350238.350792:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:22662:x1869977659636480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350238.350798:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783350238.350974:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783350238.352285:0:25709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783350238.352449:0:22662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783350238.352469:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783350238.352481:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6000/0xd05e6ae1590e3fda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3fe1 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.352492:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6000/0xd05e6ae1590e3fda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3fe1 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350238.352502:0:22662:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783350238.352505:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea37864d000 from 13 10000000:01000000:2.0:1783350238.352507:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783350238.352540:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7600/0xd05e6ae1590e3fe8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.352559:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7600/0xd05e6ae1590e3fe8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.352568:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7600/0xd05e6ae1590e3fe8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350238.352590:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783350238.352642:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.352678:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36daca840 going to sleep for 11 seconds 00000100:00100000:3.0:1783350238.352901:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659636608 00000100:00100000:3.0:1783350238.352908:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659636608 00000100:00100000:3.0:1783350238.352954:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783350238.352974:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+21:22662:x1869977659636608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350238.352986:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350238.353000:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3fef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3fe8 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.353022:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3fe8 expref: 22 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.353048:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e3fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3fe8 expref: 22 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.353057:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f1800, rc 0) 00000100:00100000:3.0:1783350238.353102:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:22662:x1869977659636608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350238.353108:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783350238.353352:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350238.353366:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7600/0xd05e6ae1590e3fe8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3fef expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.353387:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7600/0xd05e6ae1590e3fe8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3fef expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350238.353447:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783350238.353475:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.353504:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36daca840 going to sleep for 11 seconds 00000100:00100000:0.0:1783350238.353561:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659636736 00000100:00100000:0.0:1783350238.353566:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659636736 00000100:00100000:0.0:1783350238.353599:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783350238.353607:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:22662:x1869977659636736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783350238.353720:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:22662:x1869977659636736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.353727:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783350238.353818:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783350238.353847:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783350238.353883:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350238.353897:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3517c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350238.353908:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659636864 00000100:00100000:1.0:1783350238.353911:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659636864 00000100:00100000:1.0:1783350238.353935:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783350238.353940:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659636864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783350238.354021:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659636864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350238.354028:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783350238.354066:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783350238.362777:0:25710:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783350238.363989:0:22662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783350238.364025:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783350238.364037:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7600/0xd05e6ae1590e3fe8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3fef expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.364050:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7600/0xd05e6ae1590e3fe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3fef expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350238.364063:0:22662:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783350238.364066:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea36d918800 from 13 10000000:01000000:2.0:1783350238.364068:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783350238.364107:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7800/0xd05e6ae1590e3ff6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.364115:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7800/0xd05e6ae1590e3ff6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.364125:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7800/0xd05e6ae1590e3ff6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350238.364183:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783350238.364253:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.364299:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36daca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350238.365213:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659636992 00000100:00100000:1.0:1783350238.365224:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659636992 00000100:00100000:1.0:1783350238.365273:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783350238.365282:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+22:22662:x1869977659636992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350238.365297:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350238.365312:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3ffd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3ff6 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.365336:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3ffd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3ff6 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.365346:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea374602000/0xd05e6ae1590e3ffd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3ff6 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.365355:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374602000, rc 0) 00000100:00100000:1.0:1783350238.365412:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659636992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350238.365419:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783350238.365518:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659636992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783350238.365534:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7800/0xd05e6ae1590e3ff6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3ffd expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.365541:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7800/0xd05e6ae1590e3ff6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3ffd expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350238.365607:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659637120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783350238.365647:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350238.365677:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9600 going to sleep for 11 seconds 00000100:00100000:2.0:1783350238.367954:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659637120 00000100:00100000:2.0:1783350238.367978:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659637120 00000100:00100000:2.0:1783350238.368042:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783350238.368051:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659637120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783350238.368251:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659637120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.368259:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783350238.368869:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659637120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350238.368995:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659637248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783350238.369058:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350238.369190:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc16000 going to sleep for 11 seconds 00000100:00100000:2.0:1783350238.369305:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659637248 00000100:00100000:2.0:1783350238.369312:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659637248 00000100:00100000:2.0:1783350238.369345:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783350238.369352:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659637248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783350238.369448:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659637248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.369455:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783350238.369532:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659637248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783350238.374454:0:25711:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783350238.375481:0:22662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783350238.375510:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783350238.375523:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7800/0xd05e6ae1590e3ff6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3ffd expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.375534:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7800/0xd05e6ae1590e3ff6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3ffd expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350238.375546:0:22662:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783350238.375548:0:22662:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea37464f800 from 13 10000000:01000000:2.0:1783350238.375551:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783350238.375588:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6800/0xd05e6ae1590e4004 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.375611:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6800/0xd05e6ae1590e4004 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.375622:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6800/0xd05e6ae1590e4004 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350238.375648:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659637376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783350238.375710:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350238.375839:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659637376 00000100:00100000:3.0:1783350238.375846:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659637376 00000100:00100000:3.0:1783350238.375897:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783350238.375906:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+23:22662:x1869977659637376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350238.375919:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350238.375931:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3429f0000/0xd05e6ae1590e400b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e4004 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.375953:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3429f0000/0xd05e6ae1590e400b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e4004 expref: 24 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.375974:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3429f0000/0xd05e6ae1590e400b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e4004 expref: 24 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.375990:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f0000, rc 0) 00000100:00100000:3.0:1783350238.376025:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:22662:x1869977659637376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350238.376032:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783350238.376259:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36daca300 going to sleep for 11 seconds 00000100:00100000:2.0:1783350238.376281:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659637376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350238.376295:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6800/0xd05e6ae1590e4004 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e400b expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.376304:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6800/0xd05e6ae1590e4004 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e400b expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350238.376363:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659637504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783350238.376390:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.376414:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36daca300 going to sleep for 11 seconds 00000100:00100000:1.0:1783350238.376467:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659637504 00000100:00100000:1.0:1783350238.376472:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659637504 00000100:00100000:1.0:1783350238.376504:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783350238.376518:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:22662:x1869977659637504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783350238.376638:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:22662:x1869977659637504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350238.376645:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783350238.376741:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659637504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783350238.376779:0:22662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659637632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783350238.376816:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.376842:0:22662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36daca300 going to sleep for 11 seconds 00000100:00100000:1.0:1783350238.376941:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659637632 00000100:00100000:1.0:1783350238.376946:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659637632 00000100:00100000:1.0:1783350238.376984:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783350238.376991:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:22662:x1869977659637632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783350238.377071:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:22662:x1869977659637632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350238.377086:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783350238.377233:0:22662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:22662:1869977659637632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783350238.378027:0:25712:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783350238.378338:0:22662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783350238.378364:0:22662:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783350238.378374:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6800/0xd05e6ae1590e4004 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e400b expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.378386:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6800/0xd05e6ae1590e4004 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e400b expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350238.496627:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350238.496710:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642755456 00000100:00100000:3.0:1783350238.496721:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642755456 00000100:00100000:3.0:1783350238.496802:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:3.0:1783350238.496813:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+6:18673:x1869977642755456:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783350238.496832:0:24663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350238.496864:0:24663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e4012 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded508 expref: -99 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.496935:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f0e00/0xd05e6ae1590e4019 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.496949:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f0e00/0xd05e6ae1590e4019 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.496973:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f0e00/0xd05e6ae1590e4019 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.496989:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4020 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.496996:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497016:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497106:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc000/0xd05e6ae1590e4027 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497115:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc000/0xd05e6ae1590e4027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497123:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc000/0xd05e6ae1590e4027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783350238.497181:0:24663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783350238.497185:0:24663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783350238.497217:0:24663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc000/0xd05e6ae1590e4027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497228:0:24663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f0e00/0xd05e6ae1590e4019 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497233:0:24663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f0e00/0xd05e6ae1590e4019 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497239:0:24663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f0e00/0xd05e6ae1590e4019 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497244:0:24663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3429f0e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350238.497248:0:24663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f0e00/0xd05e6ae1590e4019 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497255:0:24663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f0e00/0xd05e6ae1590e4019 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497274:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e99c00) 00010000:00010000:3.0:1783350238.497277:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350238.497281:0:24663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f0e00/0xd05e6ae1590e4019 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497286:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f0e00/0xd05e6ae1590e4019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497298:0:24663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497304:0:24663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4020 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497310:0:24663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4020 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497315:0:24663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350238.497318:0:24663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4020 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497323:0:24663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4020 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497330:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ea370dced00) 00010000:00010000:3.0:1783350238.497332:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350238.497334:0:24663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4020 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497339:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4020 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497381:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e4012 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded508 expref: 8 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497394:0:24663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc000/0xd05e6ae1590e4027 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded508 expref: 7 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.497401:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:3.0:1783350238.497403:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783350238.497405:0:24663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc000, rc 0) 00000100:00100000:3.0:1783350238.497467:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+7:18673:x1869977642755456:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 656us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350238.497475:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00080000:0.0:1783350238.497773:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783350238.502670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.502761:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642755584 00000100:00100000:2.0:1783350238.502772:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642755584 00000100:00100000:2.0:1783350238.502848:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1783350238.502858:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d2fd8619-94bf-44d4-83ae-710347291d72+7:18673:x1869977642755584:12345-192.168.203.50@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783350238.502941:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d2fd8619-94bf-44d4-83ae-710347291d72+7:18673:x1869977642755584:12345-192.168.203.50@tcp:900:lhsmtool_posix.0 Request processed in 84us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.502957:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1783350238.506379:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350238.506520:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642755840 00000100:00100000:0.0:1783350238.506530:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642755840 00000100:00100000:0.0:1783350238.506589:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:0.0:1783350238.506599:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+7:18673:x1869977642755840:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783350238.506619:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350238.506639:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e402e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded50f expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.506714:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e4035 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.506728:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e4035 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.506740:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e4035 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.506756:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e403c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.506764:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e403c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.506771:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e403c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507238:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808a00/0xd05e6ae1590e4043 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507249:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808a00/0xd05e6ae1590e4043 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507256:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808a00/0xd05e6ae1590e4043 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783350238.507268:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783350238.507421:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e4035 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507428:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e4035 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507434:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e4035 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507439:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d809600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783350238.507443:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e4035 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507450:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e4035 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507461:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:0.0:1783350238.507465:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783350238.507468:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e4035 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507483:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e4035 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507498:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e403c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507503:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e403c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507509:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e403c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507513:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783350238.507516:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e403c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507522:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e403c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507530:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ea349e99a00) 00010000:00010000:0.0:1783350238.507532:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783350238.507534:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e403c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.507539:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e403c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.508826:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e402e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded50f expref: 10 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.508880:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808a00/0xd05e6ae1590e4043 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded50f expref: 9 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.508888:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e99000) 00010000:00010000:0.0:1783350238.508891:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783350238.508893:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea37d808a00, rc 0) 00000100:00100000:0.0:1783350238.508980:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+9:18673:x1869977642755840:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 2382us (2610us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1783350238.508988:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:3.0:1783350238.520123:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.520388:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642755968 00000100:00100000:2.0:1783350238.520399:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642755968 00000100:00100000:2.0:1783350238.520462:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:2.0:1783350238.520472:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+9:18673:x1869977642755968:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783350238.520715:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+9:18673:x1869977642755968:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 Request processed in 243us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.520724:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00000040:00080000:1.0:1783350238.532814:0:23421:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783350238.537242:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350238.540009:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642756096 00000100:00100000:0.0:1783350238.540024:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642756096 00000100:00100000:0.0:1783350238.540205:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:0.0:1783350238.540220:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+5:18673:x1869977642756096:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1783350238.544274:0:22664:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4011us 00000100:00080000:3.0:1783350238.552819:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783350238.557218:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350238.557312:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642756224 00000100:00100000:1.0:1783350238.557323:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642756224 00000100:00100000:1.0:1783350238.557380:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:1.0:1783350238.557390:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+9:18679:x1869977642756224:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783350238.557410:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350238.557442:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e4051 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded516 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557530:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e4058 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557544:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e4058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557555:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e4058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557570:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602400/0xd05e6ae1590e405f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557577:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602400/0xd05e6ae1590e405f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557584:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602400/0xd05e6ae1590e405f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557627:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e4058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557635:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e4058 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557641:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e4058 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557647:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374603000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350238.557651:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e4058 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557668:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e4058 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557680:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e99c00) 00010000:00010000:1.0:1783350238.557683:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350238.557688:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e4058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557694:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e4058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557708:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602400/0xd05e6ae1590e405f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557714:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602400/0xd05e6ae1590e405f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557719:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602400/0xd05e6ae1590e405f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557724:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350238.557726:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602400/0xd05e6ae1590e405f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557732:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602400/0xd05e6ae1590e405f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557739:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ea2426df700) 00010000:00010000:1.0:1783350238.557741:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350238.557744:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602400/0xd05e6ae1590e405f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557758:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602400/0xd05e6ae1590e405f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557788:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e4051 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded516 expref: 10 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557798:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e99c00) 00010000:00010000:1.0:1783350238.557800:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350238.557804:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e4051 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded516 expref: 10 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350238.557813:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374602200, rc 0) 00000100:00100000:1.0:1783350238.557884:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+9:18679:x1869977642756224:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 494us (675us total) trans 0 rc 301/301 00000100:00100000:1.0:1783350238.557892:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:0.0:1783350238.567348:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350238.567433:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642756352 00000100:00100000:1.0:1783350238.567443:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642756352 00000100:00100000:1.0:1783350238.567496:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:1.0:1783350238.567507:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d2fd8619-94bf-44d4-83ae-710347291d72+9:18679:x1869977642756352:12345-192.168.203.50@tcp:700:lfs.0 00000100:00100000:1.0:1783350238.567592:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d2fd8619-94bf-44d4-83ae-710347291d72+9:18679:x1869977642756352:12345-192.168.203.50@tcp:700:lfs.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350238.567600:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:3.0:1783350238.576229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.576638:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642756608 00000100:00100000:2.0:1783350238.576648:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642756608 00000100:00100000:2.0:1783350238.576708:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:2.0:1783350238.576718:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+9:18679:x1869977642756608:12345-192.168.203.50@tcp:36:lfs.0 00010000:00010000:2.0:1783350238.576773:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350238.576801:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e3f7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded483 expref: 9 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.576831:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e99c00) 00010000:00010000:2.0:1783350238.576836:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783350238.576908:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.576934:0:22665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4f3 expref: 5 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.576942:0:22665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.576986:0:22665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4f3 expref: 5 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.577000:0:22665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4f3 expref: 5 pid: 22665 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350238.577015:0:22665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d81f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22665:1869977659637760:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783350238.577094:0:22665:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36daca300 going to sleep for 11 seconds 00000100:00100000:1.0:1783350238.583125:0:22665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d81f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22665:1869977659637760:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783350238.583178:0:22665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350238.592072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350238.592167:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642756736 00000100:00100000:0.0:1783350238.592177:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642756736 00010000:00010000:0.0:1783350238.592239:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4f3 expref: 6 pid: 22665 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350238.592276:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:0.0:1783350238.592285:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:2399:x1869977642756736:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350238.592298:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350238.592305:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4f3 expref: 6 pid: 22665 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.592329:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4f3 expref: 6 pid: 22665 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.592350:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e3fbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded4f3 expref: 6 pid: 22665 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.592364:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e99c00) 00010000:00010000:0.0:1783350238.592370:0:22650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.592379:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.592386:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.592410:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350238.592461:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2399:x1869977642756736:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 176us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.592468:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00010000:00010000:0.0:1783350238.592831:0:22665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.593008:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.593031:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.593051:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.593059:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783350238.594011:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783350238.594128:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+5:18673:x1869977642756096:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 Request processed in 53909us (56892us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.594159:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 26 00010000:00010000:2.0:1783350238.596541:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596563:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596575:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783350238.596592:0:22665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064bff4b5 reply state 00000000b2fbcbc6 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596616:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596624:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ea2424c3100) 00010000:00010000:2.0:1783350238.596627:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783350238.596631:0:22665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783350238.596637:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783350238.596647:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596654:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596660:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596666:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350238.596671:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596679:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596689:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e99c00) 00010000:00010000:2.0:1783350238.596691:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350238.596695:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596701:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4066 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783350238.596728:0:22665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064bff4b5 reply state 00000000b2fbcbc6 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596737:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.596743:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ea349e99a00) 00010000:00010000:2.0:1783350238.596745:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783350238.596747:0:22665:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783350238.596832:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+10:18679:x1869977642756608:12345-192.168.203.50@tcp:36:lfs.0 Request processed in 20111us (20609us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1783350238.596853:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:1.0:1783350238.598388:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783350238.598408:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659637888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783350238.598464:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350238.599100:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659638144:0@lo:400:kworker.0 00000100:00100000:1.0:1783350238.599154:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350238.599176:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659638656:0@lo:400:kworker.0 00000100:00100000:0.0:1783350238.599299:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659637888 00000100:00100000:0.0:1783350238.599306:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659637888 00000100:00100000:0.0:1783350238.599356:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783350238.599365:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659637888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783350238.599392:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783350238.599434:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659637888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.599440:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1783350238.599460:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783350238.600167:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659638016:0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.600218:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.600241:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659638528:0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.600264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.600285:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659639040:0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.600309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.600341:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659638400:0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.600364:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.600379:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659638912:0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.600397:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.600413:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659639424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783350238.600435:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.600451:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783350238.600468:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659638272:0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.600493:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.600507:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659638784:0@lo:400:kworker.0 00000100:00100000:1.0:1783350238.600703:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350238.600724:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659639168:0@lo:400:kworker.0 00000100:00100000:1.0:1783350238.600744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350238.600775:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659638144 00000100:00100000:1.0:1783350238.600781:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659638144 00000100:00100000:1.0:1783350238.600811:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659638528 00000100:00100000:1.0:1783350238.600814:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659638528 00000100:00100000:1.0:1783350238.600825:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659638656 00000100:00100000:1.0:1783350238.600827:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659638656 00000100:00100000:1.0:1783350238.600863:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783350238.600871:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659638144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350238.600915:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659638144:12345-0@lo:400:kworker.0 Request processed in 45us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350238.600921:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783350238.600934:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783350238.601165:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783350238.601175:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659638656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350238.601223:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659638656:12345-0@lo:400:kworker.0 Request processed in 50us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.601228:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783350238.601246:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659638016 00000100:00100000:0.0:1783350238.601250:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659638016 00000100:00100000:0.0:1783350238.601275:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659638400 00000100:00100000:0.0:1783350238.601277:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659638400 00000100:00100000:0.0:1783350238.601302:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783350238.601307:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659638016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350238.601346:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659638016:12345-0@lo:400:kworker.0 Request processed in 38us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.601352:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783350238.601364:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783350238.601370:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659638400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350238.601397:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659638400:12345-0@lo:400:kworker.0 Request processed in 28us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.601402:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783350238.601418:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659639424 00000100:00100000:0.0:1783350238.601421:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659639424 00000100:00100000:0.0:1783350238.601441:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783350238.601447:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659639424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783350238.601459:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783350238.601489:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659639424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.601495:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1783350238.601512:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783350238.601727:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.601746:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659639296:0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.601783:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350238.601815:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659638400:0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.601831:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659639424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783350238.601874:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659639040 00000100:00100000:2.0:1783350238.601878:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659639040 00000100:00100000:2.0:1783350238.601907:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659638912 00000100:00100000:2.0:1783350238.601910:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659638912 00000100:00100000:2.0:1783350238.601923:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659638272 00000100:00100000:2.0:1783350238.601926:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659638272 00000100:00100000:2.0:1783350238.601936:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659639168 00000100:00100000:2.0:1783350238.601939:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659639168 00000100:00100000:1.0:1783350238.602046:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659638528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350238.602080:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659638528:12345-0@lo:400:kworker.0 Request processed in 1140us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350238.602085:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783350238.602132:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659637888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783350238.602177:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659638144:0@lo:400:kworker.0 00000100:00100000:1.0:1783350238.602379:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659638656:0@lo:400:kworker.0 00000100:00100000:0.0:1783350238.602454:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659638784 00000100:00100000:0.0:1783350238.602459:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659638784 00000100:00100000:0.0:1783350238.602478:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659639296 00000100:00100000:0.0:1783350238.602480:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659639296 00000100:00100000:0.0:1783350238.602497:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783350238.602503:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659639040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350238.602614:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659639040:12345-0@lo:400:kworker.0 Request processed in 110us (2303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.602630:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783350238.602644:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783350238.602649:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659638912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350238.602698:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659638912:12345-0@lo:400:kworker.0 Request processed in 49us (2300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.602704:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783350238.602714:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783350238.602720:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659638272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350238.603315:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659638016:0@lo:400:kworker.0 00000100:00100000:1.0:1783350238.603328:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659638528:0@lo:400:kworker.0 00010000:00080000:1.0:1783350238.603341:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea24477df80 x1869977659639040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350238.603350:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659639040:0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.603453:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783350238.603459:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659638784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.603497:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659638784:12345-0@lo:400:kworker.0 Request processed in 37us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.603502:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783350238.603514:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783350238.603630:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659638272:12345-0@lo:400:kworker.0 Request processed in 909us (3135us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.603636:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783350238.603649:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783350238.603655:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659639168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350238.603683:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659639168:12345-0@lo:400:kworker.0 Request processed in 29us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.603689:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1783350238.603703:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783350238.603708:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783350238.603765:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659639168:0@lo:400:kworker.0 00000100:00100000:3.0:1783350238.603967:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659638272:0@lo:400:kworker.0 00000100:00100000:3.0:1783350238.603981:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659638784:0@lo:400:kworker.0 00000100:00100000:3.0:1783350238.603992:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659638912:0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.604086:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659639296:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783350238.604400:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea24477c000 x1869977659639296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350238.604412:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659639296:0@lo:400:kworker.0 00000100:00100000:2.0:1783350238.604496:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659639296:12345-0@lo:400:kworker.0 Request processed in 615us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.604505:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783350238.691331:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.695174:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642756864 00000100:00100000:2.0:1783350238.695190:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642756864 00000100:00100000:2.0:1783350238.695252:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:2.0:1783350238.695262:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+10:18687:x1869977642756864:12345-192.168.203.50@tcp:101:lctl.0 00010000:00010000:2.0:1783350238.695284:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350238.695305:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e407b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded51d expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.695370:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e4082 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.695383:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e4082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.695395:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e4082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350238.695705:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783350238.695710:0:22664:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783350238.695745:0:22664:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e4082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.695769:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e407b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded51d expref: 12 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.695787:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e4082 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded51d expref: 11 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.695795:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c3a00) 00010000:00010000:2.0:1783350238.695797:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783350238.695814:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7e00, rc 0) 00000100:00100000:2.0:1783350238.695973:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+11:18687:x1869977642756864:12345-192.168.203.50@tcp:101:lctl.0 Request processed in 711us (4649us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.695981:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:1.0:1783350238.741401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.741502:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642756992 00000100:00100000:2.0:1783350238.741512:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642756992 00000100:00100000:2.0:1783350238.741579:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:2.0:1783350238.741589:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:18688:x1869977642756992:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783350238.741611:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350238.741631:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded524 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.741693:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e4090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.741707:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e4090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.741720:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e4090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350238.741763:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783350238.741767:0:22666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783350238.741786:0:22666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e4090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.741810:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e4089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded524 expref: 7 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.741828:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e4090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded524 expref: 6 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.741850:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c3a00) 00010000:00010000:2.0:1783350238.741853:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783350238.741857:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7200, rc 0) 00000100:00100000:2.0:1783350238.741918:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:18688:x1869977642756992:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 330us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.741925:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:0.0:1783350238.744108:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.744201:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642757120 00000100:00100000:2.0:1783350238.744211:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642757120 00000100:00100000:2.0:1783350238.744266:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:2.0:1783350238.744276:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+6:18688:x1869977642757120:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783350238.744295:0:24663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350238.744312:0:24663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e4097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded52b expref: -99 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744373:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e409e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744387:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e409e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744397:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e409e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744408:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e40a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744415:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e40a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744438:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e40a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744506:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e40ac lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744515:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e40ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744521:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e40ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350238.744554:0:24663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783350238.744558:0:24663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783350238.744575:0:24663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e40ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744586:0:24663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e409e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744592:0:24663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e409e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744599:0:24663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e409e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744604:0:24663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350238.744608:0:24663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e409e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744615:0:24663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e409e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744635:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c3a00) 00010000:00010000:2.0:1783350238.744638:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350238.744642:0:24663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e409e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744649:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e409e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744664:0:24663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e40a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744670:0:24663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e40a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744676:0:24663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e40a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744681:0:24663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350238.744683:0:24663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e40a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744689:0:24663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e40a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744696:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ea349e99a00) 00010000:00010000:2.0:1783350238.744698:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350238.744701:0:24663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e40a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744707:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e40a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744742:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e4097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded52b expref: 8 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744755:0:24663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e40ac lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded52b expref: 7 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.744762:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ea2424c3100) 00010000:00010000:2.0:1783350238.744764:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783350238.744766:0:24663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6a00, rc 0) 00000100:00100000:2.0:1783350238.744816:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+7:18688:x1869977642757120:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 541us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.744822:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:1.0:1783350238.747975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350238.748042:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642757248 00000100:00100000:0.0:1783350238.748053:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642757248 00000100:00100000:0.0:1783350238.748156:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:0.0:1783350238.748167:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:18688:x1869977642757248:12345-192.168.203.50@tcp:900:lfs.0 00000100:00100000:0.0:1783350238.748252:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:18688:x1869977642757248:12345-192.168.203.50@tcp:900:lfs.0 Request processed in 87us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.748272:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00080000:1.0:1783350238.748557:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783350238.751104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.751240:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642757504 00000100:00100000:2.0:1783350238.751250:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642757504 00000100:00100000:2.0:1783350238.751298:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:2.0:1783350238.751307:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+7:18688:x1869977642757504:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783350238.751326:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350238.751347:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e40b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded532 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350238.751452:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783350238.751550:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e40b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded532 expref: 9 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.751565:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c3a00) 00010000:00010000:2.0:1783350238.751567:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783350238.751585:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e40b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded532 expref: 9 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.751600:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6200, rc 0) 00000100:00100000:2.0:1783350238.751658:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+8:18688:x1869977642757504:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 352us (563us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1783350238.751666:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:0.0:1783350238.754321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.754412:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642757760 00000100:00100000:2.0:1783350238.754420:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642757760 00000100:00100000:2.0:1783350238.754465:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:2.0:1783350238.754473:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+8:18688:x1869977642757760:12345-192.168.203.50@tcp:36:lfs.0 00010000:00010000:2.0:1783350238.754523:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350238.754547:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e40ac lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded52b expref: 8 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.754564:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ea2424c3100) 00010000:00010000:2.0:1783350238.754569:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783350238.754588:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.754601:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.754610:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783350238.754814:0:22664:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000def96449 reply state 00000000a135965a transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.754828:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.754841:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ea2424c3100) 00010000:00010000:2.0:1783350238.754844:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1783350238.754847:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783350238.754855:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783350238.755040:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+9:18688:x1869977642757760:12345-192.168.203.50@tcp:36:lfs.0 Request processed in 566us (726us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1783350238.755047:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:1.0:1783350238.762094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.762229:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642758016 00000100:00100000:2.0:1783350238.762239:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642758016 00000100:00100000:2.0:1783350238.762295:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:2.0:1783350238.762305:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+9:18688:x1869977642758016:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783350238.762519:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+10:18688:x1869977642758016:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 214us (433us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1783350238.762527:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:1.0:1783350238.765356:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.765535:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642758272 00000100:00100000:2.0:1783350238.765544:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642758272 00000100:00100000:2.0:1783350238.765733:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:2.0:1783350238.765744:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+10:18688:x1869977642758272:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783350238.765770:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350238.765793:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e40c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded539 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.765870:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.765885:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.765914:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.765926:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.765933:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.765952:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350238.766070:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783350238.766297:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766305:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766310:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766317:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350238.766321:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766328:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766340:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c3a00) 00010000:00010000:2.0:1783350238.766343:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350238.766355:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766361:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766375:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766381:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766387:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766392:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ec00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350238.766395:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766401:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766409:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ea349e99a00) 00010000:00010000:2.0:1783350238.766412:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350238.766415:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766421:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766453:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e40c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded539 expref: 12 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766473:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c3a00) 00010000:00010000:2.0:1783350238.766476:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783350238.766480:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e40c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded539 expref: 12 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.766490:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e600, rc 0) 00000100:00100000:2.0:1783350238.766596:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+11:18688:x1869977642758272:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 853us (1247us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1783350238.766604:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:2.0:1783350238.772362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350238.772567:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642758400 00000100:00100000:0.0:1783350238.772578:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642758400 00000100:00100000:0.0:1783350238.772660:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:0.0:1783350238.772672:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+11:18688:x1869977642758400:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783350238.772694:0:24663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350238.772715:0:24663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e40e4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded540 expref: -99 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.772832:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.772845:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.772856:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783350238.772880:0:24663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783350238.772884:0:24663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783350238.772904:0:24663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.772929:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809600/0xd05e6ae1590e40e4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded540 expref: 13 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.772965:0:24663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded540 expref: 12 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.772987:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ea2424c3100) 00010000:00010000:0.0:1783350238.772990:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783350238.772994:0:24663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea37d808400, rc 0) 00000100:00100000:0.0:1783350238.773060:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+12:18688:x1869977642758400:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 390us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.773067:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:1.0:1783350238.776313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350238.776478:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642758528 00000100:00100000:3.0:1783350238.776488:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642758528 00000100:00100000:3.0:1783350238.776558:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:3.0:1783350238.776568:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+12:18688:x1869977642758528:12345-192.168.203.50@tcp:37:lfs.0 00000100:00100000:3.0:1783350238.780121:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+12:18688:x1869977642758528:12345-192.168.203.50@tcp:37:lfs.0 Request processed in 3545us (3806us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350238.780159:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:3.0:1783350238.785078:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350238.785738:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642758784 00000100:00100000:1.0:1783350238.785748:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642758784 00000100:00100000:1.0:1783350238.785828:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:1.0:1783350238.785838:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3767a2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+12:18688:x1869977642758784:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1783350238.786079:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3767a2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+13:18688:x1869977642758784:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 242us (1008us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1783350238.786087:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:1.0:1783350238.838822:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350238.839403:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642758912 00000100:00100000:3.0:1783350238.839415:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642758912 00000100:00100000:2.0:1783350238.839861:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:2.0:1783350238.839874:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+11:18694:x1869977642758912:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783350238.839895:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350238.839915:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded547 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.839987:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840003:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840014:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840027:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4100 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840049:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840056:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840157:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e4107 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840167:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e4107 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840175:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e4107 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350238.840210:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783350238.840214:0:22665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783350238.840248:0:22665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e4107 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840259:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840265:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840271:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840276:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350238.840280:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840293:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840304:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c3a00) 00010000:00010000:2.0:1783350238.840308:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350238.840312:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840318:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e40f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840331:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840337:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4100 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840342:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840347:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350238.840350:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840356:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4100 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840362:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ea349e99a00) 00010000:00010000:2.0:1783350238.840365:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350238.840368:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4100 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840382:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4100 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840408:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e40f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded547 expref: 13 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840421:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e4107 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded547 expref: 12 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.840428:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ea2424c3100) 00010000:00010000:2.0:1783350238.840430:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783350238.840433:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e600, rc 0) 00000100:00100000:2.0:1783350238.840546:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+12:18694:x1869977642758912:12345-192.168.203.50@tcp:101:bash.0 Request processed in 675us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350238.840553:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:2.0:1783350238.843691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350238.843772:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642759040 00000100:00100000:0.0:1783350238.843782:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642759040 00000100:00100000:0.0:1783350238.843837:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1783350238.843847:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d2fd8619-94bf-44d4-83ae-710347291d72+5:18694:x1869977642759040:12345-192.168.203.50@tcp:900:bash.0 00000100:00100000:0.0:1783350238.843924:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d2fd8619-94bf-44d4-83ae-710347291d72+5:18694:x1869977642759040:12345-192.168.203.50@tcp:900:bash.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.843931:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1783350238.846497:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350238.846572:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642759296 00000100:00100000:2.0:1783350238.846581:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642759296 00000100:00100000:2.0:1783350238.846638:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:2.0:1783350238.846649:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+12:18694:x1869977642759296:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783350238.846666:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350238.846684:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e410e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded54e expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.846790:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.846819:0:22664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded540 expref: 12 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.846828:0:22664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.846857:0:22664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded540 expref: 12 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.846869:0:22664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded540 expref: 12 pid: 24663 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350238.846881:0:22664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22664:1869977659639552:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783350238.846964:0:22664:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36daca300 going to sleep for 11 seconds 00000100:00100000:1.0:1783350238.851773:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350238.851862:0:24200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642759424 00000100:00100000:0.0:1783350238.851870:0:24200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642759424 00010000:00010000:0.0:1783350238.851910:0:24200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded540 expref: 13 pid: 24663 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350238.851966:0:24200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:0.0:1783350238.851977:0:24200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+13:2400:x1869977642759424:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350238.851991:0:24200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350238.851998:0:24200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded540 expref: 13 pid: 24663 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.852031:0:24200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded540 expref: 13 pid: 24663 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.852052:0:24200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ea2424c3100) 00010000:00010000:0.0:1783350238.852059:0:24200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.852069:0:24200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.852076:0:24200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350238.852094:0:24200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350238.852179:0:24200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+13:2400:x1869977642759424:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 204us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350238.852828:0:24200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00010000:00010000:2.0:1783350238.852926:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808400/0xd05e6ae1590e40eb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded540 expref: 12 pid: 24663 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350238.852954:0:22664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22664:1869977659639552:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783350238.852983:0:22664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.852991:0:22664:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.852997:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.853021:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.853041:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.855849:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858102:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e4123 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858125:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e4123 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858153:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e4123 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350238.858165:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783350238.858682:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858691:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858698:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858703:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350238.858708:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858715:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858745:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ea2424c3100) 00010000:00010000:2.0:1783350238.858748:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350238.858752:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858758:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4115 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783350238.858772:0:22664:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0b7fa72 reply state 00000000b1d84ed0 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858782:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858789:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8ea2424c3500) 00010000:00010000:2.0:1783350238.858791:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783350238.858794:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783350238.858832:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e410e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded54e expref: 15 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858846:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e4123 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded54e expref: 14 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350238.858852:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:2.0:1783350238.858854:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783350238.858856:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f000, rc 0) 00000100:00100000:2.0:1783350238.860417:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+15:18694:x1869977642759296:12345-192.168.203.50@tcp:101:bash.0 Request processed in 13760us (13919us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1783350238.860429:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:1.0:1783350238.888708:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350238.889015:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642759552 00000100:00100000:3.0:1783350238.889026:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642759552 00000100:00100000:3.0:1783350238.889088:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:3.0:1783350238.889099:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+15:18694:x1869977642759552:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1783350238.889122:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350238.889164:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4131 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded555 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.889239:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.889269:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.889282:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783350238.889332:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783350238.889336:0:22666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783350238.889356:0:22666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.889384:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.889409:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4131 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded555 expref: 17 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.889427:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded555 expref: 16 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350238.889435:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:3.0:1783350238.889438:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783350238.889442:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc400, rc 0) 00000100:00100000:3.0:1783350238.889506:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+16:18694:x1869977642759552:12345-192.168.203.50@tcp:101:bash.0 Request processed in 408us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350238.889513:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:1.0:1783350238.900237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350238.900402:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642759808 00000100:00100000:3.0:1783350238.900414:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642759808 00000100:00100000:3.0:1783350238.900472:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:3.0:1783350238.900482:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fd8619-94bf-44d4-83ae-710347291d72+16:18694:x1869977642759808:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:3.0:1783350238.904437:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fd8619-94bf-44d4-83ae-710347291d72+17:18694:x1869977642759808:12345-192.168.203.50@tcp:35:bash.0 Request processed in 3945us (4198us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1783350238.904454:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00010000:00010000:0.0:1783350238.985092:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350239.021522:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350239.021629:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642760064 00000100:00100000:2.0:1783350239.021639:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642760064 00000100:00100000:2.0:1783350239.021701:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:2.0:1783350239.021711:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+17:18704:x1869977642760064:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783350239.021745:0:24663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350239.021765:0:24663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e413f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded55c expref: -99 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350239.021873:0:24663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783350239.021977:0:24663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e413f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded55c expref: 19 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.021993:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c3a00) 00010000:00010000:2.0:1783350239.021996:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783350239.022001:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e413f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded55c expref: 19 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.022016:0:24663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8ec00, rc 0) 00000100:00100000:2.0:1783350239.022075:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+18:18704:x1869977642760064:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 365us (562us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1783350239.022082:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:1.0:1783350239.025458:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350239.025544:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642760320 00000100:00100000:2.0:1783350239.025554:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642760320 00000100:00100000:2.0:1783350239.025605:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:2.0:1783350239.025616:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fd8619-94bf-44d4-83ae-710347291d72+18:18704:x1869977642760320:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783350239.025824:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fd8619-94bf-44d4-83ae-710347291d72+19:18704:x1869977642760320:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 210us (374us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1783350239.025847:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:1.0:1783350239.078323:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350239.078432:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642760576 00000100:00100000:3.0:1783350239.078444:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642760576 00000100:00100000:3.0:1783350239.078520:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:3.0:1783350239.078531:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+19:18707:x1869977642760576:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783350239.078577:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350239.078597:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e414d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded563 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.078712:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cce00/0xd05e6ae1590e4154 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.078726:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cce00/0xd05e6ae1590e4154 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.078738:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cce00/0xd05e6ae1590e4154 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783350239.078749:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783350239.078851:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e414d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded563 expref: 22 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.078869:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cce00/0xd05e6ae1590e4154 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded563 expref: 21 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.078878:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:3.0:1783350239.078881:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783350239.078885:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cce00, rc 0) 00000100:00100000:3.0:1783350239.078965:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+21:18707:x1869977642760576:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 429us (644us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1783350239.078973:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:0.0:1783350239.083494:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350239.083729:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642760704 00000100:00100000:2.0:1783350239.083740:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642760704 00000100:00100000:2.0:1783350239.083803:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:2.0:1783350239.083813:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+21:18707:x1869977642760704:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:2.0:1783350239.083878:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e4162 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.083894:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e4162 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.083905:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e4162 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.083951:0:24663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e4162 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.083966:0:24663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e4162 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.083972:0:24663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e4162 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.083978:0:24663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ec00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350239.083983:0:24663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e4162 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.083990:0:24663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e4162 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.084002:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:2.0:1783350239.084019:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783350239.084024:0:24663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e4162 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.084030:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e4162 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350239.084263:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+21:18707:x1869977642760704:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 450us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350239.084271:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:1.0:1783350239.093742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350239.094285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350239.094550:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642761088 00000100:00100000:2.0:1783350239.094560:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642761088 00000100:00100000:2.0:1783350239.094622:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:2.0:1783350239.094632:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fd8619-94bf-44d4-83ae-710347291d72+21:18707:x1869977642761088:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:0.0:1783350239.094730:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642760832 00000100:00100000:0.0:1783350239.094736:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642760832 00000100:00100000:0.0:1783350239.094840:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:0.0:1783350239.094851:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fd8619-94bf-44d4-83ae-710347291d72+23:2399:x1869977642760832:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350239.094864:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783350239.094873:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fd8619-94bf-44d4-83ae-710347291d72+23:18707:x1869977642761088:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 241us (587us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1783350239.094883:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00010000:00010000:0.0:1783350239.094889:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cce00/0xd05e6ae1590e4154 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded563 expref: 23 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350239.094926:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:0.0:1783350239.094931:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350239.094953:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fd8619-94bf-44d4-83ae-710347291d72+21:2399:x1869977642760832:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 106us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350239.094973:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000040:00080000:3.0:1783350239.302998:0:22698:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783350239.442659:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350239.442918:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642761344 00000100:00100000:3.0:1783350239.442947:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642761344 00000100:00100000:3.0:1783350239.443017:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:3.0:1783350239.443027:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+21:18738:x1869977642761344:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:3.0:1783350239.443368:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350239.443458:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e4169 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded56a expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.443765:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4170 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.443781:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4170 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.443795:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4170 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783350239.443808:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783350239.444782:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e4169 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded56a expref: 24 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.444806:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4170 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded56a expref: 23 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.444815:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:3.0:1783350239.444818:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783350239.444822:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc800, rc 0) 00000100:00100000:3.0:1783350239.444983:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+23:18738:x1869977642761344:12345-192.168.203.50@tcp:101:cat.0 Request processed in 1956us (2332us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1783350239.444992:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:2.0:1783350239.458762:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350239.459180:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642761600 00000100:00100000:1.0:1783350239.459191:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642761600 00000100:00100000:1.0:1783350239.459296:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:1.0:1783350239.459307:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fd8619-94bf-44d4-83ae-710347291d72+23:18738:x1869977642761600:12345-192.168.203.50@tcp:35:cat.0 00000100:00100000:1.0:1783350239.459601:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fd8619-94bf-44d4-83ae-710347291d72+24:18738:x1869977642761600:12345-192.168.203.50@tcp:35:cat.0 Request processed in 295us (923us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1783350239.459610:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:0.0:1783350239.467495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350239.468782:0:24200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642761728 00000100:00100000:3.0:1783350239.468795:0:24200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642761728 00000100:00100000:3.0:1783350239.468870:0:24200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:3.0:1783350239.469990:0:24200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fd8619-94bf-44d4-83ae-710347291d72+24:2400:x1869977642761728:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783350239.470796:0:24200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783350239.470828:0:24200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e4170 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded56a expref: 24 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.470848:0:24200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:3.0:1783350239.470852:0:24200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783350239.471851:0:24200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fd8619-94bf-44d4-83ae-710347291d72+23:2400:x1869977642761728:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 2965us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350239.471863:0:24200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00000040:00080000:1.0:1783350239.557079:0:23421:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783350239.557516:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350239.557597:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642761984 00000100:00100000:3.0:1783350239.557606:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642761984 00000100:00100000:3.0:1783350239.558688:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:2.0:1783350239.558763:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+23:18744:x1869977642761984:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:2.0:1783350239.558790:0:24663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350239.558811:0:24663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e417e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded571 expref: -99 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.558917:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4185 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.558933:0:24663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e4123 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded54e expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.559025:0:24663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded555 expref: 24 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.559034:0:24663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4185 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.559067:0:24663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded555 expref: 24 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.559079:0:24663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded555 expref: 24 pid: 22666 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350239.559091:0:24663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24663:1869977659639680:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783350239.560194:0:24663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e4123 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded54e expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.560207:0:24663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e4123 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded54e expref: 24 pid: 22664 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350239.560219:0:24663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24663:1869977659639808:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783350239.560255:0:24663:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36daca780 going to sleep for 11 seconds 00000100:00100000:2.0:1783350239.567347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350239.567479:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642762112 00000100:00100000:1.0:1783350239.567489:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642762112 00010000:00010000:1.0:1783350239.567530:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded555 expref: 25 pid: 22666 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350239.567579:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:1.0:1783350239.567589:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fd8619-94bf-44d4-83ae-710347291d72+25:2399:x1869977642762112:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783350239.567605:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350239.567613:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded555 expref: 25 pid: 22666 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350239.567649:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded555 expref: 25 pid: 22666 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350239.567671:0:22651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:1.0:1783350239.567676:0:22651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4185 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350239.567684:0:22651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4185 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350239.567690:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350239.567915:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fd8619-94bf-44d4-83ae-710347291d72+25:2399:x1869977642762112:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 325us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350239.567924:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00010000:00010000:0.0:1783350239.568066:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc400/0xd05e6ae1590e4138 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded555 expref: 24 pid: 22666 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350239.568084:0:24663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24663:1869977659639680:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783350239.568095:0:24663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24663:1869977659639808:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783350239.568117:0:24663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4185 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350239.569981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350239.570388:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642762240 00000100:00100000:1.0:1783350239.570398:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642762240 00010000:00010000:1.0:1783350239.570435:0:22652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e4123 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded54e expref: 24 pid: 22664 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350239.570478:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:1.0:1783350239.570486:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea357ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fd8619-94bf-44d4-83ae-710347291d72+24:2400:x1869977642762240:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783350239.570499:0:22652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350239.570505:0:22652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e4123 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded54e expref: 24 pid: 22664 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350239.570518:0:22652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e4123 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded54e expref: 24 pid: 22664 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350239.570723:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e4123 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded54e expref: 24 pid: 22664 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350239.570750:0:22652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:1.0:1783350239.570755:0:22652:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4185 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350239.570765:0:22652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4185 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350239.570772:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4185 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350239.570802:0:22652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350239.571343:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea357ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fd8619-94bf-44d4-83ae-710347291d72+23:2400:x1869977642762240:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 853us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350239.571353:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00010000:00010000:0.0:1783350239.571466:0:24663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4185 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350239.571475:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4185 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783350239.571494:0:24663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783350239.573010:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e417e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded571 expref: 24 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350239.573053:0:24663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8fc00/0xd05e6ae1590e4185 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded571 expref: 23 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350239.573061:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:0.0:1783350239.573064:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783350239.573066:0:24663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8fc00, rc 0) 00000100:00100000:0.0:1783350239.573119:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+23:18744:x1869977642761984:12345-192.168.203.50@tcp:101:dd.0 Request processed in 14419us (15607us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1783350239.573129:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:0.0:1783350239.576270:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350239.576347:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642762368 00000100:00100000:2.0:1783350239.576358:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642762368 00000100:00100000:2.0:1783350239.576415:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:2.0:1783350239.576426:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+23:18744:x1869977642762368:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:2.0:1783350239.576462:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350239.576481:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e4193 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded578 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.576514:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e419a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.576528:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e419a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.576549:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e419a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.576658:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e4193 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded578 expref: 25 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.576676:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e419a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded578 expref: 24 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.576684:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:2.0:1783350239.576687:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783350239.576691:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7c00, rc 0) 00000100:00100000:2.0:1783350239.576765:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+24:18744:x1869977642762368:12345-192.168.203.50@tcp:101:dd.0 Request processed in 341us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350239.576771:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:3.0:1783350239.581586:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350239.581835:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642762624 00000100:00100000:0.0:1783350239.581846:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642762624 00000100:00100000:0.0:1783350239.581906:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:0.0:1783350239.581916:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+24:18744:x1869977642762624:12345-192.168.203.50@tcp:36:dd.0 00010000:00010000:0.0:1783350239.582195:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350239.582213:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350239.582223:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783350239.582267:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1783350239.582288:0:22664:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041d3de89 reply state 00000000c1668b63 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350239.582318:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350239.582326:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:0.0:1783350239.582329:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783350239.582333:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783350239.582413:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+27:18744:x1869977642762624:12345-192.168.203.50@tcp:36:dd.0 Request processed in 499us (836us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1783350239.582421:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00000020:00080000:0.0:1783350239.582425:0:22664:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783350239.585418:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350239.585510:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642762752 00000100:00100000:2.0:1783350239.585519:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642762752 00000100:00100000:2.0:1783350239.585618:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:2.0:1783350239.585629:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+27:18744:x1869977642762752:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:2.0:1783350239.585667:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350239.585687:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded57f expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.585751:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41a8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded57f expref: 28 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.585766:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41a8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded57f expref: 28 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.585786:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:2.0:1783350239.585800:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783350239.585804:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7400, rc 0) 00000100:00100000:2.0:1783350239.585865:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+28:18744:x1869977642762752:12345-192.168.203.50@tcp:101:dd.0 Request processed in 239us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350239.585874:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:3.0:1783350239.599374:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350239.599515:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642763008 00000100:00100000:2.0:1783350239.599525:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642763008 00000100:00100000:2.0:1783350239.599591:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:2.0:1783350239.599601:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fd8619-94bf-44d4-83ae-710347291d72+28:18744:x1869977642763008:12345-192.168.203.50@tcp:103:dd.0 00010000:00010000:2.0:1783350239.599617:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350239.599641:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41a8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded57f expref: 28 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.599660:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:2.0:1783350239.599664:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783350239.599853:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fd8619-94bf-44d4-83ae-710347291d72+27:18744:x1869977642763008:12345-192.168.203.50@tcp:103:dd.0 Request processed in 253us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350239.599874:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:0.0:1783350239.606248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350239.606424:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642763136 00000100:00100000:2.0:1783350239.606434:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642763136 00000100:00100000:2.0:1783350239.606495:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:2.0:1783350239.606505:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+27:18744:x1869977642763136:12345-192.168.203.50@tcp:58:dd.0 00010000:00010000:2.0:1783350239.606614:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.606632:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350239.606643:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783350239.607655:0:22664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783350239.607684:0:22664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1783350239.607905:0:22664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1783350239.608269:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+27:18744:x1869977642763136:12345-192.168.203.50@tcp:58:dd.0 Request processed in 1760us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350239.608280:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:0.0:1783350239.610822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350239.610997:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642763264 00000100:00100000:3.0:1783350239.611054:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642763264 00000100:00100000:3.0:1783350239.611191:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:3.0:1783350239.611202:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+27:18744:x1869977642763264:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:3.0:1783350239.611222:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350239.611241:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e41b6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded586 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.611291:0:22666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.611312:0:22666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e41b6 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded586 expref: 28 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.611330:0:22666:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.611342:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e41b6 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded586 expref: 28 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.611355:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:3.0:1783350239.611359:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783350239.611363:0:22666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e41b6 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded586 expref: 28 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350239.611371:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc800, rc 0) 00000100:00100000:3.0:1783350239.611417:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+28:18744:x1869977642763264:12345-192.168.203.50@tcp:101:dd.0 Request processed in 217us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350239.611424:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00010000:00010000:3.0:1783350240.004357:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783350240.324796:0:22698:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783350240.324807:0:22698:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783350240.324837:0:22698:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1783350240.324847:0:22698:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1783350240.325000:0:22698:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5e6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22698:1869977659639936:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783350240.325094:0:22698:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350240.337006:0:22698:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5e6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22698:1869977659639936:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783350240.349827:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.349872:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.349905:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.349945:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.349973:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.349997:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.350016:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.350039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.350057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.350089:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.350118:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642763392 00000100:00100000:0.0:1783350240.350127:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642763392 00000100:00100000:0.0:1783350240.350209:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642763648 00000100:00100000:0.0:1783350240.350212:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642763648 00000100:00100000:0.0:1783350240.350224:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642764160 00000100:00100000:0.0:1783350240.350235:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642764160 00000100:00100000:0.0:1783350240.350258:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642763776 00000100:00100000:0.0:1783350240.350427:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642763776 00000100:00100000:0.0:1783350240.350450:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642764288 00000100:00100000:0.0:1783350240.350454:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642764288 00000100:00100000:0.0:1783350240.350469:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:0.0:1783350240.350477:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+29:2400:x1869977642763648:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350240.350561:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+29:2400:x1869977642763648:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 84us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350240.350568:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:0.0:1783350240.350584:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:0.0:1783350240.350589:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+12:2400:x1869977642764160:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350240.350615:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+12:2400:x1869977642764160:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350240.350621:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:0.0:1783350240.350632:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:0.0:1783350240.350638:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+5:2400:x1869977642763776:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350240.350660:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+5:2400:x1869977642763776:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350240.350665:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:0.0:1783350240.350676:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:0.0:1783350240.350681:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2400:x1869977642764288:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350240.350702:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2400:x1869977642764288:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 21us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350240.350708:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:0.0:1783350240.350728:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:0.0:1783350240.350734:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+28:18745:x1869977642763392:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783350240.350751:0:22666:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783350240.350829:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+28:18745:x1869977642763392:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 95us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350240.350836:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:3.0:1783350240.351042:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642763520 00000100:00100000:3.0:1783350240.351047:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642763520 00000100:00100000:3.0:1783350240.351074:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 165 00000100:00100000:3.0:1783350240.351080:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:2400:x1869977642763520:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350240.351105:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ad66c7-3f06-4dfd-8c9f-5fff2e080f5d+13:2400:x1869977642763520:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 25us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350240.351111:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 165 00000100:00100000:3.0:1783350240.351154:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642763904 00000100:00100000:3.0:1783350240.351157:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642763904 00000100:00100000:3.0:1783350240.351177:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642764416 00000100:00100000:3.0:1783350240.351179:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642764416 00000100:00100000:3.0:1783350240.351191:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642764032 00000100:00100000:3.0:1783350240.351194:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642764032 00000100:00100000:3.0:1783350240.351203:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642764544 00000100:00100000:3.0:1783350240.351205:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642764544 00000100:00100000:3.0:1783350240.351218:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:3.0:1783350240.351222:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fd8619-94bf-44d4-83ae-710347291d72+5:2400:x1869977642763904:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350240.351246:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fd8619-94bf-44d4-83ae-710347291d72+5:2400:x1869977642763904:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350240.351261:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:3.0:1783350240.351281:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1783350240.351286:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2400:x1869977642764416:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350240.351308:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2400:x1869977642764416:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350240.351314:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1783350240.351324:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:3.0:1783350240.351338:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fd8619-94bf-44d4-83ae-710347291d72+5:2400:x1869977642764032:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350240.351376:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fd8619-94bf-44d4-83ae-710347291d72+5:2400:x1869977642764032:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 39us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350240.351383:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:3.0:1783350240.351394:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:3.0:1783350240.351400:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2400:x1869977642764544:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350240.351418:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfa17c46-c0cf-418b-9e96-4c0ccaabd42c+5:2400:x1869977642764544:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 18us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350240.351423:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00080000:1.0:1783350240.352706:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783350240.352713:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783350240.352717:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783350240.352719:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783350240.355022:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350240.358107:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642764672 00000100:00100000:3.0:1783350240.358124:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642764672 00000100:00100000:3.0:1783350240.358473:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:3.0:1783350240.358495:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+28:18745:x1869977642764672:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783350240.358570:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e41bd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358587:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e41bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358601:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e41bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358615:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cdc00/0xd05e6ae1590e41c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358623:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cdc00/0xd05e6ae1590e41c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358650:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cdc00/0xd05e6ae1590e41c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358672:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e41cb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358682:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e41cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358689:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e41cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783350240.358736:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783350240.358740:0:22666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783350240.358753:0:22666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e41cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358764:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e41bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358770:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e41bd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358776:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e41bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358783:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350240.358787:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e41bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358794:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e41bd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358812:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e99000) 00010000:00010000:3.0:1783350240.358815:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350240.358820:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e41bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358826:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e41bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358841:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cdc00/0xd05e6ae1590e41c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358847:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cdc00/0xd05e6ae1590e41c4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358852:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cdc00/0xd05e6ae1590e41c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358857:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cdc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350240.358860:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cdc00/0xd05e6ae1590e41c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358865:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cdc00/0xd05e6ae1590e41c4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358873:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8ea370dced00) 00010000:00010000:3.0:1783350240.358875:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350240.358878:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cdc00/0xd05e6ae1590e41c4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358883:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cdc00/0xd05e6ae1590e41c4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358908:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e41cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358914:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e41cb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358920:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e41cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.358925:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350240.359089:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e41cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.359096:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e41cb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.359104:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:3.0:1783350240.359107:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350240.359110:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e41cb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.359116:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e41cb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350240.359436:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fd8619-94bf-44d4-83ae-710347291d72+28:18745:x1869977642764672:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 Request processed in 950us (4420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350240.359445:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:0.0:1783350240.372712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.372793:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642764928 00000100:00100000:2.0:1783350240.372803:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642764928 00000100:00100000:2.0:1783350240.372854:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:2.0:1783350240.372863:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+28:18745:x1869977642764928:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783350240.372883:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350240.372902:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded58d expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373243:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41d9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373375:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373387:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350240.373399:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783350240.373481:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373643:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41d9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373651:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41d9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373658:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350240.373662:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41d9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373669:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41d9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373681:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:2.0:1783350240.373683:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783350240.373687:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41d9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373703:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41d9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373746:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41d2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded58d expref: 30 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373757:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e99000) 00010000:00010000:2.0:1783350240.373760:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783350240.373764:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded58d expref: 30 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.373773:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6400, rc 0) 00000100:00100000:2.0:1783350240.373826:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+29:18745:x1869977642764928:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 963us (1122us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1783350240.373834:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:1.0:1783350240.379840:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.379969:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642765056 00000100:00100000:2.0:1783350240.379980:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642765056 00000100:00100000:2.0:1783350240.380036:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:2.0:1783350240.380045:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+29:18745:x1869977642765056:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783350240.380078:0:22664:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783350240.380214:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+29:18745:x1869977642765056:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 169us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350240.380221:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:0.0:1783350240.388796:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.388981:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642765312 00000100:00100000:2.0:1783350240.388992:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642765312 00000100:00100000:2.0:1783350240.389060:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:2.0:1783350240.389085:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+29:18745:x1869977642765312:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783350240.389106:0:24663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350240.389127:0:24663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41e7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded594 expref: -99 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783350240.389584:0:24663:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =59 00000004:00080000:2.0:1783350240.389592:0:24663:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+59 in llog 00000004:00080000:2.0:1783350240.389612:0:24663:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1783350240.389766:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41ee lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.389780:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.389791:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.389842:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41e7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded594 expref: 32 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.389860:0:24663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41ee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded594 expref: 31 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.389869:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3200) 00010000:00010000:2.0:1783350240.389872:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783350240.389875:0:24663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6200, rc 0) 00000100:00100000:2.0:1783350240.389928:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+31:18745:x1869977642765312:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 845us (1141us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1783350240.389935:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:0.0:1783350240.399267:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.399443:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642765568 00000100:00100000:2.0:1783350240.399454:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642765568 00000100:00100000:2.0:1783350240.399518:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:2.0:1783350240.399528:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+31:18745:x1869977642765568:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783350240.399585:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350240.399609:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e41ee lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded594 expref: 31 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399625:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3200) 00010000:00010000:2.0:1783350240.399635:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783350240.399655:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41fc lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399668:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41fc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399677:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41fc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399690:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e4203 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x603d6efd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399697:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e4203 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x603d6efd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399703:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e4203 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x603d6efd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399747:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41fc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399771:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41fc lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399777:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41fc lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399782:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350240.399786:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41fc lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399793:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41fc lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399801:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ea2424c3100) 00010000:00010000:2.0:1783350240.399804:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350240.399807:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41fc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399811:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e41fc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399820:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e4203 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x603d6efd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399825:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e4203 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x603d6efd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399830:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e4203 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x603d6efd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399835:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350240.399845:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e4203 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x603d6efd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399850:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e4203 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x603d6efd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399857:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x603d6efd (ffff8ea2424c3300) 00010000:00010000:2.0:1783350240.399860:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350240.399862:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e4203 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x603d6efd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.399868:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e4203 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x603d6efd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350240.399957:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+30:18745:x1869977642765568:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 420us (695us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783350240.399964:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:1.0:1783350240.404481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.404744:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642765696 00000100:00100000:2.0:1783350240.404754:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642765696 00000100:00100000:2.0:1783350240.404812:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:2.0:1783350240.404822:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+30:18745:x1869977642765696:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783350240.404841:0:24663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350240.404881:0:24663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e420a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded59b expref: -99 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.404916:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750200/0xd05e6ae1590e4211 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.405165:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750200/0xd05e6ae1590e4211 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.405257:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750200/0xd05e6ae1590e4211 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.405460:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e420a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded59b expref: 32 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.405477:0:24663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750200/0xd05e6ae1590e4211 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded59b expref: 31 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.405629:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3600) 00010000:00010000:2.0:1783350240.405633:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783350240.405637:0:24663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea347750200, rc 0) 00000100:00100000:2.0:1783350240.405744:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+31:18745:x1869977642765696:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 922us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350240.405753:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:0.0:1783350240.415133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.416453:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642765952 00000100:00100000:2.0:1783350240.416464:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642765952 00000100:00100000:2.0:1783350240.416524:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:2.0:1783350240.416532:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+31:18745:x1869977642765952:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783350240.416623:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.416639:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.416649:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783350240.416792:0:22664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1783350240.416800:0:22664:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681211663514ns, next at 682211661751ns, rc = 0 00000004:00010000:2.0:1783350240.416839:0:22664:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6b1a4e1 reply state 000000000d79589a transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.416850:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.416857:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3600) 00010000:00010000:2.0:1783350240.416860:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783350240.416864:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783350240.416962:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+33:18745:x1869977642765952:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 429us (1838us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1783350240.416969:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:0.0:1783350240.426212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.426393:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642766080 00000100:00100000:2.0:1783350240.426404:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642766080 00000100:00100000:2.0:1783350240.426464:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:2.0:1783350240.426473:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+33:18745:x1869977642766080:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783350240.426557:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350240.426578:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e421f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded5a2 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.426631:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e421f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a2 expref: 34 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.426646:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e421f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a2 expref: 34 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.426682:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3600) 00010000:00010000:2.0:1783350240.426685:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783350240.426688:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea347750000, rc 0) 00000100:00100000:2.0:1783350240.426807:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+34:18745:x1869977642766080:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 334us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350240.426814:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:3.0:1783350240.431086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.431415:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642766208 00000100:00100000:0.0:1783350240.431424:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642766208 00000100:00100000:0.0:1783350240.431480:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:0.0:1783350240.431500:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3495cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fd8619-94bf-44d4-83ae-710347291d72+5:2400:x1869977642766208:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783350240.431735:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3495cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fd8619-94bf-44d4-83ae-710347291d72+6:2400:x1869977642766208:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 245us (658us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1783350240.431743:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:3.0:1783350240.439442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.439574:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642766464 00000100:00100000:2.0:1783350240.439585:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642766464 00000100:00100000:2.0:1783350240.439643:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:2.0:1783350240.439653:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fd8619-94bf-44d4-83ae-710347291d72+34:18745:x1869977642766464:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783350240.439862:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fd8619-94bf-44d4-83ae-710347291d72+35:18745:x1869977642766464:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 211us (429us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1783350240.439870:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:2.0:1783350240.446768:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350240.446930:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642766720 00000100:00100000:3.0:1783350240.446963:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642766720 00000100:00100000:3.0:1783350240.447028:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:3.0:1783350240.447038:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+35:18745:x1869977642766720:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783350240.447187:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+35:18745:x1869977642766720:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 150us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350240.447195:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:0.0:1783350240.454788:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.454877:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642766848 00000100:00100000:2.0:1783350240.454887:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642766848 00000100:00100000:2.0:1783350240.454956:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:2.0:1783350240.454967:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+35:18745:x1869977642766848:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783350240.454987:0:24663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350240.455007:0:24663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751600/0xd05e6ae1590e4226 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded5a9 expref: -99 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.455074:0:24663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751800/0xd05e6ae1590e422d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.455103:0:24663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751800/0xd05e6ae1590e422d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.455114:0:24663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751800/0xd05e6ae1590e422d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350240.455205:0:24663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783350240.455224:0:24663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751800/0xd05e6ae1590e422d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.455250:0:24663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751600/0xd05e6ae1590e4226 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a9 expref: 37 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.455380:0:24663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751800/0xd05e6ae1590e422d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a9 expref: 36 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.455390:0:24663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3600) 00010000:00010000:2.0:1783350240.455393:0:24663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783350240.455396:0:24663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea347751800, rc 0) 00000100:00100000:2.0:1783350240.455463:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+36:18745:x1869977642766848:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 497us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350240.455470:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:1.0:1783350240.457784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.457892:0:24664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642766976 00000100:00100000:2.0:1783350240.457901:0:24664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642766976 00000100:00100000:2.0:1783350240.457957:0:24664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:2.0:1783350240.457967:0:24664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fd8619-94bf-44d4-83ae-710347291d72+6:2399:x1869977642766976:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783350240.457984:0:24664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350240.458016:0:24664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c023ebb/0xd05e6ae1590e4234 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded5b0 expref: -99 pid: 24664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783350240.458040:0:24664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4bc3df, blocks: 0x0 00010000:00010000:2.0:1783350240.458060:0:24664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1783350240.458065:0:24664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350240.458073:0:24664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c023ebb/0xd05e6ae1590e4234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5b0 expref: 7 pid: 24664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.458091:0:24664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c023ebb/0xd05e6ae1590e4234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5b0 expref: 7 pid: 24664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.458104:0:24664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea347751400, rc 0) 00000100:00100000:2.0:1783350240.459497:0:24664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fd8619-94bf-44d4-83ae-710347291d72+7:2399:x1869977642766976:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 1524us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350240.459508:0:24664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:3.0:1783350240.466824:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.466962:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642767232 00000100:00100000:2.0:1783350240.466972:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642767232 00000100:00100000:2.0:1783350240.467020:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:2.0:1783350240.467029:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+36:18745:x1869977642767232:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783350240.467133:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+36:18745:x1869977642767232:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 105us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350240.467161:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:3.0:1783350240.478248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.478447:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642767360 00000100:00100000:2.0:1783350240.478457:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642767360 00000100:00100000:2.0:1783350240.478626:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:2.0:1783350240.478639:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+36:18745:x1869977642767360:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783350240.480085:0:22645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1783350240.480100:0:22645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1783350240.480170:0:22645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1783350240.482552:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.482569:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.482577:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.482597:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783350240.482601:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.482608:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.482625:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ea2424c3100) 00010000:00010000:0.0:1783350240.482628:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1783350240.482632:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.482639:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e40c1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350240.485755:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fd8619-94bf-44d4-83ae-710347291d72+19:18745:x1869977642767360:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 Request processed in 7112us (7508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350240.485767:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:0.0:1783350240.486299:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659640064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783350240.486355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350240.486838:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659640064 00000100:00100000:2.0:1783350240.486846:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659640064 00000100:00100000:2.0:1783350240.486909:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783350240.486918:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659640064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783350240.487051:0:24175:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783350240.487055:0:24175:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1783350240.487057:0:24175:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783350240.487059:0:24175:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1783350239 -> 1783350239 00002000:00010000:2.0:1783350240.487061:0:24175:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1783350240.487098:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1869977659640064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (743us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1783350240.487105:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1783350240.488402:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1783350240.488455:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea37e5cd880/2, rc 0, transno 12884901892 00000100:00100000:0.0:1783350240.488465:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659640064:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1783350240.490154:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490179:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490205:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490211:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350240.490216:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490224:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490240:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ea349e99a00) 00010000:00010000:1.0:1783350240.490243:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350240.490248:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490254:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808c00/0xd05e6ae1590e406d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490287:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490293:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490299:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490305:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350240.490308:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490323:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490332:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ea2424c3100) 00010000:00010000:1.0:1783350240.490334:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350240.490337:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490342:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e4074 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490354:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490360:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490365:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490369:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350240.490372:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490377:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490384:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8ea2424c3500) 00010000:00010000:1.0:1783350240.490386:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350240.490388:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490398:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e411c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490413:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490419:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490424:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490429:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d809000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350240.490432:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490437:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490444:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:1.0:1783350240.490446:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350240.490449:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490454:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809000/0xd05e6ae1590e41a1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490466:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490471:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490484:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490502:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea347750e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350240.490505:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490511:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490518:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3600) 00010000:00010000:1.0:1783350240.490520:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783350240.490524:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.490529:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750e00/0xd05e6ae1590e4218 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350240.490892:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350240.491544:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642767488 00000100:00100000:1.0:1783350240.491554:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642767488 00000100:00100000:1.0:1783350240.491610:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:1.0:1783350240.491619:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fd8619-94bf-44d4-83ae-710347291d72+7:2399:x1869977642767488:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1783350240.491729:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fd8619-94bf-44d4-83ae-710347291d72+7:2399:x1869977642767488:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 Request processed in 110us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350240.491736:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:3.0:1783350240.496674:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.496760:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642767744 00000100:00100000:2.0:1783350240.496771:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642767744 00000100:00100000:2.0:1783350240.496830:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:2.0:1783350240.496840:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+15:18745:x1869977642767744:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783350240.496894:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350240.496921:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751800/0xd05e6ae1590e422d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a9 expref: 15 pid: 24663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.496940:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3600) 00010000:00010000:2.0:1783350240.496955:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783350240.496985:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751600/0xd05e6ae1590e423b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.497016:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751600/0xd05e6ae1590e423b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.497026:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751600/0xd05e6ae1590e423b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783350240.497199:0:22664:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c631d46 reply state 000000007f7fae11 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751600/0xd05e6ae1590e423b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.497211:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751600/0xd05e6ae1590e423b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.497219:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3600) 00010000:00010000:2.0:1783350240.497221:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783350240.497224:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783350240.497318:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+16:18745:x1869977642767744:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 478us (652us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1783350240.497326:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:3.0:1783350240.500600:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350240.500810:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642767872 00000100:00100000:2.0:1783350240.500820:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642767872 00000100:00100000:2.0:1783350240.500878:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:2.0:1783350240.500888:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fd8619-94bf-44d4-83ae-710347291d72+7:2399:x1869977642767872:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783350240.501054:0:24175:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783350240.501058:0:24175:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1783350238 00002000:00010000:2.0:1783350240.501061:0:24175:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1783350238 00002000:00010000:2.0:1783350240.501063:0:24175:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1783350239 -> 1783350238 00002000:00010000:2.0:1783350240.501066:0:24175:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1783350240.501125:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fd8619-94bf-44d4-83ae-710347291d72+8:2399:x1869977642767872:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 239us (538us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1783350240.501169:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:3.0:1783350240.510680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350240.511372:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642768000 00000100:00100000:1.0:1783350240.511383:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642768000 00000100:00100000:1.0:1783350240.511452:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:1.0:1783350240.511463:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fd8619-94bf-44d4-83ae-710347291d72+8:2400:x1869977642768000:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783350240.511536:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009fd01fc2/0xd05e6ae1590e4242 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.511554:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350240.511558:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350240.511564:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd01fc2/0xd05e6ae1590e4242 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.511577:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fd01fc2/0xd05e6ae1590e4242 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.511601:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009fd01fc2/0xd05e6ae1590e4242 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.511609:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fd01fc2/0xd05e6ae1590e4242 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.511617:0:24173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fd01fc2/0xd05e6ae1590e4242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.511625:0:24173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350240.511629:0:24173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd01fc2/0xd05e6ae1590e4242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.511638:0:24173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd01fc2/0xd05e6ae1590e4242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.511666:0:24173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fd01fc2/0xd05e6ae1590e4242 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.511675:0:24173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd01fc2/0xd05e6ae1590e4242 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350240.511757:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fd8619-94bf-44d4-83ae-710347291d72+8:2400:x1869977642768000:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 Request processed in 295us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350240.511764:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:1.0:1783350240.517929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.518016:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642768256 00000100:00100000:0.0:1783350240.518025:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642768256 00000100:00100000:0.0:1783350240.518168:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:0.0:1783350240.518180:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+16:18745:x1869977642768256:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783350240.518260:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.518277:0:22665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e419a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded578 expref: 16 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.518300:0:22665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.518334:0:22665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e419a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded578 expref: 16 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.518347:0:22665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e419a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded578 expref: 16 pid: 22665 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350240.518362:0:22665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d8bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22665:1869977659640192:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783350240.518439:0:22665:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9540 going to sleep for 11 seconds 00000100:00100000:0.0:1783350240.521735:0:22665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d8bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22665:1869977659640192:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783350240.521762:0:22665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350240.522459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350240.522738:0:24200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642768384 00000100:00100000:3.0:1783350240.522746:0:24200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642768384 00010000:00010000:3.0:1783350240.522783:0:24200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e419a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded578 expref: 17 pid: 22665 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350240.522821:0:24200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:3.0:1783350240.522831:0:24200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fd8619-94bf-44d4-83ae-710347291d72+17:2399:x1869977642768384:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783350240.522845:0:24200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783350240.522852:0:24200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e419a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded578 expref: 17 pid: 22665 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.522865:0:24200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e419a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded578 expref: 17 pid: 22665 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.522903:0:24200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e419a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded578 expref: 17 pid: 22665 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.522919:0:24200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:3.0:1783350240.522925:0:24200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e41b6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded586 expref: 16 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.523003:0:24200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.523011:0:24200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.523019:0:24200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.523049:0:24200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783350240.523080:0:22665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.523088:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350240.523101:0:24200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fd8619-94bf-44d4-83ae-710347291d72+16:2399:x1869977642768384:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 272us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350240.523109:0:24200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00010000:00010000:0.0:1783350240.523679:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.523694:0:22665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e421f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a2 expref: 16 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.523703:0:22665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.523740:0:22665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e421f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a2 expref: 16 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.523752:0:22665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e421f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a2 expref: 16 pid: 22665 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350240.524480:0:22665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d8bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22665:1869977659640320:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783350240.524731:0:22665:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350240.538022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.538215:0:22665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d8bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22665:1869977659640320:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783350240.538241:0:22665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350240.541731:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642768512 00000100:00100000:3.0:1783350240.541746:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642768512 00010000:00010000:3.0:1783350240.541793:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e421f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a2 expref: 17 pid: 22665 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350240.541845:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:3.0:1783350240.541856:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fd8619-94bf-44d4-83ae-710347291d72+17:2399:x1869977642768512:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783350240.541888:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783350240.541896:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e421f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a2 expref: 17 pid: 22665 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.541910:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e421f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a2 expref: 17 pid: 22665 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.541932:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347750000/0xd05e6ae1590e421f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5a2 expref: 17 pid: 22665 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.541961:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3600) 00010000:00010000:3.0:1783350240.541966:0:22650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.541977:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.541985:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.542021:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783350240.542075:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fd8619-94bf-44d4-83ae-710347291d72+16:2399:x1869977642768512:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 221us (4063us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350240.542083:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00010000:00010000:0.0:1783350240.542176:0:22665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.542184:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783350240.542307:0:22665:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1783350240.542421:0:22665:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1783350240.542469:0:22665:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1783350240.542542:0:22665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d8bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22665:1869977659640448:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783350240.542601:0:22665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350240.542637:0:22665:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350240.543278:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659640448 00000100:00100000:3.0:1783350240.543286:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659640448 00000100:00100000:3.0:1783350240.543331:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783350240.543340:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22665:x1869977659640448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783350240.543424:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22665:x1869977659640448:12345-0@lo:1000:mdt00_001.0 Request processed in 85us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350240.543453:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783350240.543971:0:22665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d8bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22665:1869977659640448:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1783350240.544172:0:22665:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1783350240.544241:0:22665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d8bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22665:1869977659640576:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783350240.544590:0:22665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350240.544621:0:22665:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350240.544741:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659640576 00000100:00100000:1.0:1783350240.544747:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659640576 00000100:00100000:1.0:1783350240.544784:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783350240.544792:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d8bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22665:x1869977659640576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783350240.544935:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d8bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22665:x1869977659640576:12345-0@lo:1000:mdt00_001.0 Request processed in 142us (344us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1783350240.544942:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783350240.545710:0:22665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d8bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22665:1869977659640576:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1783350240.545751:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545760:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545767:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545773:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783350240.545778:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545786:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545799:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3600) 00010000:00010000:0.0:1783350240.545802:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783350240.545807:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545812:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808e00/0xd05e6ae1590e4250 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545868:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545875:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545890:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545895:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783350240.545897:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545903:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545911:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:0.0:1783350240.545914:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783350240.545921:0:22665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e41b6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded586 expref: 19 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545932:0:22665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e41b6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded586 expref: 19 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545939:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e41b6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded586 expref: 19 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.545999:0:22665:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc800/0xd05e6ae1590e41b6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded586 expref: 19 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350240.546011:0:22665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d8bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22665:1869977659640704:192.168.203.50@tcp:105: 00000100:00100000:0.0:1783350240.546079:0:22665:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9780 going to sleep for 11 seconds 00000100:00100000:2.0:1783350240.552214:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350240.552391:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642768640 00000100:00100000:3.0:1783350240.552401:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642768640 00000100:00100000:3.0:1783350240.552455:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:3.0:1783350240.552466:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d6d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fd8619-94bf-44d4-83ae-710347291d72+20:18744:x1869977642768640:12345-192.168.203.50@tcp:49:dd.0 00000100:00100000:3.0:1783350240.552720:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d6d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fd8619-94bf-44d4-83ae-710347291d72+20:18744:x1869977642768640:12345-192.168.203.50@tcp:49:dd.0 Request processed in 255us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350240.552728:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1783350240.553356:0:22665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d8bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22665:1869977659640704:192.168.203.50@tcp:105: 00010000:00010000:0.0:1783350240.553401:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553412:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e41af lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553454:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e4257 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553468:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e4257 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553479:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e4257 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553489:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e4257 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553495:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e4257 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553502:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e4257 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553508:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d809800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783350240.553512:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e4257 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553518:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e4257 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553529:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:0.0:1783350240.553537:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783350240.553542:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e4257 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553548:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d809800/0xd05e6ae1590e4257 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553560:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553575:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553581:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553586:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783350240.553589:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553594:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553602:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:0.0:1783350240.553605:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783350240.553608:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.553613:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea37d808800/0xd05e6ae1590e4249 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350240.553749:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fd8619-94bf-44d4-83ae-710347291d72+19:18745:x1869977642768256:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 35571us (35828us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1783350240.553770:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 63 00000020:00080000:0.0:1783350240.553774:0:22665:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783350240.554515:0:22698:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783350240.554521:0:22698:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783350240.554538:0:22698:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1783350240.554545:0:22698:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1783350240.561843:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350240.561890:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350240.562174:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642769024 00000100:00100000:3.0:1783350240.562185:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642769024 00000100:00100000:3.0:1783350240.562245:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:3.0:1783350240.562256:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fd8619-94bf-44d4-83ae-710347291d72+19:18745:x1869977642769024:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783350240.562286:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642768768 00000100:00100000:2.0:1783350240.562290:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642768768 00000100:00100000:2.0:1783350240.562326:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:2.0:1783350240.562334:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+20:18744:x1869977642768768:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:2.0:1783350240.562357:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350240.562378:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751e00/0xd05e6ae1590e425e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded5b7 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.562422:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751c00/0xd05e6ae1590e4265 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.562447:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751c00/0xd05e6ae1590e4265 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.562457:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751c00/0xd05e6ae1590e4265 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.562539:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751e00/0xd05e6ae1590e425e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5b7 expref: 22 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.562555:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea347751c00/0xd05e6ae1590e4265 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5b7 expref: 21 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.562563:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ea2424c3900) 00010000:00010000:2.0:1783350240.562577:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783350240.562580:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea347751c00, rc 0) 00000100:00100000:2.0:1783350240.562638:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fd8619-94bf-44d4-83ae-710347291d72+22:18744:x1869977642768768:12345-192.168.203.50@tcp:101:dd.0 Request processed in 304us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350240.562645:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 64 00000004:00080000:3.0:1783350240.562665:0:22667:0:(mdd_object.c:4010:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783350240.562695:0:22667:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1783350240.562717:0:22667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e426c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.562727:0:22667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e426c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.562734:0:22667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e426c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.562741:0:22667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e426c lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.562755:0:22667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e426c lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350240.562761:0:22667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e426c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350240.563052:0:22667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783350240.563109:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fd8619-94bf-44d4-83ae-710347291d72+22:18745:x1869977642769024:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 855us (1218us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1783350240.563118:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000020:00080000:2.0:1783350240.563122:0:22667:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783350240.563283:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350240.563290:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e426c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.563297:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350240.563302:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e426c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.563309:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e426c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.563322:0:22653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ea2424c3600) 00010000:00010000:0.0:1783350240.563324:0:22653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783350240.563329:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e426c lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.563334:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd600/0xd05e6ae1590e426c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.563344:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350240.563346:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350240.563347:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350240.618927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350240.618992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.619071:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642769280 00000100:00100000:0.0:1783350240.619081:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642769280 00000100:00100000:0.0:1783350240.619186:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642769152 00000100:00100000:0.0:1783350240.619190:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642769152 00000100:00100000:0.0:1783350240.619212:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:0.0:1783350240.619222:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fd8619-94bf-44d4-83ae-710347291d72+9:2400:x1869977642769280:12345-192.168.203.50@tcp:4:dd.0 00010000:00010000:0.0:1783350240.619281:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.619300:0:24179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c023ebb/0xd05e6ae1590e4234 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5b0 expref: 9 pid: 24664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.619308:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350240.619312:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350240.619317:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.619351:0:24179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c023ebb/0xd05e6ae1590e4234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5b0 expref: 9 pid: 24664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.619365:0:24179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c023ebb/0xd05e6ae1590e4234 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5b0 expref: 9 pid: 24664 timeout: 781 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350240.619380:0:24179:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d8bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:24179:1869977659640832:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783350240.619461:0:24179:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783350240.623406:0:24179:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d8bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:24179:1869977659640832:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783350240.623440:0:24179:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350240.623927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350240.624206:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642769408 00000100:00100000:0.0:1783350240.624214:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642769408 00010000:00010000:0.0:1783350240.624409:0:22652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c023ebb/0xd05e6ae1590e4234 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5b0 expref: 10 pid: 24664 timeout: 781 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350240.624452:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:0.0:1783350240.624461:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fd8619-94bf-44d4-83ae-710347291d72+10:2399:x1869977642769408:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350240.624476:0:22652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350240.624497:0:22652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c023ebb/0xd05e6ae1590e4234 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5b0 expref: 10 pid: 24664 timeout: 781 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.624511:0:22652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c023ebb/0xd05e6ae1590e4234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5b0 expref: 10 pid: 24664 timeout: 781 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.624535:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c023ebb/0xd05e6ae1590e4234 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded5b0 expref: 10 pid: 24664 timeout: 781 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.624551:0:22652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350240.624555:0:22652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350240.624560:0:22652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.624570:0:22652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.624695:0:22652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350240.624756:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fd8619-94bf-44d4-83ae-710347291d72+9:2399:x1869977642769408:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 296us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350240.624774:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00010000:00010000:1.0:1783350240.624820:0:24179:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350240.624835:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783350240.705993:0:24992:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:3.0:1783350240.706019:0:24992:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:0.0:1783350240.706253:0:24179:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1783350240.706258:0:24179:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1783350238 -> 1783350239 00002000:00010000:0.0:1783350240.706269:0:24179:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1783350238 -> 1783350239 00002000:00010000:0.0:1783350240.706272:0:24179:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1783350240.706289:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.706303:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.706312:0:24179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.706320:0:24179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350240.706324:0:24179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.706333:0:24179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.706352:0:24179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.706359:0:24179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db7f37df/0xd05e6ae1590e4273 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350240.706461:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fd8619-94bf-44d4-83ae-710347291d72+6:2400:x1869977642769280:12345-192.168.203.50@tcp:4:dd.0 Request processed in 87236us (87538us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1783350240.706470:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:0.0:1783350240.706502:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:0.0:1783350240.706513:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fd8619-94bf-44d4-83ae-710347291d72+5:2400:x1869977642769152:12345-192.168.203.50@tcp:4:dd.0 00002000:00010000:0.0:1783350240.706550:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6a4bc3df, atime: 0x6a4bc3de, ctime: 0x6a4bc3df, blocks: 0x1a68 00010000:00010000:0.0:1783350240.706557:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e427a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.706569:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1783350240.706573:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350240.706579:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e427a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.706590:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e427a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783350240.766465:0:24992:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:0.0:1783350240.766828:0:24179:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1783350240.766849:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e427a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.766862:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e427a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.766871:0:24179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e427a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.766888:0:24179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea37d808e00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350240.766893:0:24179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e427a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.766902:0:24179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e427a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.766919:0:24179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e427a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350240.766998:0:24179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dead99c0/0xd05e6ae1590e427a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350240.767467:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fd8619-94bf-44d4-83ae-710347291d72+5:2400:x1869977642769152:12345-192.168.203.50@tcp:4:dd.0 Request processed in 60951us (148468us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1783350240.767482:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00010000:00010000:0.0:1783350241.028499:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350242.053198:0:23820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350242.189737:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783350242.189760:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d8bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659640960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783350242.189826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350242.190518:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659640960 00000100:00100000:0.0:1783350242.190528:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659640960 00000100:00100000:0.0:1783350242.190606:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783350242.190616:0:24176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37d81ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659640960:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783350242.190785:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1783350242.191321:0:24176:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783350242.191403:0:24176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37d81ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659640960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 787us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350242.191421:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783350242.191615:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d8bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659640960:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1783350242.574790:0:25751:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1783350242.701212:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783350242.701234:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659641088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350242.701313:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350242.701389:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659641088 00000100:00100000:3.0:1783350242.701398:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659641088 00000100:00100000:3.0:1783350242.701452:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783350242.701462:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659641088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783350242.701498:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1783350242.701510:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783350242.701519:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37d8bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659641216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783350242.701540:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659641088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350242.701544:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350242.701559:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783350242.701573:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659641216 00000100:00100000:3.0:1783350242.701576:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659641216 00000100:00100000:3.0:1783350242.701594:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783350242.701599:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659641216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783350242.701613:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783350242.701643:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659641216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350242.701649:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783350242.701708:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37d8bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659641216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350242.701807:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659641088:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783350243.077210:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350243.207469:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783350243.207494:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659641344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783350243.207577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350243.207676:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659641344 00000100:00100000:0.0:1783350243.207685:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659641344 00000100:00100000:0.0:1783350243.207769:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783350243.207780:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659641344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783350243.207808:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783350243.207857:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659641344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350243.207866:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1783350243.207937:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350243.208021:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659641344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783350243.716323:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783350243.716345:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659641472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783350243.716412:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350243.716455:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659641472 00000100:00100000:2.0:1783350243.716461:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659641472 00000100:00100000:2.0:1783350243.716505:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783350243.716513:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659641472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783350243.716541:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1783350243.716592:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659641472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350243.716600:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1783350243.716618:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783350243.716810:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659641472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783350243.717548:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3648:1869977659641600:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.717945:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350243.717986:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659642112:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.718020:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350243.718039:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659642624:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.718061:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350243.718080:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783350243.718117:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659641600 00000100:00100000:1.0:1783350243.718131:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659641600 00000100:00100000:1.0:1783350243.718190:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783350243.718197:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:3648:x1869977659641600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350243.718240:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8+24:3648:x1869977659641600:12345-0@lo:400:kworker.0 Request processed in 43us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350243.718247:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783350243.718390:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659641728:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.718424:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350243.718445:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659642240:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.718463:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350243.718476:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244e69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659642752:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.718489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350243.718510:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2239a5ab-360a-4f19-bf1f-f81ba58e2cb8:3648:1869977659641600:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.718541:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659641984:0@lo:400:kworker.0 00000100:00100000:2.0:1783350243.718772:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659642624 00000100:00100000:2.0:1783350243.718776:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659642624 00000100:00100000:2.0:1783350243.718805:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659642752 00000100:00100000:2.0:1783350243.718807:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659642752 00000100:00100000:2.0:1783350243.718823:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783350243.718830:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659642624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350243.718874:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659642624:12345-0@lo:400:kworker.0 Request processed in 45us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350243.718880:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783350243.718892:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783350243.718897:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659642752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350243.718946:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659642752:12345-0@lo:400:kworker.0 Request processed in 49us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350243.718951:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1783350243.718971:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783350243.718975:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783350243.719003:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659642112 00000100:00100000:2.0:1783350243.719006:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659642112 00000100:00100000:2.0:1783350243.719026:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659641728 00000100:00100000:2.0:1783350243.719029:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659641728 00000100:00100000:2.0:1783350243.719040:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783350243.719045:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659642112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350243.719077:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659642112:12345-0@lo:400:kworker.0 Request processed in 31us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350243.719083:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783350243.719094:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783350243.719100:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659641728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350243.719263:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659641728:12345-0@lo:400:kworker.0 Request processed in 163us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350243.719270:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783350243.719419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350243.719474:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659641856:0@lo:400:kworker.0 00000100:00100000:2.0:1783350243.719497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350243.719515:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659642368:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.719585:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659642496:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.719608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350243.722482:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37e5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659643008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783350243.722558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350243.722600:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659642240 00000100:00100000:3.0:1783350243.722617:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659642240 00000100:00100000:3.0:1783350243.722658:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659641856 00000100:00100000:3.0:1783350243.722661:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659641856 00000100:00100000:3.0:1783350243.722690:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783350243.722698:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659642240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.722756:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659642240:12345-0@lo:400:kworker.0 Request processed in 58us (4291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350243.722763:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783350243.722779:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783350243.722785:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37e5ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659641856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.722813:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37e5ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659641856:12345-0@lo:400:kworker.0 Request processed in 29us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350243.722818:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1783350243.722836:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783350243.722845:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659643008 00000100:00100000:3.0:1783350243.722848:0:24177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659643008 00000100:00100000:3.0:1783350243.722868:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783350243.722874:0:24177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659643008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783350243.722888:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1783350243.722930:0:24177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659643008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350243.722937:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783350243.722985:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659641728:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.722998:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659642240:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.723522:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244e69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659642752:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.723542:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659642112:0@lo:400:kworker.0 00010000:00080000:3.0:1783350243.723564:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea244e6bb80 x1869977659642624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350243.723574:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659642624:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.723614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350243.723698:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659641984 00000100:00100000:1.0:1783350243.723703:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659641984 00000100:00100000:1.0:1783350243.723738:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659642496 00000100:00100000:1.0:1783350243.723741:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659642496 00000100:00100000:1.0:1783350243.723764:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783350243.723769:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659641984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350243.723808:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659641984:12345-0@lo:400:kworker.0 Request processed in 38us (4389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350243.723819:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783350243.723831:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783350243.723836:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659642496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350243.723860:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659642496:12345-0@lo:400:kworker.0 Request processed in 24us (4251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350243.723865:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783350243.724316:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1783350243.724323:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea37e5cd880, transno 12884901892 00000004:00080000:2.0:1783350243.724336:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1783350243.724355:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659643008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783350243.724366:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659641984:0@lo:400:kworker.0 00000100:00100000:2.0:1783350243.724375:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659642496:0@lo:400:kworker.0 00000100:00080000:2.0:1783350243.724435:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783350243.725725:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659642880:0@lo:400:kworker.0 00000100:00100000:3.0:1783350243.725773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350243.725855:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659641856:0@lo:400:kworker.0 00000100:00100000:1.0:1783350243.725902:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659642368 00000100:00100000:1.0:1783350243.725908:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659642368 00000100:00100000:1.0:1783350243.725961:0:24663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659642880 00000100:00100000:1.0:1783350243.725964:0:24663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659642880 00000100:00100000:1.0:1783350243.725994:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783350243.726001:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659642368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350243.726054:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659642368:12345-0@lo:400:kworker.0 Request processed in 53us (2439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350243.726060:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783350243.726076:0:24663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783350243.726082:0:24663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659642880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350243.726107:0:24663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659642880:12345-0@lo:400:kworker.0 Request processed in 26us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350243.726112:0:24663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1783350243.726131:0:22660:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783350243.726384:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37e5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659642368:0@lo:400:kworker.0 00010000:00080000:3.0:1783350243.726398:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea244e6b800 x1869977659642880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350243.726485:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659642880:0@lo:400:kworker.0 00010000:00010000:0.0:1783350244.104260:0:22654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14153 lines, 14153 kept, 0 dropped, 0 bad.